JP3475074B2 - Data processing device - Google Patents

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a data processing apparatus for forming a synchronously reproducible multiplexed stream based on two or more related bit streams.

[0002]

2. Description of the Related Art DVD video objects (Video)
o Object) stream has a structure of a pack and a packet conforming to the MPEG standard. Therefore, it is possible to form a DVD video object stream by using a device that forms an MPEG standard program stream from two bit streams, an encoded video stream and an audio stream.

[0003]

In order to form a video object stream conforming to the DVD standard from a program stream of the MPEG standard, navigation data, which is information necessary for reproducing the video object stream, is processed. It must be extracted from the MPEG standard program stream and incorporated as a navigation pack. Therefore, the MPEG to be processed
It is necessary to analyze the standard program stream. However, this analysis processing requires a long time because the data amount of the program stream to be processed is large. The present invention is
An object of the present invention is to enable a video object stream conforming to the DVD standard to be formed at higher speed. Another object of the present invention is to enable a DVD standard video object stream to be generated using an apparatus for generating an MPEG standard program stream. Furthermore, the present invention enables an apparatus for generating a multiplexed stream conforming to a first standard to be used to generate a multiplexed stream conforming to a second standard different from the first standard. With the goal.

[0004]

According to a first aspect of the present invention, there is provided a data processing device for forming a multiplexed stream conforming to the first standard from two or more bit streams,
A packing unit that divides each bit stream into packs of processing units; a storage unit that extracts and holds pack information necessary for playback control of each pack generated by the packing unit from each pack; the information pack for holding information required for reproduction control of the reproduction units in the second standard stream is multiplexed stream conforms to standards,
For each minimum playback unit in the second standard stream,
The information pack generating means for generating dummy data by setting dummy data in the data part of the information pack, the element pack which is a pack generated by the packing means, and the information pack generated by the information pack generating means are multiplexed to generate the information pack. And a dummy data set in the data part of each information pack in the first standard stream generated by the multiplex means is held in the storage means. And a conversion unit for converting the first standard stream into the second standard stream by replacing the pack with the pack information corresponding to the information pack.

According to a second aspect of the present invention, in addition to the first aspect, the first standard stream generated by the multiplexing means and / or the second standard stream generated by the converting means.
A data processing device having a writing means for writing a standard stream to a predetermined recording medium. According to a third aspect of the present invention, in addition to the first or second aspect, the present invention further comprises operation input means for executing the operation of the conversion means, and the conversion means receives an operation input from the operation input means. The data processing device executes the conversion operation only when The invention of claim 4 relates to claim 1 to claim 3.
In any one of the above, the first standard is the MPEG standard, the second standard is the DVD standard, and the information pack is a navigation pack of the DVD standard. The navigation pack is a pack in which a reproduction start time, a reproduction end time, an address, an SCR (system clock reference) of a VOBU (video object unit) are recorded for reproduction control of a DVD standard video object stream, and a pack header. , System header (composed of system header start code, total bit rate, audio buffer size, video buffer size, private stream first buffer size, private stream second buffer size), PCI packet, and DSI packet. The navigation data is described in, for example, Japanese Patent Laid-Open No. 8-273304. The invention of claim 5 is any one of claims 1 to 4.
In the above, the two or more bit streams are a data processing device including a bit stream of encoded audio data and a bit stream of encoded video data.

[0006]

[0007]

BEST MODE FOR CARRYING OUT THE INVENTION A data processing apparatus according to an embodiment of the present invention will be described below with reference to FIGS. FIG. 1A is a block diagram of the data processing device 100. The data processing device 100 includes an operation unit 1 including a keyboard and a mouse for operating the data processing device 100, a monitor 2 for displaying the operation and processing status of the data processing device 100, and recorded data. Recording medium 3 for reading and storing data (eg CD
(ROM, MO, hard disk, etc.), drive control unit 5, system control unit 4, and system ROM / RAM 6 that operates under the control of the system control unit 4.

The drive controller 5 is, for example, a CD-ROM.
Drives and MO drives. That is, it depends on the type of the recording medium 3. The drive control unit 5 is controlled by the system control unit 4 and reads the data stored in the recording medium 3 to the system control unit 4 or the data output from the system ROM / RAM 6 to the recording medium. Write to 3. The system ROM / RAM 6 is a data processing program and data memory in the multiplexed stream generation of the data processing apparatus 100, and includes an elementary analysis section 7, a stream generation section 8, a log information recording section 9, and A navigation data recording unit 10 is provided.

FIG. 1B shows how the data processing apparatus 100 forms a multiplexed stream. 21 in the figure
And 22 are elementary streams. That is,
1 such as video stream or audio stream
It is a type of bitstream. Reference numeral 23 in the drawing denotes a multiplexed stream formed by the data processing apparatus 100, and here, a DVD video stream is illustrated. The multiplexing stream 23 is a unit of data (Vn, A) cut out from the element streams 21 and 22.
The audio pack A and the video pack V created by adding the time information and the like to the n) and the navigation pack N that is the control information for reproducing the DVD video are interleaved into one stream capable of synchronous reproduction. It is a stream. The data processing device 100 performs a series of data processing in which two or more elementary streams are divided into data of a predetermined unit to create a pack to which time information is added, and each pack is interleaved and multiplexed.

When the data processing apparatus 100 is activated, the system control unit 4 displays on the monitor 2 a screen (not shown) for inputting various conditions for creating a multiplexed stream. When the operator inputs the material data file of the multiplexed stream to be formed, the type of the output stream, the file name, etc. from the operation unit 1, the input setting conditions are stored in the memory of the system ROM / RAM 6. To be done.

The system control unit 4 operates the elementary analysis unit 7, the stream generation unit 8, and the log information recording unit 9 to create a multiplexed stream and log information, and the drive control unit 5 transfers them to the recording medium 3. Output and write. Then, the system control unit 4 sets the system ROM
A stream whose output stream type recorded in the memory of the RAM 6 requires navigation data (eg, D
In the case of VD standard video object stream), the navigation data recording unit 10 is further operated to set navigation data in the multiplexed stream recorded in the recording medium 3.

The process of creating a multiplexed stream controlled by the system control unit 4 will be described below in the order of the process of the elementary analysis unit 7, the process of the stream generation unit 8 and the process of the log information recording unit 9 with reference to FIGS. This will be described with reference to FIG.

FIG. 2 is a flowchart showing the operation of the elementary analysis section 7 of the system ROM / RAM 6. First, in step S31, the system control unit 4 can open and read the elementary stream of the recording medium 3 by referring to the material data file name of the stream generation condition stored in the memory of the system ROM / RAM 6. Set to state.

In step S32, it is determined whether the elementary analysis processing has ended. The analysis process ends when the read pointer of the elementary stream of the drive control unit 5 reaches the end of the elementary stream. While the data of the elementary stream can be read, the analysis processing of the following steps S33 to S36 is repeatedly executed. When the analysis process ends, the process proceeds to step S37, and the elementary stream is closed.

In step S33, the data of the elementary stream is read in order and the start code is searched. As the start code, the value specified in the standard of each elementary stream is used. For example, the start code of MPEG video is 0x
A total of 4 bytes (32 bits) consisting of 3 bytes arranged in a sequence of 000001 and 1 byte following this, and the 4th byte is used as a code for judging the data type. For example, start code 0x000001B3
Indicates that it is a sequence header by 0xB3 of the 4th byte. Similarly, start code 0x00000
1B8 indicates that it is a GOP header by 0xB8 of the 4th byte, and 0x00000100 indicates that it is a picture header by 0x00 of the 4th byte.

In step S34, the start code 4
Whether or not it is a header code is determined by the byte data. If it is not the header code, control is returned to step S32 to search for the next start code. If it is a header code, the process proceeds to step S35 and subsequent steps to analyze the header information.

In step S35, the system control unit 4 obtains header types such as a sequence header, a GOP header, and a picture header, and position information of the header in the elementary stream. The header position information is a value indicating at which byte from the head of the elementary stream the corresponding header code was recorded. The header type and header position information are for system ROM / RA
It is recorded inside the M6 as analysis information. In step S36, attribute information such as bit rate, frame rate, picture type, etc. is read from the inside of the header data and recorded in the system ROM / RAM 6.

When the analysis process of steps S33 to S36 is repeated and the elementary stream ends, the elementary stream is closed (S3).
7), the operation of the elementary analysis unit 7 ends.

3 and 4A are system ROMs.
-Stream generator 8 and log information recorder 9 of RAM 6
3 is a flowchart showing the operation of FIG. The stream generation unit 8 uses the STD (System) defined by the MPEG standard.
m Target Decoder; virtual decoder)
The stream is created so that the decryption operation in step 1 will be performed without any problem. That is, the SCR value added to the pack header and the pack order in the stream are controlled so that the STD input buffer prepared for each elementary stream does not overflow or underflow.

First, the system control section 4 executes step S4.
In 1, the elementary stream of the recording medium 3 is opened by referring to the material data file name of the stream generation condition stored in the memory of the system ROM / RAM 6 and set to a readable state. Further, the system control unit 4 refers to the output file name of the stream generation condition stored in the memory of the system ROM / RAM 6 and outputs the output file for accumulating the generated multiplexed stream to the recording medium 3. Open it and set it to a writable state.

In step S42, the buffer control parameter and the SCR parameter added to the pack header are initialized. As the buffer control parameter, STD
A data amount of the input buffer, a reduction amount parameter transferred from the STD input buffer, and a parameter indicating the maximum buffer capacity are prepared for each elementary stream. The data amount and reduction amount parameters are initialized to 0, and the maximum buffer capacity of each virtual buffer uses the value defined in the MPEG standard. SCR is the system clock of STD and is initialized to 0.

In step S43, it is determined whether or not the multiplexed stream generation process has ended. The generation process ends when the packing of all material data streams and the recording in the multiplexed stream are completed. The generation process of steps S44 to S56 is repeated while the material data remains. When the generation process ends, the process proceeds to step S57,
The material data file, output file, and log file are closed.

In steps S44 to S47, the pack to be recorded in the target multiplexed stream is determined. The private pack is, for example, a navigation pack which is reproduction information of the DVD video object stream. The navigation pack is used at the beginning of a stream or GOP (Group of Pictures) of a video.
e) Since it is recorded in units, it is preferentially judged when determining a pack.

When the conditions such as the recording of the first pack of the stream and the recording of the video GOP data are completed, a private pack is generated in step S48. In the private pack, only the pack header is set, and the data area is set in the padding byte (0xFF). That is, dummy data is set. The created private pack is output to the drive control unit 5 and written in the output file of the recording medium 3 by the drive control unit 5. After this, log information is recorded in step S52.

In step S45, it is determined whether the audio pack can be set. When possible, the value obtained by adding the data amount and the data size set in the packed data area is equal to or less than the maximum capacity of the audio buffer. That is, the audio virtual buffer does not overflow due to the set audio pack. If this condition is satisfied, the process proceeds to step S48, in which header information such as SCR or PTS value of the audio pack is set and the audio elementary stream read from the recording medium 3 via the drive control unit 5 is set as pack data. The audio pack is created. This audio pack is output to the drive control unit 5, and the drive control unit 5 outputs the recording medium 3
Will be written to the output file. After this, step S5
In 2, log information is recorded.

The processes of steps S45 and S49 are for setting an audio pack, but in the case of a video pack as well as in the case of an audio pack, if it can be set (YES in S46), it is generated (YES in S46). S5
0), log information is recorded (S52), and even in the case of a sub-picture pack (YES in S47), it is generated (S51) and the log information is recorded (S5).
2).

No private pack is required (N in S43
O), if the audio pack, video pack, and sub-picture pack cannot be set (S45, S46, S47)
No in either case), the process proceeds to step S53. Step S5
In 3, the SCR value is updated with a value obtained by adding the transfer time per pack obtained based on the total bit rate of the multiplexed stream. This updated value is added as header information of the next pack.

In step S54, the data amount of each virtual buffer is calculated. When the pack is created and recorded in the multiplexed stream in steps S48 to S51, the data size set in the pack data area is added to the data amount of the created virtual buffer of the pack.
For example, when the audio pack is created and recorded in the multiplexed stream in step S49, the data amount of the audio virtual buffer increases by the data size set in the pack. Further, the value set as the reduction amount of each virtual buffer is subtracted from the data amount of all virtual buffers. The parameter indicating the reduction amount is set in step S4.
Since it is initialized to 0 in step 2, until the buffer decrease amount calculation process of step S56 (described later) is executed,
The amount of data in the buffer continues to increase.

In step S55, steps S44-S
As a result of the processing of 54, it is determined whether or not the initialization of each virtual buffer is completed, that is, whether or not each virtual buffer is in the buffer full state. In STD, the reproduction is started when the STD input buffer becomes full, so that the virtual buffer is also in the buffer full state as the reproduction start time. Therefore, no data is transferred from the buffer until the virtual buffer is initialized to buffer full.

When the initialization of each virtual buffer is completed in step S55, the amount of data transferred from each virtual buffer to the decoder, that is, the amount of data reduction due to the reproduction of the multiplexed stream is calculated in step S56. . This data reduction amount is the amount of data estimated to be transferred from each virtual buffer to the decoder while one pack is input to the STD input buffer. The amount of data reduction is
It is calculated using the bit rate value recorded as attribute information in the elementary analysis unit 7.

In calculating the reduction amount of video data, VBR is calculated.
Since it corresponds to an elementary stream encoded by the encoding method, it is necessary to recalculate the data reduction amount in GOP units. Specifically, the cumulative amount of data reduction from the virtual buffer is the GOP recorded in the multiplexed stream.
When the data size is reached, it is assumed that the bit rate value has changed, and the data reduction amount is calculated at the bit rate of the next GOP, and is set in the parameter indicating the reduction amount.

If the initialization of the virtual buffer is not completed in step S55, or if the setting of the decrease amount parameter is completed in step S56, the control is returned to step S43. By repeating the processing of steps S43 to S56 described above, a multiplexed stream is generated from the elementary stream recorded as the material data file. When the stream recording of all material data is completed, the material data file and the output file are closed (S57), and the operation of the stream generation unit 8 is completed.

As described above, the elementary analysis section 7,
By the operations of the stream generation unit 8 and the log information recording unit 9, a multiplexed stream that can be used as an MPEG program stream is created. Further, in the recording medium 3, the log information recording unit 9 creates a log information file regarding a pack sequence at the time of stream generation.

FIG. 4B shows the format of the log information file. The log information file 90 is, as described above,
It is composed of a pack information string created by recording pack information at any time when recording a pack of an MPEG standard multiplexed stream. Each pack information is a code (0x004E, 0x0041, 0x005) indicating a pack type.
6, 0x0053), and the pack No. serially counted for each pack recording with the head pack of the multiplexed stream as 0. And PTS indicating the start time of the pack playback
And extended information.

The pack information 91 is recorded in the log information file 90 when the private pack is interleaved in the multiplexed stream. In the pack information 91, PT
S is 0, extended information is SCR of pack header Indicates the value set in the base item. The pack information 92 is recorded in the log information file 90 when the audio pack is interleaved in the multiplexed stream. Pack information 9
Stream IDs (0 to 7) are set in the extension information of No. 2. The pack information 93 is, when a video pack including a picture header is interleaved in a multiplexed stream,
It is recorded in the log information file 90. The extension information of the pack information 93 includes pack N including the final data of the picture.
o. And the picture type are recorded as the image reference information. The pack information 94 is recorded in the log information file 90 when the sub-picture pack is interleaved in the multiplexed stream. The stream ID (0 to 31) is set in the extension information of the pack information 94.

The log information file 90 having the above configuration is referred to by the navigation data recording unit 10 when creating a multiplexed stream that requires navigation data, here, a video object stream of the DVD standard. That is, the MPEG formed as described above.
When converting a standard multiplexed stream into a DVD standard video object stream, it is referred to as follows.

FIG. 5 is a flow chart showing the operation of the navigation data recording section 10 of the system ROM / RAM 6. The system controller 4 is a system ROM / R.
If the stream type of the stream generation condition recorded in the memory of the AM6 is a DVD video object, in other words, if the stream requires navigation data, the navigation data recording unit 1
0 operation.

First, in step S61, the system RO
The output file name of the stream generation condition stored in the memory of the M / RAM 6 is referred to, the multiplexed stream of the recording medium 3 and the log information file at the time of stream generation are opened and set to a readable state.

In step S62, the pack information is retrieved from the log information, and the pack number of the VOBU (video object stream unit) is searched. A VOBU table recording the presence / absence of video information and the reproduction and end times of the VOBU is created. First, the log information file 90 is sequentially read, and the private pack information (type: 0x004
When the pack of E) is found, the pack No. Is extracted. The number of video packs (type: 0x0056) is counted until the next private pack is found, and if the number of video pack information is not 0, it is set to "video data present" in the VOBU table. If the count number is 0, "no video data" is set.

The number of private packs can be obtained by searching all pack information. The value obtained by dividing the total playback time of the multiplexed stream by the number of private packs is the VOBU playback interval. The VOBU table holds the reproduction end time by adding the reproduction interval to the reproduction start time. The reproduction end time is set as the reproduction start time of the next VOBU.

In step S63, it is checked whether or not a file in which highlight information, which is a part of navigation data, is recorded is present at a predetermined position of the recording medium 3, and if the file is present, it is opened and readable. Is set to a different state. The highlight recording file is a data file in which the data of the highlight information is edited and saved by the operator of the data processing apparatus 100, and like the material data file, a predetermined file name (example It is stipulated in operation that a file name with an extension of HLI) is prepared.

If a highlight recording file exists, the reproduction period information is read out in step S64, and HL is read.
An I table is created. The HLI table includes an HLI reproduction start time, a reproduction end time, and a file pointer when the highlight recording file is opened. When the VOBU table and the HLI table are prepared as described above, the recording of navigation data is started.

In step S65, it is determined whether or not the navigation data has been set / recorded in all private packs in the multiplexed stream. While there is an unrecorded private pack, the navigation data setting process of steps S66 to S73 is repeated.

In step S66, the system header of the navigation pack is set. As the system header, a value defined by the DVD video standard is used. In step S67, general information about reproduction control is set.
That is, from the VOBU table, the private pack pack number. Is read out and the pack number of the navigation pack is read. Is set as. Also, the reproduction start time information and the reproduction end time information are read and set.

In step S68, it is checked whether or not the reproduction start time information and the reproduction end time information in the VOBU table and the reproduction time information in the highlight table overlap, and if there is overlapping information, the corresponding highlight information is highlighted. Data is read from the recording file pointer and set as highlight information.

In step S69, general information regarding data search is set. As the main data, general information about the reproduction control in step S67 can be used.
The reference image information in the VOBU is set by reading the image reference information from the log information of the video pack recorded in the log information file.

In step S70, seamless reproduction information is set. The display start time and display end time can be set by obtaining the reproduction time information from the log information of the video pack recorded in the log information recording file.

In step S71, the VOB currently being set is set.
The address information of the VOBU to be reproduced at the specified reproduction start time before and after the U navigation data is recorded and the presence / absence of a video are recorded as VOBU search information. For the address information, the reproduction start time of the VOBU table is searched, and the pack number of the corresponding VOBU. (Number) and the pack number currently set. It can be calculated by calculating the difference between and. Regarding the presence / absence of video, the number of pictures of the corresponding VOBU is checked, and if the number of pictures is 0, it means “no video”, and if it is 1 or more, it means “video exists”.

In step S72, the VOB currently being set is set.
Audio packs and sub-picture packs that are played back at the same time as or immediately after the playback start time of the U table are searched,
Pack number of the corresponding VOBU. And the pack number currently set. It is set as the synchronization information based on the difference between and.

The navigation data composed of the system header, the reproduction control information, and the data search information set as described above is set in the data memory in the navigation data recording section 10 and output to the drive control section 5 in step S73. Then, the data is recorded in the data area in the private pack in the multiplexed stream of the recording medium 3. As a result, the private pack in the multiplexed stream is recognized as the navigation pack.

When the processing of steps S66 to S73 is completed for all navigation packs, the HLI recording file, stream recording file, and log information file are closed and the processing ends.

[0052]

According to the present invention, when creating a multiplexed stream of the first standard, the pack information of each pack is stored in the memory, and the data section is used as dummy data in the multiplexed stream of the first standard. In order to incorporate the information pack
By setting the pack information in the dummy data section, the multiplexed stream of the second standard can be created at high speed without newly analyzing the multiplexed stream of the first standard.

[Brief description of drawings]

FIG. 1 is a block diagram showing a data processing device of the present embodiment (a), and an explanatory diagram showing how a multiplexed stream of 1 is created from 2 elementary streams.

FIG. 2 is a flowchart showing a processing procedure of an elementary analysis unit 7 in FIG.

3 is a flowchart showing a part of a processing procedure of a stream generation unit 9 in FIG.

FIG. 4 is a flowchart (a) showing the remaining part of FIG. 3 and an explanatory diagram (b) showing the configuration of a log information file.

5 is a flowchart showing a processing procedure of a navigation data recording unit 10 in FIG.

[Explanation of symbols]

21 Video Elementary Stream 22 Audio Elementary Stream 23 multiplexed streams N navigation pack

Claims (5)

(57) [Claims] 1. A data processing device for forming a multiplexed stream conforming to a first standard from two or more bit streams, comprising: a packer for dividing each bit stream into packs of processing units. Storage means for extracting and holding, from each pack, pack information necessary for reproduction control of each pack generated by the packing means, and reproduction in a second standard stream which is a multiplexed stream conforming to the second standard. An information pack for holding information necessary for unit-based reproduction control is stored in the second standard stream.
Information pack generation means for setting and generating dummy data in the data part of the information pack for each minimum reproduction unit , element packs that are packs generated by the packing means, and information generated by the information pack generation means It is set in the data unit of each information pack in the first standard stream generated by the multiplexing unit, and the multiplexing unit that multiplexes the pack with each other to generate the first standard stream conforming to the first standard. A data processing device comprising: a conversion unit that converts the first standard stream into a second standard stream by replacing the dummy data with the pack information corresponding to the information pack stored in the storage unit. 2. The first standard stream according to claim 1, further comprising:
And / or a writing means for writing the second standard stream generated by the converting means on a predetermined recording medium. 3. The method according to claim 1 or 2, further comprising operation input means for executing the operation of the conversion means, wherein the conversion means receives an operation input from the operation input means. A data processing device, which performs the conversion operation only when the data is broken. 4. The navigation pack according to any one of claims 1 to 3, wherein the first standard is an MPEG standard, the second standard is a DVD standard, and the information pack is a DVD standard. so
There is a data processing device. 5. The code stream according to any one of claims 1 to 4, wherein the two or more bit streams are encoded audio.
Video data bitstream and encoded video
A data processing device that includes a bitstream of data.