JP2965149B2 - Multimedia encoding method, multimedia encoder, and recording medium recording multimedia encoding program - Google Patents

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

[0001] The present invention relates to a system for transmitting multimedia information, and more particularly to a multimedia encoder.

[0002]

2. Description of the Related Art FIG. 11 shows a conventional multimedia encoder. This multimedia encoder includes a video encoding unit 14v, an audio encoding unit 14a, and a video packetizing unit 1
6v, a voice packetizing unit 17a, a user data packet unit 16u, and a multiplexing unit 18.

[0003] A video encoder 14v and an audio encoder 14a
Encodes video 11 and audio 12, respectively, and outputs video stream 15v and audio stream 15a. The video packetizer 16v, the audio packetizer 16a, and the user data packetizer 16u respectively transmit the video stream 1
The video packet 17v, the audio packet 17a, and the user data packet 17u are generated by adding the time information and the header information generated from the reference clock 21 to the 5v, the audio stream 15a, and the user data 13. Multiplexer 18
Performs time division multiplexing of the video packet 17v, the audio packet 17a, and the user data packet 17u to generate a single multiplexed stream 19 and transfer it to the transmission medium 20.

FIG. 12 shows the structure of a multiplexed stream 19 for a storage medium. Multiplexed stream 19 for storage
In order to enable random access to the information multiplexed therein, a directory table 24 for storing the header position and time information of the packet and a directory packet 23 for storing the information are defined as the syntax. I have. The directory table 24 registers a preceding adjacent table packet position 25, a rear adjacent table packet position 27, and header position / time information 26.

On the decoder side, a directory table 24 in which packets to be searched are registered is searched, and the target packets are searched according to the directory table 24.

[0006] The multiplexed stream 19 is basically an MPE.
G1 / SYSTE and MPEG2 / TS, TS are assumed. The directory table 24 and the directory packet 23 are assumed to be multiplexed into a bit stream stored in a storage medium such as a DVD or an LD. In such storage media, a random access (for example, cueing) function of the content in the stream is indispensable. The directory packet 23 is a packet that carries a directory table 24. The directory table 24 stores position information and time information of each packet to speed up random access to the packet. However, by itself, the decoder can convert a huge number of bits of the multiplexed stream into a directory table 2
4 (table packet 25), so if one table packet is searched,
The position of the adjacently placed table packet can be found immediately by referring to the adjacent table positions 25,27. Thus, the speed of random access is increased.

The conventional encoder multiplexes the directory packet 23 onto the multiplexed stream 19 in the following two ways.

[0008] 1. Once, all video packets 17v and audio packets 17a are multiplexed into a multiplexed stream 19 without a directory table, and then one directory table 24 is generated while searching for a multiplexed stream packet position without a directory table. A two-pass method added to the stream 19.

[0009] 2. A fixed value is set in the preceding adjacent table position 25 and the rear adjacent table position 27, and each time the multiplexing detects the head position of the packet, the directory table 2
4 is a one-pass method in which directory table packets 23 are inserted at regular intervals while registering packet position / time information.

In the one-pass format, in order to insert a plurality of tables into one multiplexed stream, it is necessary to count the number of bytes between table packets at the same time as multiplexing and to count adjacent table packets. The length of the packet to be transmitted is generally unfixed, and there is a difficult problem such as determination of the number of digits of a packet length counter. For this reason,
The table packet is generated by fixing the value of the adjacent table position to a fixed value while keeping the interval between the table packets constant.

As an example using the above conventional encoder,
GLOBCOM '95, 13.4 “MPEG2 Videoand Audio CODEC Bo
ard Set for Personal Computer ”.
Also, “MPEG2 Video and Audio CODEC Board Set for
The European Design and Test Conference (ED
& TC) 1996 ”A Memory-based Aechitecture for MPEG2
System Protocol LSIs ”are introduced.

[0012]

A conventional two-pass encoder does not preserve the structure of a multiplexed stream that has already been generated, that is, the encoder determines which byte from the head of the stream each packet is. Therefore, once a multiplexed stream of some form has been generated, it is necessary to search the packet header one byte at a time from the beginning again, and it takes a lot of time to search and enumerate the header and time information. However, it hindered the efficiency of directory table generation and multiplexed bitstream editing.

The multiplexing of a plurality of directory tables by the one-pass method (placement of a plurality of tables in one multiplexed stream) requires a search time for the directory table, and the time required for editing the multiplexed bit stream is increased. It hinders efficiency and increases the amount of data in the table header,
This hindered efficient use of storage space.

In both the one-pass system and the two-pass system, since an audio stream, a video stream, and a user data stream are multiplexed in non-real time using software or the like, information on intermediate products such as streams and packets is encoded. Therefore, it took an enormous amount of time to search and enumerate streams, packet header positions, and time information in non-real time, which hindered the efficiency of packetization and multiplexing processing by software and the like.

It is an object of the present invention to provide a multimedia encoding method, a multimedia encoder, and a recording medium on which a multimedia encoding program is recorded, in which header and time information can be enumerated and searched efficiently.

[0016]

SUMMARY OF THE INVENTION The present invention provides a method for synthesizing a coded stream of video, audio, and user data, a packet, and a multiplexed bit stream in parallel with the generation of a multiplexed bit stream of video and audio and user data. Then, time information indicating the stream position, the header position of the packet, and the reproduction time of the video, audio, and user data in the system time is stored in the database.

By making a database of search results in parallel with packetization and multiplexing, search of a header position and enumeration and search of all data in a multiplexed stream of time information can be efficiently performed.

[0018]

Next, embodiments of the present invention will be described with reference to the drawings.

Referring to FIG. 1, a multimedia encoder according to a first embodiment of the present invention includes a packetizing section 16, a multiplexing section 18, syntax analyzing sections 28s, 28p, 28b, and data registering sections 29s, 29p, 29b. It is composed of a database 30.

The packetizer 16 and the syntax analyzer 28s input the video stream 15v, the audio stream 15a, and the user data 13 in parallel. The packetizer 16 packetizes the video stream 15v, the audio stream 15a, and the user data 13, and outputs a video packet 17v, an audio packet 17a, and a user data packet 17u.
The syntax analysis unit 28s calculates a relative position 31 from the head of each individual stream of the header for each of the video stream 15v, the audio stream 15a, and the user data 13, and outputs the calculated position to the data registration unit 29s.
The data registration unit 29s registers information output from the syntax analysis unit 28s in the database 30. The multiplexing unit 18 and the syntax analysis unit 28p transmit the video packet 17v and the audio packet 1
7a and the user data packet 17u are input in parallel. The syntax analysis unit 28p detects a packet header for the video packet 17a, the audio packet 17a, and the user data packet 17u, calculates a relative position 32 from the head of the packet sequence of the packet header, and obtains time information 33.
p, and outputs these to the data registration unit 29p.
The data registration unit 29p registers the information output from the syntax analysis unit 28p in the database 30. The multiplexing unit 18 multiplexes the video packet 17v, the audio packet 17a, and the user data packet 17v, and outputs a multiplexed bit stream 19 to the transmission medium 20 and the syntax analysis unit 28b. The syntax analysis unit 28b detects the packet header in the bit stream 19, calculates the absolute position 34 of the packet header from the head of the bit stream, generates time information 33b, and outputs these to the data registration unit 29b. The data registration unit 29b registers the information output from the syntax analysis unit 28p in the database 30.

Here, the time information 33p, 33b means that the encoder uses a predetermined system clock (2 in MPEG2).
8 MHz), and counts the system clock (for example, the system start time is set to “0”), which is the time of the system, and is generated from the value of the system clock counter when the packet header is generated ( Rounding,
The significant figures are taken out by truncation).

The information registered in the database 30 is used when registering the header position and its time information in the directory table during media multiplexing and directory table generation and multiplexing.

Referring to FIG. 2, a multimedia encoder according to a second embodiment of the present invention includes an encoding unit 14, a packetizing unit 16, a multiplexing unit 18, and data registration units 29s and 29.
p, 29b and a database 30.

The encoding unit 14 encodes the video 11 and the audio 12 respectively, outputs the video stream 15v and the audio stream 15a, and outputs the generated code amount 35. The data registration unit 29 s stores the generated code amount 35 output from the encoding unit 14 and the history information (current access unit in each of audio and video (information stored in one packet, one screen frame for video, audio frame for audio) (A coding unit referred to as “encoding unit”) and the number of the current access unit, which is currently stored and temporarily stored in the data registration unit 29s, etc.). The position is calculated and registered in the database 30.

In audio and video encoding, generally, the generated code amount required for the current access unit is measured to control the generated code amount. Based on this generated code amount and the total code amount in the so-called history information, the current access unit stream is the number of the video and audio access unit, and the current access unit is a byte (bit) after the coding is started. You can see if there is (relative position).

The packetizer 16 converts the video stream 15
v, the audio stream 15a, and the user data 13 are input and packetized, and the video packet 17v, the audio packet 17a, and the user data packet 17u are output. The packet length 36 of each video, audio, and user data packet and its time information 33p is output to the data registration unit 29p. The data registration unit 29p calculates the relative position from the beginning of the packet sequence of the packet header based on the packet length 36 and the history information (registered in the data registration unit 29p), and registers the relative position and the time information 33p in the database 30. .

Here, the history information indicates the total number of bytes (bits) of packets packetized up to the current access unit in each of audio and video, and the number of audio and video packets. In this way, it is possible to determine at which byte in the series of audio and video packets the packet is based on the total number of bytes of the packet generated in the past and the current number of packets.

The multiplexing unit 18 multiplexes the video packet 17v, the audio packet 17a, and the user data packet 17u, and outputs the multiplexed data to the transmission medium 20 as a bit stream 19.
3b is output to the data registration unit 29b. Data registration unit 2
9b calculates the absolute position of the packet header from the head of the bit stream from the packet interval 37, and obtains the time information 33b.
And the absolute position are registered in the database 30. The absolute position indicates, in a multiplexed stream in which audio and video are multiplexed, where the head of a packet storing a certain access unit is located in the multiplexed stream. This can be understood by the multiplexing unit 18 recognizing the code amount generated by multiplexing up to that time.

Referring to FIG. 3, the multimedia encoder according to the third embodiment of the present invention includes a data registration unit 29 instead of the data registration units 29s, 29p and 29b in the first embodiment of FIG. And register 38
s, 38p ₁ , 38p ₂ , 38b ₁ , 38b ₂ , the data registration unit 29 and the registers 38s, 38p ₁ , 38p ₂ ,
A bus 39 is provided between 38b ₁ and 38b ₂ .

The syntax analysis unit 28s stores the header position 31 in register 38s, the syntax analysis unit 28p packet header position 32 in register 38p _1, and stores the time information 33p to register 38p _2, parsing unit 28b packets the absolute position 34 in register 38b _1, and stores the time information 33b to the register 38b _2, registers the interrupt associated with these operations to the data registration unit 29 38s, 38
Request reading of p ₁ , 38p ₂ , 38b ₁ , 38b ₂ .

The data registration unit 29 stores the registers 38s, 38
The data of p ₁ , 38p ₂ , 38b ₁ , 38b ₂ is read out before being updated, and registered in the database 30.

Referring to FIG. 4, the multimedia encoder according to the fourth embodiment of the present invention differs from the multimedia encoder according to the second embodiment shown in FIG.
A data registration unit 29 is provided in place of s, 29p, and 29b,
Furthermore register _{38s, 38p 1, 38p 2,} 38b 1,
And 38b _2, the data registration unit 29 and the register 38s, 38
between _{p 1, 38p 2, 38b 1} , 38b 2 are those having a bus 39.

The syntax analysis unit 28s registers the code generation amount 35
The parser 28p stores the packet length 3
6 to register 38p₁And the time information 33p in the register 3
8p_TwoAnd the parsing unit 28b sets the header interval 37
Register 35b₁The time information 33b is stored in the register 38b._Two
In the data registration unit 29 accompanying these operations.
Register 38s, 38p by interrupt₁, 38p_Two, 3
8b₁, 38b_TwoRequest for reading. Data registration unit 2
9 is a register 38, 38p₁, 38p_Two, 38b ₁, 38
b_TwoData is read before being updated, and the database
Registered in the server 30.

Referring to FIG. 5, the multimedia encoder according to the fifth embodiment of the present invention is such that the data registration unit 29 and the database 30 are realized by the general-purpose computer 40 in the embodiment of FIG.

Referring to FIG. 6, the multimedia encoder according to the sixth embodiment of the present invention is different from the multimedia encoder according to the fourth embodiment shown in FIG.
Is realized by the general-purpose computer 40.

Referring to FIG. 7, a multimedia encoder according to a seventh embodiment of the present invention includes an encoding unit 14, a packetizing unit 16, a multiplexing unit 18, and a syntax analyzing unit 28p.
And a data registration unit 29p, a database 30, and storage units 22 ₁ , 22 ₂ , and 22 ₃ for temporarily storing packets in parallel with the syntax analysis unit 28p.

The multiplexing unit 18 searches the header information of the video packet 17v and the audio packet 17a stored in the storage devices 22 ₁ and 22 ₂ at high speed by referring to the database 30, and searches for the video packet 17v and the audio packet 17a.
And a user data packet 17u, and outputs a bit stream 19. Others are the same as the first embodiment.

Referring to FIG. 8, a multimedia encoder according to an eighth embodiment of the present invention includes an encoding unit 14, a packetizing unit 16, a multiplexing unit 18, and a parsing unit 28s.
And a storage unit 22 ₁ , 22 ₂ , 22 ₃ for temporarily storing the video stream 15, the audio stream 15a, and the user data 13 in parallel with the data registration unit 29s, the database 30, and the syntax analysis unit 28p. I have.

The packetizing section 16 comprises storage devices 22 ₁ , 22
₂ are stored in the video packet 17v and the audio packet 17
The header information and the time information a are searched at high speed by referring to the database 30, the video packet 17v, the audio packet 17a and the user data packet 17u are multiplexed, and the bit stream 19 is output. Others are the same as the first embodiment.

Referring to FIG. 9, the multimedia encoder according to the ninth embodiment of the present invention refers to a directory table non-creating encoder 41 that does not create a directory table, a syntax analyzer 28, and a directory table referring to a database 30. And a multiplexing unit 45 for multiplexing the multiplexed stream 43 without a directory table and the directory table packet.

Directory table non-creating encoder 4
1 and the parsing unit 28 encode, packetize, and multiplex the video 11, the audio 12, and the user data 13 in the same manner as in the first to eighth embodiments, and a multiplexed stream 43 without a directory table and a database 30. Create The directory table creator 42 refers to the database 30 and generates a directory table packet 44 of the multiplexed stream 43 without a directory table.

When the multiplexed stream 43 without directory table and the directory table packet 44 are all generated by the above method, the multiplexing unit 45 multiplexes both to generate the multiplexed stream 19 for storage media.

Referring to FIG. 10, the multimedia encoder according to the tenth embodiment of the present invention includes an input device 51, a database 52, an output device 53, a recording medium 54, and a data processing device 55.

The input device 51 is for inputting the video 11, the audio 12, the user data 13 or the video stream 15v, the audio stream 15a, and the user data 13 to the data processing device 55. The database 52 is shown in FIGS.
This corresponds to the database 30 in FIG. Recording medium 54
Is an FD, CD-ROM, semiconductor, or the like in which a multimedia encoding program including packetization, multiplexing, syntax analysis, data registration, and directory table creation described in the first to ninth embodiments is recorded. It is a recording medium such as a memory. The data processing device 55 includes the recording medium 5
4 to read the multimedia encoding program, execute the processing described in the first to ninth embodiments, store the data in the database 52,
9 is output to the output device 53. The output device 53 transmits the bit stream 19 to the transmission medium 20.

[0045]

As described above, according to the present invention, search and enumeration of header and time information can be performed at high speed by storing the history of the structure of a multiplexed stream that has already been generated in parallel with encoding. It is possible to 1. It is possible to speed up generation of a single directory table for one program in a multiplexed stream and reduce storage area consumption by a directory table packet header. By obtaining information about intermediate products of encoding such as streams and packets, streams in non-real time,
As a result, it is possible to speed up the search and enumeration of the packet header position and time information, and to increase the efficiency of packetization and multiplexing processing by software or the like.

[Brief description of the drawings]

FIG. 1 is a configuration diagram of a multimedia encoder according to a first embodiment of the present invention.

FIG. 2 is a configuration diagram of a multimedia encoder according to a second embodiment of the present invention.

FIG. 3 is a configuration diagram of a multimedia encoder according to a third embodiment of the present invention.

FIG. 4 is a configuration diagram of a multimedia encoder according to a fourth embodiment of the present invention.

FIG. 5 is a configuration diagram of a multimedia encoder according to a fifth embodiment of the present invention.

FIG. 6 is a configuration diagram of a multimedia encoder according to a sixth embodiment of the present invention.

FIG. 7 is a configuration diagram of a multimedia encoder according to a seventh embodiment of the present invention.

FIG. 8 is a configuration diagram of a multimedia encoder according to an eighth embodiment of the present invention.

FIG. 9 is a configuration diagram of a multimedia encoder according to a ninth embodiment of the present invention.

FIG. 10 is a configuration diagram of a multimedia encoder according to a tenth embodiment of the present invention.

FIG. 11 is a configuration diagram of a conventional example of a multimedia encoder.

FIG. 12 is a diagram showing the structure of a storage use bit stream.

[Explanation of symbols]

Reference Signs List 11 video 12 audio 13 user data 14v video encoding unit 14a audio 15v video stream 15a audio stream 16 packetization unit 17v video packet 17a audio packet 17u user data packet 18 multiplexing unit 19 bit stream 20 transmission media 22 ₁ , 22 ₂ , 22 ₃ Storage device 28s, 28p, 28b, 28 Syntax analysis unit 29s, 29p, 29b, 29 Data registration unit 30 Database 31 Header position 32 Packet header position 33p, 33b Time information 34 Absolute position in packet header bit stream 35 Code generation amount 36 packet length 37 packet interval 38 s, 38 p ₁ , 38 p ₂ , 38 b ₁ , 38 _{b 2} register 39 bus 40 computer 41 directory table not created encoder 42 directory table created Component 43 Multiplexed stream without directory table 44 Directory table packet 45 Multiplexer 51 Input device 52 Database 53 Output device 54 Recording medium 55 Data processing device

──────────────────────────────────────────────────続 き Continued on the front page (51) Int.Cl. ⁶ identification symbol FI H04N 7/24 (58) Fields investigated (Int.Cl. ⁶ , DB name) H04L 12/56 H04J 3/00 H04N 7/025 -7/035 H04N 7/24

Claims (19)

(57) [Claims] 1. A multimedia encoding method for multiplexing multimedia information and transmitting the multiplexed multimedia information to a transmission medium, comprising the steps of: generating a multiplexed bit stream of video, audio, and user data; , Analyzing the packet and the multiplexed bit stream, and storing in a database time information representing the stream, the header position of the packet, and the decoding and reproduction times of the video, audio and user data in the system time. Multimedia encoding method. 2. A video stream, an audio stream, and a user data are calculated with respect to a relative position from a stream head in each individual stream of a header, and the relative position is stored in a database. In addition to detecting the packet header, calculating the relative position of the packet header from the beginning of the packet sequence, generating time information representing the playback time of video, audio, and user data in system time, Storing the time information in a database, detecting a packet header in the multiplexed bit stream,
An absolute position of the packet header from the head of the bit stream is calculated, time information representing a reproduction time of video, audio, and user data is generated in system time, and the absolute position and the time information are stored in a database. The method of claim 1. 3. A multimedia encoding method for multiplexing multimedia information and transmitting the multiplexed multimedia information to a transmission medium, wherein, in video and audio encoding, a generated code amount is detected along with a process of adding a header to a video and audio stream. The relative position of the packet header from the head of the stream is calculated from the generated code amount and the history information, and the relative position is stored in a database. The video stream, the audio stream, and the user Along with the process of adding a header to each packet of data, and the process of adding time information indicating the playback time of video, audio, and user data in system time, the packet length of each packet of video, audio, and user data and the time Information from the beginning of the packet sequence in the packet header based on the packet length and the history information. Calculating a position, storing the relative position and the time information in a database, and multiplexing the video packet, the audio packet, and the user data packet, adding a header to a bit stream, and processing video, audio, and user data. A packet interval between headers and time information are obtained in association with a process of adding time information representing the reproduction time of the system in system time, and the absolute position of the packet header from the head of the bit stream is calculated from the packet interval. A multimedia encoding method, wherein information and the absolute position are stored in a database. 4. A multimedia encoding method for multiplexing multimedia information and transmitting the multiplexed multimedia information to a transmission medium, wherein packetization of a video stream, an audio stream, and user data adds a header to each packet of video, audio, and user data. Along with the processing of adding time information representing the processing time of the video, audio, and user data in system time, the packet length of each video, audio, and user data packet and the time information are detected, and the packet length is detected. Calculating the relative position of the packet header from the beginning of the packet sequence from the history information, storing the relative position and the time information in a database, and referring to the database for header information of video packets and audio packets. Search and convert video, audio, and user data packets into a multiplexed bit stream Multimedia encoding method, characterized by redundant. 5. A multimedia encoding method for multiplexing multimedia information and transmitting the multiplexed multimedia information to a transmission medium, wherein a relative position from a head of each individual stream of a header is calculated for a video stream, an audio stream, and user data; A multimedia encoding method comprising: storing the relative positions in a database; searching for header information of a video stream and an audio stream by referring to the database; and packetizing the video stream, the audio stream, and the user data. . 6. A multimedia encoding method for multiplexing multimedia information and transmitting the multiplexed multimedia information to a transmission medium, comprising encoding, packetizing, and multiplexing video, audio, and user data, and multiplexing a stream without a directory table and a database. And generating a directory table packet by referring to the database, and multiplexing the multiplexed stream and the directory table packet to generate a multiplexed stream. 7. A packetizing means for packetizing a video stream, an audio stream, and user data, and outputting a video packet, an audio packet, and a user data packet, respectively. A first parsing unit that calculates a relative position of each header of each stream from the head of each stream of the user data and outputs the result as a header position, and multiplexes the video packet, the audio packet, and the user data packet. Multiplexing means for converting the packet header of each packet of video, audio, and user data, calculating the relative position of the packet header from the head of the packet sequence, and outputting video, audio, Set the playback time of user data in system time Second syntax analysis means for generating the represented time information; calculating a packet header in the bit stream; calculating an absolute position of the packet header from the head of the bit stream; and reproducing video, audio, and user data. Third to generate time information representing time in system time
Parsing means, first data registering means for registering a header position output from the first parsing means in a database, and packet header position and time information output from the second parsing means in a database. And a third data registering means for registering information on the absolute position and time information in the packet header bit stream output from the third syntax analyzing means in a database. 8. Encoding means for encoding video and audio respectively, outputting a video stream and an audio stream, and detecting and outputting a generated code amount accompanying the header adding process of the stream; A first database registration unit for calculating a relative position from a stream head of a packet header based on a generated code amount and history information output from the unit, and registering the calculated position in a database; and inputting the video stream, audio stream, and user data; Packetization that outputs video packets, audio packets, and user data packets, and also outputs the packet length of each video, audio, and user data packet, and the time information that represents the playback time of the video, audio, and user data in system time. Means for inputting the packet length and time information output from the packetizing means, A second data registration unit for calculating a relative position from the beginning of the packet sequence of the packet header based on the packet length and the history information, and registering the relative position and the time information in a database; A packet is input, multiplexed and a bit stream is output, and a packet interval between headers and a reproduction time of video, audio, and user data are added to a system time according to a header addition process and a time information addition process to the bit stream. A multiplexing means for outputting time information represented by:, a packet interval and time information output from the multiplexing means are input, an absolute position of the packet header from the head of the bit stream is calculated from the packet interval, A multimedia encoder having third data registration means for registering position and time information in a database. 9. Packetizing means for packetizing a video stream, an audio stream, and user data, respectively, and outputting video packets, audio packets, and user data packets; a storage means; A first parsing unit that calculates a relative position from a stream head in each stream of a header for each stream of video, audio, and user data, and stores the header position as a header position in the storage unit; Multiplexing means for multiplexing an audio packet and the user data packet and outputting the multiplexed packet as a bit stream; detecting a packet header for each of video, audio and user data packets; and detecting the relative position of the packet header from the beginning of the packet sequence. Video, audio, and user data Second time parsing means for generating time information representing the reproduction time of the data in the system time and storing them in the storage means; calculating a packet header in the bit stream; A third parsing means for calculating the absolute position of the video data, the audio data, and the reproduction time of the user data in the system time, and storing the time information in the storage means; A multimedia encoder connected to a storage unit and having a data registration unit that reads information stored in the storage unit before the information is updated by the syntax analysis unit and registers the information in a database. 10. A storage unit, which encodes video and audio, respectively, outputs a video stream and an audio stream, detects a generated code amount accompanying the header addition processing of the stream, and stores the detected code amount in the storage unit. Encoding means, The video stream, the audio stream, and the user data are input, and the video packet, the audio packet, and the user packet are output. The packet length of each video, audio, and user data packet, and the video, audio, and user Packetizing means for storing time information representing a data reproduction time in a system time in the storage means; inputting each packet of video, audio and user data, multiplexing and outputting a bit stream, and The header addition process and the playback time of video, audio, and user data are expressed in system time. Multiplexing means for storing and outputting the packet interval between headers and time information in the storage means in conjunction with the processing for adding the time information, and connected to the storage means via a bus and stored in the storage means. A multimedia encoder having data registering means for reading information stored before the information is updated by the encoding means, the packetizing means, and the multiplexing means and registering the information in a database. 11. The multimedia encoder according to claim 9, wherein said data registration means and said database are realized by a general-purpose computer. 12. Encoding means for encoding video and audio and outputting a video stream and an audio stream; storage means; inputting a video stream, an audio stream, and user data, and inputting a video packet, an audio packet, and a user data packet. And packetizing means for storing the packet header in each of the video, audio and user data, calculating the relative position of the packet header from the head in the packet sequence, and Syntactic analysis means for generating information; data registration means for registering the packet header relative position and time information output from the syntax analysis means in a database; video packets and audio from the storage means by referring to the database Search and multiplex packets and user data packets Multimedia encoder having a multiplexing means for outputting a beam. 13. Encoding means for encoding video and audio, and outputting a video stream and an audio stream; storage means for temporarily storing a video stream, an audio stream, and user data; Syntactic analysis means for inputting user data, calculating the relative position of the header from each stream in each stream, and outputting the calculated position as a header position, registration means for registering the header position output from the syntax analysis means in a database, By referring to the database, a video stream, an audio stream, and user data are retrieved from the storage unit and packetized, and a video packet, an audio packet,
A multimedia encoder comprising: packetizing means for outputting a user data packet; and multiplexing means for multiplexing the video packet, the audio packet, and the user data packet and outputting the multiplexed data as a bit stream. 14. Encoding video, audio and user data,
Means for creating a multiplexed stream and a database without a directory table by packetizing and multiplexing; a directory table generating means for generating a directory table packet of the multiplexed stream without a directory table with reference to the database; A multimedia encoder having multiplexing means for multiplexing a none-multiplexed stream and the directory table packet to generate a multiplexed stream for storage media. 15. A process of calculating a relative position from a stream head in each individual stream of a header for a video stream, an audio stream, and user data, and storing the relative position in a database; Processing for packetizing the user data, detecting a packet header for each packet of video, audio, and user data, calculating the relative position of the packet header from the beginning in the packet sequence, A process of generating time information representing a data reproduction time in a system time and storing the relative position and the time information in a database; multiplexing the video packet, the leading audio packet, and the user data packet, and multiplexing Output as a bit stream and multiplexed bit stream Detects a packet header in over arm,
A process of calculating the absolute position of the packet header from the head of the bit stream, generating time information representing the playback time of the video, audio, and user data in system time, and storing the absolute position and the time information in a database. A recording medium on which a multimedia encoding program to be executed by a computer is recorded. 16. A process for encoding video and audio, generating a video stream and an audio stream, and detecting a generated code amount accompanying a process of adding a header to the video and audio streams; Calculating the relative position of the packet header from the stream head from the history information and storing the relative position in the database; packetizing the video stream, the audio stream, and the user data; Along with the process of adding a header to each packet, and the process of adding time information representing the playback time of video, audio, and user data in the system time, the packet length of each packet of video, audio, and user data and the time information are added. A detecting process, and, based on the packet length and the history information, a relative position from the beginning of the packet sequence of the packet header. Calculating, storing the relative position and the time information in a database, multiplexing video packets, audio packets, and user data packets, outputting the multiplexed bit stream, and adding a header of the bit stream and video. In addition to the process of adding time information representing the playback time of audio and user data in system time, a packet interval between headers and time information are obtained, and the absolute position of the packet header from the beginning of the bit stream is determined from the packet interval. A recording medium recording a multimedia encoding program for causing a computer to execute a process of calculating and storing the time information and the absolute value in a database. 17. A process of encoding video and audio to generate a video stream and an audio stream, packetizing the video stream, the audio stream, and user data, and storing the video packet, the audio packet, and the user data packet in a storage device. In the process of storing and packetizing the video stream, audio stream, and user data, adding the header to each packet of video, audio, and user data, and reproducing the video, audio, and user data in the system time Accompanying the information addition processing, the packet length of each packet of video, audio, and user data and the time information thereof are detected, and the relative position from the beginning of the packet sequence of the packet header is calculated from the packet length and the history information. Storing the relative position and the time information in a database; The header information of the video packet and the audio packet being placed is searched for by referring to the database, and a multi-processor for causing a computer to execute a process of multiplexing each packet of video, audio, and user data into a multiplexed bit stream. A recording medium on which a media encoding program is recorded. 18. A process for encoding video and audio, outputting a video stream and an audio stream, and storing the video stream and the audio stream in a storage device. Calculating a relative position and storing the relative position in a database; searching for header information of video packets and audio packets in the storage device by referring to the database; and obtaining a video stream, an audio stream, and user data. And a multimedia encoding program for causing a computer to execute a process of multiplexing video packets, audio packets, and user data packets and outputting the multiplexed bit stream. 19. Encoding of video, audio and user data,
A process of creating a multiplexed stream without a directory table and a database by packetizing and multiplexing; a process of generating a directory table packet with reference to the database; a multiplexing of the multiplexed stream and the directory table packet; Recording medium storing a multimedia encoding program for causing a computer to execute a process of generating an encoded stream.