JP3338774B2 - MPEG encoding apparatus, MPEG PS multiplexing method, and recording medium recording PS multiplexing program - Google Patents

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention
(Moving Picture Experts Gro
up: M for multiplexing video data and audio data encoded in accordance with an international standard for media-integrated video compression
The present invention relates to a PEG encoding device, an MPEG PS multiplexing method, and a recording medium on which a PS multiplexing program is recorded.

[0002]

2. Description of the Related Art An MPEG encoding apparatus or the like is used to multiplex an encoded video data stream and an encoded audio data stream in synchronization with each other to generate one stream. Conventional PS
(Program stream) multiplexing device, for example,
In the multiplexing device disclosed in JP-A-162829, when a stream in the PS format is created, the multiplexing format of the stream is converted into a TS (transport stream) format, and a TS header and PSI information (program specification information) are converted.
Is added, the data amount of the entire stream increases.

[0003]

The first problem in the above-mentioned conventional technique is that the data amount increases when the data is converted from the PS to the TS, so that the TS data flows unless the bandwidth of the network is changed. If you cannot use it in an environment where changing network bandwidth is difficult,
Unless both data of the PS and the TS are stored in the storage device in advance, the PS cannot be converted to the TS.

A second problem is that video data must be re-encoded in order not to increase the bit rate of the TS, but the re-encoding takes time.
It is difficult to convert only the TS data and transmit it in real time when TS data is needed.

The present invention provides an MPE that solves the above problems.
G-encoding device, MPEG PS multiplexing method and PS
It is an object to provide a recording medium on which a multiplexing program is recorded.

[0006]

SUMMARY OF THE INVENTION First MPEG of the present invention
The encoding device is an MPEG encoding device that generates an MPEG program stream by synchronizing and multiplexing the encoded video data stream and the encoded audio data stream with each other. A padding packet necessary to absorb a bit rate of video data that can be converted into a transport stream of the same bit rate and an increase in the amount of data generated when a multiplexing method is converted from the program stream to the transport stream. The padding packet is inserted when the program stream is multiplexed.

A second MPEG encoding apparatus of the present invention multiplexes an encoded video data stream and an encoded audio data stream in synchronization with each other,
An MPEG encoding apparatus for generating an MPEG program stream, comprising: a bit rate of video data convertible from a bit rate of the entire program stream to a transport stream of a specified bit rate; And calculating the amount of padding packets necessary to absorb the increase in the amount of data generated during the multiplexing method conversion, and inserting the padding packets when multiplexing the program stream. .

A third MPEG encoding apparatus according to the present invention multiplexes an encoded video data stream and an encoded audio data stream in synchronization with each other,
An MPEG encoding device for generating an MPEG program stream, comprising: an encoding parameter input device for inputting various parameters required for encoding such as a bit rate of the entire program stream and encoding parameters of audio data; Based on the overall bit rate, the bit rate of the video data and the data generated when the multiplexing scheme is converted from the program stream to the transport stream so that the transport stream can be converted to a transport stream of the same bit rate. A coding parameter calculator for calculating the amount of padding packets to be inserted to absorb the increase in the amount, and the video coded with parameters such as a coding bit rate given from the coding parameter calculator. Data, audio data The PES packet is composed of a video PES packet and an audio PES packet, and the amount of padding packets notified from the encoding parameter calculation device is created. The video PES packet, the audio PES packet, and the padding packet are multiplexed and And a multiplexing device that generates

A fourth MPEG encoding apparatus according to the present invention multiplexes an encoded video data stream and an encoded audio data stream in synchronization with each other,
An MPEG encoding device for generating an MPEG program stream, comprising: an encoding parameter input device for inputting various parameters necessary for encoding such as a bit rate of the entire program stream and encoding parameters of audio data; A TS designated rate input device for inputting a designated bit rate of a transport stream;
A bit rate of video data and a multiplexing method conversion from the program stream to the transport stream so that the transport stream can be converted into the transport stream of the designated bit rate based on the bit rate of the entire program stream. A coding parameter calculator for calculating the amount of padding packets to be inserted in order to absorb an increase in the amount of data generated at the time of coding, and coding with a parameter such as a coding bit rate given from the coding parameter calculator. The encoded video data and audio data are formed into video PES packets and audio PES packets, respectively, and padding packets of the amount notified from the encoding parameter calculation device are created, and the video PES packets, audio PES packets, and Padding packet The and having a multiplexer to generate the program stream by multiplexing.

A first MPEG PS multiplexing method of the present invention multiplexes an encoded video data stream and an encoded audio data stream in synchronization with each other,
An MPEG PS multiplexing method for generating an MPEG program stream, comprising: inputting various parameters required for encoding such as a bit rate of the entire program stream and encoding parameters of audio data;
Based on the bit rate of the entire program stream, a bit rate of video data, so that it can be converted to a transport stream of the same bit rate,
Calculating an amount of padding packets to be inserted in order to absorb an increase in the amount of data generated when the multiplexing method is converted from the program stream to the transport stream; and Video data and audio data are stored in video PE
S packets and audio PES packets
Creating the calculated amount of padding packets,
Multiplexing the video PES packet, the audio PES packet, and the padding packet to generate the program stream.

According to a second MPEG PS multiplexing method of the present invention, an encoded video data stream and an encoded audio data stream are multiplexed in synchronization with each other,
An MPEG PS multiplexing method for generating an MPEG program stream, comprising: inputting various parameters required for encoding such as a bit rate of the entire program stream and encoding parameters of audio data;
Inputting a designated bit rate of the converted transport stream, and a bit rate of the video data based on a bit rate of the entire program stream so as to be convertible to a transport stream of the designated bit rate. And calculating an amount of padding packets to be inserted to absorb an increase in the amount of data generated when the multiplexing method is converted from the program stream to the transport stream. The video data and the audio data are formed into video PES packets and audio PES packets, respectively, and the calculated amount of padding packets is created.
Multiplexing audio PES packets and padding packets to generate the program stream.

The recording medium on which the first PS multiplexing program of the present invention is recorded includes a process for setting various parameters required for encoding such as a bit rate of an entire program stream and encoding parameters of audio data, Based on the bit rate of the entire stream, the bit rate of the video data and the multiplexing method conversion from the program stream to the transport stream occur so that the transport stream can be converted to the same bit rate. A process of calculating the amount of padding packets to be inserted to absorb the increase in the amount of data; and a process of converting the video data and audio data encoded by the encoding parameters into video PES packets and audio P
ES packets, generate the calculated amount of padding packets, and multiplex the video PES packet, audio PES packet, and padding packets to generate the program stream. The program is recorded.

The recording medium on which the second PS multiplexing program of the present invention is recorded includes a process for setting various parameters required for encoding such as a bit rate of the entire program stream and an encoding parameter for audio data, A process of setting a designated bit rate of a transport stream of the video stream, and a bit rate of video data based on a bit rate of the entire program stream so that the transport stream can be converted to a transport stream of the designated bit rate. A process of calculating an amount of padding packets to be inserted in order to absorb an increase in the amount of data generated when the multiplexing method is converted from the program stream to the transport stream; and The video data and audio data are respectively converted to video PES packets, Voice PES packets, generate the calculated amount of padding packets, and multiplex the video PES packets, audio PES packets, and padding packets to generate the program stream. Is recorded.

[0014]

Embodiments of the present invention will be described in detail with reference to the drawings. First, a first embodiment of the present invention will be described.

FIG. 1 is a block diagram showing a configuration of a first embodiment of the present invention. A video data input device 1 for inputting analog video data, and an audio data input device for inputting analog audio data. 2 and a video encoder 3 for encoding analog video data into MPEG video data
An audio encoding device 4 for encoding analog audio data into MPEG audio data, an encoding parameter input device 5 for inputting various parameters required for encoding, and an encoding parameter calculating device 6 operating under program control. A PS multiplexer 7 for multiplexing video data and audio data into MPEG2-PS under program control, and a PS data output device 8 for outputting the generated PS data.

The PS multiplexing device 7 is a video PES.
Packetizing means 71, Audio PESPac
It comprises a ketting means 72, a padding packet creating means 73, and a multiplexing means 74.

[0017] Video PES Package conversion means 7
In response to a request from the multiplexing unit 74, the MPEG video data supplied from the video encoding device 3
An eoPES packet is provided to the multiplexing means 74. The audio PES packetizing means 72 includes:
According to a request from the multiplexing means 74, the MPEG audio data provided from the audio
o Constructed as a PES Packet and passed to the multiplexing means 74. The padding packet creating means 73 responds to the request from the multiplexing means 74 and outputs the padding packet.
The packet is created and passed to the multiplexing means 74.

The multiplexing means 74 includes a video PES packetizing means 71 based on the information necessary for multiplexing the PS received from the encoding parameter calculating device 6,
audio PES packetizing means 72, Padd
ing Packet creation means 73 and each Pa
issue a request to acquire the ticket data, and use the Video PES
Packet, Audio PES Packet,
The padding packet is received and multiplexed into the PS.

FIG. 2 is a flowchart showing the operation of the first embodiment of the present invention.

Next, the operation of the first embodiment of the present invention will be described in detail with reference to FIGS.

Various parameters required for encoding, such as the overall bit rate of the PS and the encoding parameters of audio data, which are provided from the encoding parameter input device 5, are supplied to an encoding parameter calculation device 6. The coding parameter calculation device 6 calculates the
MP so that it can be converted to TS of the same bit rate
The bit rate of the EG video data and the amount of the padding packet to be inserted to absorb the increase in the amount of data generated at the time of multiplexing conversion from PS to TS are calculated (step A1).

The calculation of the amount of the padding packet is performed, for example, as follows. When the PS and the TS are compared, the difference is that PSI information (program specification information) is added to the TS and that the number of packets increases and the number of headers increases because the packet size is smaller than 188 bytes and the PS. . Therefore, the amount of data that is increased by converting from PS to TS having the same bit rate is (PSI information) + (number of TS headers × TS header size−
(PS header number × PS header size). Here, the number of headers (the number of packets) is, for example, the bit rate (bps) ÷ 8 ÷ 188 (bytes), taking the number of TS headers per second as an example.

The PSI information is 564 bytes per 0.1 second.
Assuming te, 5640 bytes per second is increased.

By the above calculation, for example, the data amount per second, which is increased by converting from PS to TS having the same bit rate, is obtained, and the padding of this data amount is performed.
Packets will be inserted every second.

The coding parameter calculator 6 converts the information calculated in step A1 and the information received from the coding parameter input device 5 such as audio coding parameters into the video coding devices 3 and 3. The notification is sent to the voice encoding device 4 and the multiplexing means 74 (step A
2).

After that, the video encoding device 3 supplied with the analog video data from the video data input device 1 uses the parameters such as the encoding bit rate of the video data supplied from the encoding parameter calculating device 6 to output the analog video data. Into MPEG video data. Similarly, the audio encoding device 4 to which the analog audio data is given from the audio data input device 2 converts the analog audio data to the MPEG by the parameters such as the encoding bit rate of the audio data given from the encoding parameter calculating device 6. Encode into audio data (step A3).

The video data encoded by the video encoding device 3 is stored in the Video PES Packet of the PS multiplexer 7.
The audio data supplied to the t-coding unit 71 and encoded by the audio encoding device 4 is supplied to the audio PES packet-forming unit 72. On the other hand, the multiplexing means 74
eo PES Packetizing means 71
Audio PES Packet
Audio PES Packet is requested from the conversion means 72.

Then, the Video PES Packet
The multiplexing unit 71 configures the video data provided from the video encoding device 3 into a Video PES Packet and passes it to the multiplexing unit 74. Similarly, the Audio PES Packet
The ket converting means 72 forms the audio data supplied from the audio encoding device 4 into an Audio PES Packet and passes it to the multiplexing means 74.

Further, the multiplexing means 74 calculates the amount of Padding Pac notified from the coding parameter calculation device.
A request is made to the padding packet creating means 73, and the padding packet creating means 73 creates a padding packet and passes it to the multiplexing means 74 (step A4).

The multiplexing means 74 calculates the bit rate and Pa of the entire PS given from the coding parameter calculating device.
Based on the amount of the Ding Packet, the Video
o PES Packetizing Means 71, Audio PE
S Packetizing Means 72 and Padding Pa
The packet data received from the packet creating means 73 is multiplexed to generate a PS. Then, the generated PS is output to the PS data output device 8 (step A).
5).

Next, the PS generated by the present invention is represented by T
The fact that the data amount of the entire stream does not increase when converted to S will be described with reference to FIG.

FIG. 3 is a diagram showing a data amount in the PS / TS conversion according to the present invention. The conversion source PS data D1 includes a conversion source PS A / V PES Packet unit D11 and a conversion source PS Padding Packet unit D12. It is composed of When converting the multiplexing format from the conversion source PS data D1 to the converted TS data D2, the conversion source PSPa
The DingPacket part D12 is discarded because it is meaningless data at the time of reproducing the stream.
The data D2 is not multiplexed. Therefore, the conversion source PS
Only the A / V PES Packet section D11 has TS Pa
TS A / V TS Pac
The data is multiplexed in the ket unit D21.

At this time, since the TS Header is added, the converted TS A / V TS Packet unit D2
1 is the conversion source PS A / V PES Pack
It becomes larger than the et part D11. The converted TS data D2 is added with a PSI information section D22 in which stream information about the TS is stored. Therefore, the converted TS data D2 has a larger effective data size at the time of reproduction than the converted PS data D1, but the discarded converted PS padding packet unit D
12, the increase is absorbed, and the stream can be converted to TS without changing the data amount of the entire stream.

When converted to TS, each Pa
If the data amount of the entire stream decreases due to an error in the amount of the dding packet, the converted TS TS NU
An LLPacket section D23 is added to adjust so as to have the same data amount as the conversion source PS data D1. TS N
The UL Packet is meaningless data when the stream is reproduced.

Next, a second embodiment of the present invention will be described in detail with reference to FIGS.

FIG. 4 is a block diagram showing the configuration of the second embodiment of the present invention. In addition to the configuration of the first embodiment shown in FIG. Different in that. When converting the multiplexing format to TS, the TS designation rate input device 9 inputs a designated value of the bit rate of the convertible TS, and the encoding parameter calculation device 6
Pass to.

Next, the operation of the second embodiment of the present invention will be described in detail with reference to FIG. FIG. 5 is a flowchart showing the operation of the second embodiment of the present invention,
Video encoding device 3, audio encoding device 4, and Video PES packetizing means 7 indicated by A2 to A5 in FIG.
1, Audio PES Packetizing Means 72, Pa
The operations of the dding packet creation unit 73 and the multiplexing unit 74 are the same as the operations of the units 3 and 4 and the units 71, 72, 73 and 74 in the first embodiment shown in FIG. The description is omitted.

In the first embodiment shown in FIG. 1, a PS that can be converted only to a TS having the same bit rate as the conversion source PS is generated. However, in the present embodiment, a PS is generated.
A designated bit rate of a convertible TS is input from the designated TS rate input device 9 (step B1), and the parameter is passed to the encoding parameter calculation device 6.

The coding parameter calculator 6 calculates the bit rate of the MPEG video data and the amount of the padding packet so that the bit rate specified by the TS is obtained (step A1a).

When the PS generated according to the second embodiment of the present invention is used, the TS can be converted into a TS having a lower bit rate than that of the conversion source PS. It is possible to cope with a case where the bit rate is low.

Next, a third embodiment of the present invention will be described in detail with reference to FIG.

FIG. 6 is a block diagram showing the configuration of the third embodiment of the present invention.
0. The computer is basically the same as that described in the first embodiment of the present invention in FIG. 1 and the second embodiment of the present invention in FIG. The recording medium 10
The S multiplex program is recorded. This recording medium 10
May be a magnetic disk, an optical recording disk, a semiconductor memory, or another recording medium. The PS multiplex program is read into the computer from the recording medium 10 and controls the same operation as in the first or second embodiment of the present invention.

[0043]

The first effect of the present invention is that, by multiplexing a necessary amount of padding packets at the time of generation of a PS, an increase in the amount of data due to conversion to TS is absorbed, and thus the entire stream can be absorbed. The object is to be able to create PS data capable of converting a multiplex format into TS without increasing the bit rate. As a result, in an environment where it is difficult to change the bandwidth of the network, when it is desired to support both PS and TS data, it is not necessary to have a TS having the same bit rate, and there is an effect that the capacity of the storage device can be reduced.

The second effect is that only the conversion of the multiplexing system can be performed without re-encoding the video data.
That is, conversion to S has become possible.

[Brief description of the drawings]

FIG. 1 is a block diagram showing a configuration of a first exemplary embodiment of the present invention.

FIG. 2 is a flowchart showing an operation of the first exemplary embodiment of the present invention.

FIG. 3 is a diagram showing PS / according to the first and second embodiments of the present invention.
It is a figure which shows the data amount in TS conversion.

FIG. 4 is a block diagram showing a configuration of a second exemplary embodiment of the present invention.

FIG. 5 is a flowchart showing the operation of the second exemplary embodiment of the present invention.

FIG. 6 is a block diagram showing a configuration of a third exemplary embodiment of the present invention.

[Explanation of symbols]

 REFERENCE SIGNS LIST 1 video data input device 2 audio data input device 3 video encoding device 4 audio encoding device 5 encoding parameter input device 6 encoding parameter calculation device 7 PS multiplexing device 71 Video PES Packetizing device 72 Audio PESPacketizing device 73 Padding Packet creating means 74 Multiplexing means 8 PS data output device 9 TS designated rate input device 10 Recording medium

──────────────────────────────────────────────────続 き Continuation of front page (58) Field surveyed (Int.Cl. ⁷ , DB name) H04N ^7/ 00-7/088 H04N ^7/ 24-7/68 H04J 3/00

Claims (8)

(57) [Claims] 1. An MPEG encoding apparatus for generating an MPEG program stream by synchronizing and multiplexing an encoded video data stream and an encoded audio data stream with each other, comprising: From the bit rate of the video data that can be converted to a transport stream of the same bit rate, and the padding necessary to absorb the increase in the amount of data that occurs when the multiplex system is converted from the program stream to the transport stream. An MPEG encoding apparatus, wherein the amount of packets is calculated and the padding packets are inserted when multiplexing the program stream. 2. An MPEG encoding apparatus for generating an MPEG program stream by synchronizing and multiplexing an encoded video data stream and an encoded audio data stream with each other, comprising: From the bit rate of video data that can be converted to a transport stream of a specified bit rate, and the increase in the amount of data that occurs when a multiplexing scheme is converted from the program stream to the transport stream. An MPEG encoding apparatus, which calculates an amount of padding packets and inserts the padding packets when multiplexing the program stream. 3. An MPEG encoding apparatus for generating an MPEG program stream by synchronizing and multiplexing an encoded video data stream and an encoded audio data stream with each other, comprising: Parameter input device for inputting various parameters necessary for encoding such as encoding parameters of audio data and audio data, and capable of converting to a transport stream of the same bit rate based on the bit rate of the entire program stream So that the bit rate of the video data
An encoding parameter calculation device that calculates an amount of padding packets to be inserted to absorb an increase in the amount of data generated when the multiplexing method is converted from the program stream to the transport stream; and the encoding parameter calculation device. The video data and the audio data encoded with the parameters such as the encoding bit rate given by
A multiplexing device configured to form an ES packet and generating the amount of padding packets notified from the encoding parameter calculation device, and multiplexing the video PES packet, the audio PES packet, and the padding packet to generate the program stream; And an MPEG encoding device. 4. An MPEG encoding apparatus for generating an MPEG program stream by synchronizing and multiplexing an encoded video data stream and an encoded audio data stream with each other, comprising: Parameter input device for inputting various parameters necessary for encoding such as encoding parameters for audio and audio data, a TS-specified rate input device for inputting a specified bit rate of a converted transport stream, and the entire program stream The bit rate of the video data and the data generated at the time of multiplexing conversion from the program stream to the transport stream so that the transport stream can be converted to the transport stream of the designated bit rate based on the bit rate of Volume increase Parameter calculating device for calculating the amount of padding packets to be inserted to absorb the data, and the video data and audio data coded with parameters such as the coding bit rate given from the coding parameter calculating device. Are the video PES packet and the audio P, respectively.
A multiplexing device configured to form an ES packet and generating the amount of padding packets notified from the encoding parameter calculation device, and multiplexing the video PES packet, the audio PES packet, and the padding packet to generate the program stream; And an MPEG encoding device. 5. An MPEG PS multiplexing method for generating an MPEG program stream by synchronizing and multiplexing an encoded video data stream and an encoded audio data stream with each other, comprising: Inputting various parameters required for encoding such as the bit rate of the audio data and the encoding parameters of the audio data; and enabling conversion to a transport stream of the same bit rate based on the overall bit rate of the program stream. And the bit rate of the video data,
Calculating the amount of padding packets to be inserted to absorb the increase in the amount of data that occurs when the multiplexing method is converted from the program stream to the transport stream; and Video data,
Audio PES packet and audio PES respectively
And generating the calculated amount of padding packets, and multiplexing the video PES packet, audio PES packet, and padding packet to generate the program stream. PS multiplexing method. 6. An MPEG PS multiplexing method for generating an MPEG program stream by synchronizing and multiplexing an encoded video data stream and an encoded audio data stream with each other, comprising: Inputting various parameters required for encoding such as the bit rate of the audio data and the encoding parameter of the audio data; inputting the designated bit rate of the converted transport stream; and The bit rate of the video data and the increase in the amount of data generated when the multiplexing method is converted from the program stream to the transport stream so that the transport stream can be converted to the transport stream of the specified bit rate. Pade to insert to absorb Calculating the amount of coding packets; and the video data encoded with the encoding parameter;
Audio PES packet and audio PES respectively
And generating the calculated amount of padding packets, and multiplexing the video PES packet, audio PES packet, and padding packet to generate the program stream. PS multiplexing method. 7. A process for setting various parameters required for encoding such as a bit rate of an entire program stream and an encoding parameter of audio data, and a process of setting the same bit rate based on the bit rate of the entire program stream. The bit rate of video data, so that it can be converted to a transport stream,
A process of calculating an amount of padding packets to be inserted in order to absorb an increase in the amount of data generated at the time of multiplexing conversion from the program stream to the transport stream; and Video data,
Audio PES packet and audio PES respectively
A program for generating a calculated amount of padding packets, multiplexing the video PES packet, audio PES packet and padding packet to generate the program stream, and causing the computer to execute the process. A recording medium on which a PS multiplexing program is recorded. 8. A process for setting various parameters necessary for encoding such as a bit rate of an entire program stream and an encoding parameter of audio data; a process for setting a designated bit rate of a converted transport stream; Based on the bit rate of the entire program stream, the bit rate of the video data and the multiplexing method conversion from the program stream to the transport stream are performed so that the transport stream can be converted to the specified bit rate. Calculating the amount of padding packets to be inserted to absorb the increase in the amount of generated data; and the video data encoded with the encoding parameter.
Audio PES packet and audio PES respectively
A program for generating a calculated amount of padding packets, multiplexing the video PES packet, audio PES packet and padding packet to generate the program stream, and causing the computer to execute the process. A recording medium on which a PS multiplexing program is recorded.