JPH0955767A - Data transmission device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To mix and send out video information, audio information, etc., to a transmission line with a fixed transmission speed by packetizing data having a plurality of relative attributes and selecting and sending out the packets, one by one, according to specific priority. SOLUTION: PES packetizers 2 and 3 read video ES data and audio ES data out and generate packets called PES(packet sized ES) data. Further, TS packetizers 4-6 generate TS(transport stream) packets. The TS packets each consist of a TS header and a TS payload and have 188-byte fixed length. The generated packets are stored in a buffer, and selected and read out, one by one, by a selection part 10. Then the selection part 10 selects one packet according to the specific priority and outputs it to a PCR giving part 1 when the packet is present at one of the packetizers 4-6.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a data transmission apparatus, and more particularly to a data transmission apparatus capable of packet-multiplexing related image and audio data and transmitting the data.

[0002]

2. Description of the Related Art Conventionally, in the case of real-time coding in which an output signal of a video camera or a VTR is directly coded by an MPEG system or the like, the coding is performed based on the amount of data accumulated in a buffer of a multiplexer. By performing feedback control of the amount of data generated in the device, overflow or underflow of the buffer during transmission at a fixed transmission rate was prevented. Moreover, since the encoding is performed in real time, the value of the clock counter is inserted as it is into the data as clock information to be used for clock synchronization on the reproducing side.

[0003]

In the case of real-time coding as described above, it is possible to match the transmission path by controlling the amount of coded data. When the data is encoded by time and once stored in the storage device, the feedback control cannot be performed on the encoding device. Therefore, how to send the accumulated data to the fixed-rate transmission line becomes a problem.

The object of the present invention is to solve this problem,
It is an object of the present invention to provide a data transmission device capable of mixing video information, audio information and the like and sending them to a transmission line having a fixed transmission rate so that they can be decoded at a correct timing on the receiving side.

[0005]

SUMMARY OF THE INVENTION According to the present invention, in a data transmission device for packetizing and transmitting data, clock means for generating clock information and data of a plurality of related attributes based on the clock information are respectively packeted. It is characterized by including a packet generating means for converting the packets into packets and a selecting means for selecting and transmitting the packets generated one by one according to a predetermined priority. Further, it is characterized by including clock information inserting means for inserting clock information into at least a part of the packets. According to the present invention, with such a configuration, the data once encoded and accumulated can be sent to the fixed-rate transmission path, and the receiving side can perform strict clock reproduction.

[0006]

DETAILED DESCRIPTION OF THE INVENTION The present invention will be described in detail below with reference to the drawings. FIG. 1 is a block diagram showing the configuration of a packet data transmission system to which the present invention is applied. The transmission side device is, for example, a server of the video on demand system or a device for transferring data accumulated in the server, and the reception side device is, for example, a CATV reception device having a video on demand function or a server for receiving the data. The data storage device 1 stores, for example, video ES (elementary stream) data which is video frame data and audio ES data which is audio frame data. This data is taken in from, for example, a television camera or a VTR, encoded into a data amount that can be transmitted at a predetermined transmission rate, and the data is divided into frames of a predetermined cycle.

The PES packetizers 2 and 3 read out the video ES data and the audio ES data, respectively.
A packet called ES (packetized ES) data is generated. The PES packet sequence is grouped corresponding to frames of video and audio ES data, and each PES packet is composed of a PES header and a PES payload. Then, the header of the PES packet including the information on the head of the frame at the head of each group includes a DTS (decoding time stamp: time information for decoding the data) field. Depending on the specifications of the PES packetizer, there may be a PTS (presentation time stamp: time information for displaying and outputting the data) field instead of or in addition to the DTS field.
If only the TS field is present, set the DTS value to P
Substitute with the TS value. When packetizing, the PES packetizer counts the number of frames of ES data, for example, to decode the data, generate time information to be displayed, and insert the time information in the DTS or PTS field. It should be noted that the PES packetization process is executed in advance prior to the data transmission, and the transmission process is started from the state where the PES packet is stored in the storage device.

TS packetizers 4, 5 and 6 are TS
(Transport Stream) Generate a packet. T
The S packet is composed of a TS header and a TS payload and has a fixed length of 188 bytes. The generated packets are stored in the buffer, selected one by one by the selection unit 10, and read out. The packetizing (data input) timings of the video and audio TS packetizers 4 and 5 are controlled by the comparing units 8 and 9, respectively.

[0009] The TS packetizer 4 for video uses the P header in the TS header at a predetermined cycle (for example, once or more every 100 milliseconds).
It has a function of inserting a CR field. The PCR value, which is clock information, needs to be transmitted frequently, but the cycle does not have to be constant. Therefore, the PCR field is provided in a predetermined cycle only in the video TS packets that occupy most of the packets. However, in the TS packetizer,
Although a temporary PCR value is added to this field, it is updated in the PCR adding unit described later.

PSI (Program Specific Information) data is data such as channel number information of a program in, for example, CATV, and needs to be inserted into the data at a predetermined cycle. The TS packetizer 6 for PSI generates a TS packet containing PSI data at a predetermined cycle. The null packet generator 7 generates a null TS packet that does not contain any information. The null TS packet is selected and read by the selection unit 10 to fill the time when there is no other packet to be selected.

The transmission clock 13 has a predetermined frequency (for example, 2
7MHz) clock signal, PCR counter 1
2 counts the clock signal to obtain clock information P
Output CR. The comparators 8 and 9 respectively use the PCR values output from the PCR counters and the TS packetizers 4 and 5, respectively.
The DTS value in the PES data input to is always compared. And if both values match or DT
When the S value is smaller, the reproduction (transmission) timing of the data has arrived, so that the PES including the DTS value is next.
The PES data is sequentially input to the TS packetizer (the packetizer is operated) until data appears, and packets are generated. If the DTS value is larger, TS
Stop the packetizer operation.

The selection unit 10 includes the TS packetizers 4, 5,
When there is a packet in any of the six, one packet is selected in a predetermined priority order and output to the PCR assigning unit 11. The order of priority is, for example, audio, PSI, and video. If there are no packets to be sent to the three packetizers, the null TS packet generator 7 reads the null TS packet.

The PCR assigning unit 11 checks whether or not the PCR field is present in the TS packet output from the selecting unit 10. If the PCR field is present, the PCR counter value in the field, that is, The current clock information is inserted and sent to the transmission line 14. The transmission line 14 is based on a clock unique to the transmission line (unique).
It is a communication network that transmits packets at a fixed transmission rate, and any transmission path such as CATV, LAN, leased line, and public communication network can be used.

In the device on the receiving side, the PCR extraction unit 15 first extracts the PCR value from the received packet. The reception clock 18 is an oscillation circuit that oscillates at the same frequency as the transmission clock and whose frequency can be controlled from the outside. The PCR counter 17 on the reception side counts this clock signal and outputs the clock information PCR on the reception side. Output. The comparison unit 16 compares the PCR value output from the PCR counter 17 with the received PCR value, and the reception PC
The reception clock 18 is controlled so that the frequency of the reception clock 18 becomes higher when the R value is larger, and the frequency of the reception clock 18 becomes lower when the reception PCR value is smaller. Therefore, the reception clock 18 is slave-synchronized with the transmission clock 13.

The unpacketizer 19 has a reception buffer, discards null TS packets among the received packets and arranges other packets by type. Then, the TS packet is decomposed for each type to extract the data, and the video and audio PES data is reproduced. The video reproducing unit 20 and the audio reproducing unit 21 extract the ES data from the input PES data, further decode (decompress) the ES data, and output the video and audio data.

The comparators 22 and 23 respectively extract the DTS value from the PES data and compare it with the value of the reception side PCR counter 17. Only when the DTS value is less than or equal to the PCR counter value, the operations of the respective reproducing units 20 and 21 are permitted until the next DTS value appears, and when the DTS value is larger than the PCR value, both values become equal. Stop the operation of the playback section. Therefore, video or audio data is output from each of the reproducing units 20 and 21 in synchronization with the timing to be reproduced, and the buffer of the unpacketizer does not overflow or underflow.

FIG. 2 is an explanatory diagram showing the structure of transmitted video data. For example, 1/30 (or 1/6
Video frame data which is obtained by A / D converting a video signal generated in a 0) second cycle is coded by a coding system such as an MPEG system and stored in the data storage device 1 as ES data. The ES data is divided into frames, for example, and the data amount corresponding to each frame changes depending on the characteristics of the image and the like. In the PES packetizing process in the PES packetizer 2, for example, 1
ES data corresponding to one frame is stored in several PES packets, a DTS field is provided in the header of the first PES packet, and a DTS value is stored.

In the TS packetizer 4, one PE
The S packet is further stored in a plurality of fixed length TS packets. A PCR field is provided in the TS packet at a predetermined cycle. The number of TS packets per frame changes according to the change in the original ES data amount.
Therefore, when the number of packets is small, a null TS packet is sent from the selection unit 10 to fill the free time. In addition, video TS packets are audio and PSI.
Since the priority is lower than that of data, the selection unit 10 may have to wait for transmission. Therefore, in the TS packetizer 4, the provisional PCR value is stored in the PCR field or nothing is stored in the PCR field, and the PCR value is stored in the PCR assigning unit 11 in the subsequent stage of the selecting unit 10. With the above configuration, it is possible to mix data having a plurality of attributes such as video and audio and send the mixed data at a desired timing.

FIG. 3 is a block diagram showing a part of the second embodiment. In the first embodiment disclosed in FIG. 1, P
Although the PCR counter 12 is used to generate the PCR value to be added by the CR adding unit 11, the second embodiment is an example of generating the PCR value by calculation by software.

When the length of the TS packet is fixed and the position of the PCR field generated in the TS packetizer 4 is always the same bit position, the PCR value is a counter to which a constant value is added every packet transmission. It can be configured by. FIG. 3 shows a PC in the second embodiment.
FIG. 3 is a block diagram of an R generation unit, which replaces the PCR counter of FIG. 1. A packet transmission unit 40 that transmits packets at a constant transmission rate with reference to the transmission clock 13.
(In FIG. 1, included in the PCR adding unit 11)
Every time a packet is sent, a sending notification is sent to the PCR counter 41 composed of software. The PCR counter 41 adds a constant PCR increment value to the PCR counter value each time the transmission notification is received. The PCR increase value is calculated by the following equation.

PCR increase value = (clock frequency × packet bit length) ÷ transmission rate.

Generally, the PCR transmitted last time
The difference between the value and the newly transmitted PCR value is
Based on the bit interval between the field and the newly transmitted PCR field, it is calculated by the following equation.

PCR increase value = (clock frequency × PCR bit interval) ÷ transmission rate.

Further, in the second embodiment, when the TS packet data is not sent to the transmission line in real time but is stored in the storage device, instead of the packet sending unit 40,
The PCR counter 41 is used every time one packet is stored by using the packet storage unit that stores the packet in the storage device.
The storage notification should be issued to. Therefore, in this case, processing can be performed completely asynchronously with the transmission clock.

Although the embodiments have been disclosed above, the following modified examples are also conceivable. In the first embodiment, an example in which the packetizer is controlled by the comparison unit of PCR and DTS has been disclosed, but the following configuration may be considered as another system. First, in the TS packetizer, PCR
Packetization is performed asynchronously with, and a DTS value is added to each of the generated packets. In the selection unit, the DTS value added to each packet is compared with the PCR, and the DTS
Packets whose value is less than or equal to PCR are selected one by one according to a predetermined priority order and transmitted. According to this structure, the TS packetizer can perform the packetizing process in advance, and the delay due to the process is reduced.

In the embodiment, the system in which the PCR is provided only in the video TS packet is disclosed, but the PCR may be provided only in other packets, for example, the audio TS packet, the PSI packet and the null TS packet. Since the audio TS packets and PSI packets are transmitted periodically, for example, if a PCR field is provided for each predetermined number of audio TS packets, or if the PSI transmission period and the PCR transmission period are close, all the PSI packets are PCR Providing a field simplifies the control of the cycle. Further, normally, if the null TS packet is always sent at the frame period of the video signal, the PCR field may be provided in the null TS packet. When the PCR is transmitted using the audio TS packet, the audio TS packet has the highest priority. Therefore, as in the second embodiment, the PCR value is calculated and the TS packetizer 5 calculates the PCR value. You can also write.

[0027]

As described above, according to the present invention,
In a data transmission device for packetizing and transmitting data, packet generating means for packetizing data of a plurality of related attributes based on clock information and packet generation based on a predetermined priority are selected one by one. Since it includes a selection means for transmitting and then transmitting the clock information and a clock information insertion means for inserting clock information in at least a part of the packet, the data once encoded and accumulated can be transmitted to a fixed-rate transmission path. Moreover, there is an effect that it is possible to perform strict clock reproduction on the receiving side.

[Brief description of drawings]

FIG. 1 is a block diagram showing a configuration of a packet data transmission system to which the present invention is applied.

FIG. 2 is an explanatory diagram showing the structure of transmitted video data.

FIG. 3 is a block diagram showing a part of a second embodiment.

[Explanation of symbols]

1 ... Data storage device 2, 3 ... PES packetizer, 4,
5, 6 ... TS packetizer, 7 ... Null TS packet generation unit, 8, 9 ... Comparison unit, 10 ... Selection unit, 11 ... PCR addition unit, 12 ... PCR counter, 13 ... Transmission clock, 14
... Transmission path, 15 ... PCR extraction section, 16, 22, 23 ... Comparison section, 17 ... PCR counter, 18 ... Reception clock, 1
9 ... Unpacketizer, 20 ... Video playback unit, 21 ... Audio playback unit

Claims (5)

[Claims] 1. A data transmission apparatus for packetizing and transmitting data, wherein: clock means for generating clock information; and a packet for packetizing data of a plurality of related attributes based on the clock information at a timing to be reproduced, respectively. A data transmission device comprising: a generation unit and a selection unit that selects and transmits the packets generated by the packet generation unit one by one based on a predetermined priority. 2. A data transmission device for packetizing and transmitting data, wherein a clock means for generating clock information and a packet generating means for packetizing data of a plurality of related attributes and adding timing information to be reproduced. And a selecting unit which refers to the clock information and selects and sends the packets which have reached the timing to be reproduced one by one on the basis of a predetermined priority order. 3. The data transmission device according to claim 1, further comprising clock information insertion means for inserting clock information into at least a part of the packets. 4. A data transmission device for packetizing and transmitting video and audio data, comprising: clock means for generating clock information; and packetizing video data at a timing to be reproduced based on the clock information, and at a predetermined interval. A video data packetizing means for providing a clock information area in a packet, an audio data packetizing means for packetizing at least audio data at a timing based on a clock signal, and information about a program at predetermined intervals A program information packet generating means for generating a packet, an invalid packet generating means, and an audio data packet, a video data packet, a program information packet from among the packets that can be transmitted,
Selecting means for selecting and transmitting the packets one by one in the priority order of the invalid packets; and clock information inserting means for writing the clock information in the output packet of the selecting means when the clock information area exists in the area. A data transmission device comprising: 5. The data transmission device according to claim 3, wherein the clock information inserted in the packet is calculated by calculation based on the clock information insertion interval data.