KR100259769B1 - Ts multiplexing apparatus for multipoint video conference - Google Patents

Abstract

PURPOSE: A transfer stream multiplexer for multiuser video conference is provided which receives a packetized elementary stream from an external media encoder to generate a transfer stream and outputs the transfer stream, being suitable for a video conference environment. CONSTITUTION: A transfer stream multiplexer for multiuser video conference includes a clock generator(11) for generating a clock required for multiplexing operation, a host access controller(17) for processing address ad control signals in order to transmit/receive data required for encoding and transmitting and receiving control data, and a bus controller(18) for controlling input/output directions of a data bus. The transfer stream multiplexer further has a null transfer stream generator(15) for generating a dummy packet for controlling an output rate, a program specific information processor(12) for outputting information for selecting one program and packet from receiving programs to decode the selected program and packet, and a media transfer stream generator for receiving encoded data and video data in the form of packetized elementary stream, storing the data in a memory and generating a media transfer stream from the memory. The transfer stream multiplexer also has a program clock reference processor(16) for receiving initializing data from the host access controller and generating time stamp information required in case of decoding to transmit the information to the media transfer stream generator, and a multiplexer(19) for controlling the null transfer stream generator, media transfer stream generator, program detailed information processor and program clock reference processor to output conference images according to the number of speakers.

Description

Transport Stream Multiplexing Device for Multi-Party Video Conference

The present invention provides a multi-view video in a multipoint control system (MCS) capable of providing an appropriate video conference environment according to the number of conference participants in an environment such as an Asynchronous Transfer Mode (ATM) communication network. A transport stream multiplexing device for conferencing.

In the related art, it is impossible to provide a high quality multimedia communication service due to the limited bandwidth of the communication network.

However, as the information age has entered, users' desire for information has increased, and the construction of an information network corresponding to it has become inevitable, and the widening of a communication network has been actively performed in each country. Accordingly, in Korea, broadband-ISDN (B-ISDN) devices based on ATM are almost in the development stage.

Meanwhile, since MPEG-2 can provide a wider application area and higher quality images than MPEG-1, it is attracting attention in all industries such as broadcasting, home appliances, and communication.

However, in order to provide an MPEG-2 class video conferencing service and the like, a multiplexing apparatus capable of accommodating such a function is essential to the construction of a multipoint access control system (MCS).

For example, in the configuration of a multipoint access control system that provides a video conference service of MPEG-2 level in an ATM environment, an MPEG-2 TS multiplexing device that can provide an appropriate conference environment according to conference participants is required.

The present invention devised in response to the above-described requirements, receives a packetized elementary stream (PES) from an external media encoder and generates a transport stream (TS) to generate a video conferencing environment. An object of the present invention is to provide a transport stream multiplexing device for multi-party video conferencing.

1 is a block diagram of an embodiment of a multi-point access control system (MCS) to which the present invention is applied.

2 is a block diagram of an embodiment of a transport stream (TS) multiplexing device for multi-party video conferencing according to the present invention;

* Explanation of symbols for the main parts of the drawings

11: clock generator

12: Program Specific Information (PSI) generation unit

13: audio transport stream (TS) generation unit

14: video transport stream (TS) generation unit

15: null transport stream generation unit

16: Program Clock Reference (PCR) Processing Unit

17: host connection control unit

18: data bus controller

19: MPEG-2 Transport Stream (TS) Multiplexer

The present invention for achieving the above object, the clock generation means for receiving the main clock from the outside to generate a clock required for the multiplexing operation; Host connection control means for processing an address and a control signal to transmit and receive data necessary for encoding, and for transmitting and receiving control data throughout the apparatus; Bus control means for controlling an input / output direction of a data bus in association with the host connection control means; Null transport stream generating means for generating a dummy packet to control an output speed; Program detail information processing means for outputting information for selecting and decoding any one of the received plurality of programs and packets; Media transport stream generating means for receiving encoded data and video data in the form of a packetized elementary stream, storing the encoded data and video data in a memory, and generating a media transport stream from the stored memory; Program clock reference processing means for receiving initialization data from the host access control means, transmitting the initialization data to a local processor, generating time stamp information required for decoding, and transmitting the generated time stamp information to the media transport stream generation means; And control the null transport stream generating means, the media transport stream generating means, the program detail information processing means, and the program clock reference processing means so that the output transport stream can be output at a uniform rate. And multiplexing means for outputting an image.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is a block diagram of an embodiment of a multi-point access control system (MCS) to which the present invention is applied, in which "10" is an MPEG-2 TS multiplexing device, "20" is an MPEG-1 audio coding unit, " 30 denotes a video PES first-in-first-out, 40 denotes an audio PES first-in-first-out, 50 denotes an MPEG-2 TS buffer, 60 denotes a media encoding control, and 70 denotes a local processor.

The multi-point access control system (MCS) includes an MPEG-2 transport stream (TS) multiplexer 10, a plurality of MPEG-1 audio encoders 20, and a video packetized elementary stream (PES) first-in-first-out unit 30. A plurality of audio packetized elementary stream (PES) first-in, first-out (40), a plurality of MPEG-2 transport stream (TS) buffers (50), a media encoding control unit (60), and a local processor (70). .

The plurality of MPEG-1 audio encoders 20 receive the voices of one main speaker and three incubators from conference speakers through the media bus and encode the MPEG-1 audio signals. Output to (40).

The plurality of audio PES first-in-first-out unit 40 receives MPEG-1 encoded data from the plurality of MPEG-1 audio encoders 20 and sequentially stores the received MPEG-1 encoded data according to the request of the MPEG-2 TS multiplexer 10. The PES is sequentially output to the MPEC-2 TS multiplexer 10.

The video PES first-in-first-out unit 30 receives the divided merged images input through the media bus and stores them sequentially and then converts the PES to the MPEG-2 TS multiplexer 10 according to the request of the MPEG-2 TS multiplexer 10. Will be printed sequentially.

The media encoding control unit 60 controls the MPEG-1 audio encoder 20, the video and audio PES first-in-first-out units 30 and 40, and the MPEG-2 TS multiplexer 10.

The local processor 70 is responsible for initializing the MPEG-2 TS multiplexer 10.

The MPEG-2 TS multiplexer 10 generates a TS by receiving the PES from the video and audio PES first-in-first-out units 30 and 40, and generates a plurality of MPEG-2 TS buffers 50 according to the number of speakers. Will output

On the other hand, the TS output from the MPEG-2 TS multiplexer 10 is stored in the MPEG-2 TS buffer 50. Here, TS is video and audio for meeting, which is transmitted to conference participants through ATM network after B-ISDN protocol processing.

FIG. 2 is a block diagram of an embodiment of a transport stream (TS) multiplexing apparatus (see 10 of FIG. 1) for multi-party video conferencing according to the present invention.

The MPEG-2 TS multiplexer 19 includes a transport stream (TS) transmission control unit 191, a chip select signal generation unit 192, an audio selection control unit 193, a coefficient generator 194, and a transport stream (TS) buffer. A control unit 195 and a plurality of transport stream (TS) output units 196 are provided. Here, the TS output unit 196 may be configured by the number of conference attendees.

The clock generator 11 receives the main clock from the outside and generates and outputs clocks necessary for the operation of the respective sub-devices of the MPEG-2 TS multiplexer 19.

The host connection control unit 17 processes an address and a control signal in order to transmit and receive the necessary data with the media encoding control unit 60, and localizes the initialization data necessary for each of the TS generating units 13 to 15 and the PSI generating unit 12. It receives from the processor 70 and transmits them. The control data is transmitted to the PCR processing unit 16, and the control data for the entire apparatus such as control signal transmission and abnormal status notification are transmitted and received to the MPEG-2 TS multiplexer 19.

The data bus control unit 18 controls the input / output direction of the data bus in cooperation with the host connection control unit 17.

In the MPEG-2 system, program specific information (PSI) transmits a plurality of streams of video and audio, respectively, and transmits information about which program and packet among a plurality of programs are selected and how to decode them. To be defined.

The PSI generation unit 12 packetizes the program details information (PSI) and transmits the packetized information to the MPEG-2 TS multiplexer 15, and the PSI is transmitted to the receiving end at regular intervals according to the request of the media encoding apparatus.

The null TS generator 15 generates a dummy packet used for the output rate control in the MPEG-2 TS multiplexer 15, and the dummy packet is ignored at the receiving end.

The audio TS generating unit 13 receives encoded data of the main speakers and the incubators in the form of PES from the plurality of audio PES first-in first-out units 40 and extracts information (ie, audio PES start codes, etc.) necessary for TS packet formation. Then transfer to the connected memory (a). In addition, PES data is read from the memory a in response to a request of the MPEG-2 TS multiplexer 15 to generate audio TSs of the main speaker and the incubator and transmitted to the MPEG-2 TS multiplexer 15.

The video TS generating unit 14 receives the divided merged image data encoded from the video PES first-in-first-out unit 30 in the form of PES, extracts information (ie, video PES start code, etc.) necessary for forming a video TS packet, and then connects the connected memory. transmit to (b). In addition, the MPEG-2 TS multiplexer 15 processes the PES data read from the memory b and the data received from the PCR processor 16 to generate a video TS, and then generates an MPEG-2 TS multiplexer ( 15).

The PCR processing unit 16 generates time stamp information necessary for decoding of the receiving end, transmits the time stamp information to the video TS generating unit 14, and transmits initialization data received from the host connection control unit 17 to the local processor 70. send.

The MPEG-2 TS multiplexer 19 includes a TS transmission controller 191, a chip select signal generator 192, an audio selection controller 193, a coefficient generator 194, a TS buffer controller 195, and a conference participant. And a plurality of TS output units 196 according to the number of the audio, video, and null TS generators 13 to 15 and the PSI generator 12 so that the output TS can be output at a uniform speed. Then, the PCR processing unit 16 and the like are collectively controlled to output a conference video according to the number of conference participants.

The coefficient generator 194 generates coefficients used in each block in the apparatus and transmits the coefficients to each block.

The chip select signal generator 192 generates a chip enable signal of the audio and video TS generators 13 and 14 and the PSI generator 12 according to a command of the TS transmission controller 191 to output a TS. Transfer to section 196.

The TS transmission control unit 191 receives various data according to the TS transmission control from the host connection control unit 17 to control each block in the device, and the host connection control unit 17 displays an abnormal state of the MPEG-TS multiplexer 19 and the like. To send).

The audio selection control unit 193 receives information of conference participants from the TS transmission control unit 191 and generates a selection signal of the audio TS generating unit 13. In this case, voices whose voices are missing are selected for the main speaker and the incubators, and a simple mixed voice is encoded and transmitted to the other participants.

The TS buffer control unit 195 monitors the state of the plurality of MPEG-2 TS buffers 50 and transmits the information to the TS output unit 196 and the host connection control unit 17.

The plurality of TS output units 196 transmits the last generated TS for conferences to the outside, and can be expanded according to the number of conference attendees.

The present invention described above is capable of various substitutions, modifications, and changes without departing from the spirit of the present invention for those skilled in the art to which the present invention pertains, and the above-described embodiments and accompanying It is not limited to the drawing.

The present invention as described above is suitable for the configuration of a multi-point access control system that provides MPEG-2 class video conferencing services in an ATM environment, and provides an appropriate conference environment according to the number of conference participants. There is an effect that can provide a multimedia communication service according to the.

Claims (3)

Clock generation means for receiving a main clock from an external source and generating a clock required for a multiplexing operation; Host connection control means for processing an address and a control signal to transmit and receive data necessary for encoding, and for transmitting and receiving control data throughout the apparatus; Bus control means for controlling an input / output direction of a data bus in association with the host connection control means; Null transport stream generating means for generating a dummy packet to control an output speed; Program detail information processing means for outputting information for selecting and decoding any one of the received plurality of programs and packets; Media transport stream generating means for receiving encoded data and video data in the form of a packetized elementary stream, storing the encoded data and video data in a memory, and generating a media transport stream from the stored memory; Program clock reference processing means for receiving initialization data from the host access control means, transmitting the initialization data to a local processor, generating time stamp information required for decoding, and transmitting the generated time stamp information to the media transport stream generation means; The null transport stream generating means, the media transport stream generating means, the program detail information processing means, and the program clock reference processing means are controlled so that the output transport stream can be output at a uniform speed. Means for outputting Transport stream multiplexing device for multi-party video conferencing comprising a. The method of claim 1, Means for generating the media transport stream, Audio transport stream generating means for receiving the received encoded data in the form of a packetized elementary stream, storing the received encoded data in a memory, and generating an audio transport stream therefrom; And Video transport stream generation means for receiving the received video data in the form of a packetized elementary stream, storing the received video data in a memory, and generating a video transport stream therefrom. Transport stream multiplexing device for multi-party video conferencing comprising a. The method of claim 2, The multiplexing means, Coefficient generating means for generating coefficients; Transport stream control means for receiving control data from the host access control means and notifying the host access control means when an abnormal state occurs; Chip select signal generating means for generating chip activation signals of said media transport stream generating means and said program detail information processing means in accordance with a command of said transport stream control means; Audio selection control means for receiving the speaker information from the transport stream control means and generating a selection signal of the audio transport stream generation means; Buffer control means for monitoring the status of the buffer; And Output means for outputting a transport stream with a uniform speed, which can be expanded according to the number of speakers Transport stream multiplexing device for multi-party video conferencing comprising a.

Images