JPH01295546A - Television conference communication system - Google Patents

Abstract

PURPOSE:To reduce number of packets generated for the communication by multiplexing coded video and audio information, processing the result into a packet, sending the result to a line, decomposing the packet from the line into the video and audio information at the receiver side and decoding them respectively. CONSTITUTION:The video information from a camera 2 is coded by a video CODEC 6, the information is split into a prescribed backet size length N3 at an interface section 81 under the control of a multiplex section 82 and transferred to the multiplex section 82. The audio information from a microphone 4 is coded by the voice CODEC 7, split into a prescribed packet size length N2 at an interface section 83 under the control of the multiplex section 82 and the result is transferred to the multiplex section 82. The both are written in a data memory 88 by the control of the multiplex section 82, where the voice data in the N2 bytes and the video data in the N3 bytes are combined. A header in N1 byte is added to the combined data under the control of a CPU 84 to form one packet. The data processed into the packet is sent to a line 110 via a line control section 86.

Description

DETAILED DESCRIPTION OF THE INVENTION [Field of Industrial Application] The present invention relates to an improvement of a video conference communication system using a packet communication system.

[Prior Art] FIG. 3 shows a typical conventional configuration of a video conference terminal device using the packet communication method. In the same figure, (2
) is the camera, (3) is the monitor, (4) is the microphone, (5)
is a speaker, (6) is a video codec, (7) is an audio codec, (8) is a packet transmission control unit that assembles and disassembles video and audio information into packets, (81) is a video codec transmission interface unit, (83) (84) is an audio codec transmission interface unit, and (84) is a CPU.

(85) is a program memory, (86) is a line control unit,
(88) is data memory, (89) is video codec reception interface section, (91) is audio codec reception interface section, (92) is DMAC, (101)
is a data bus for data transfer, and (110) is a line.

Next, the operation will be explained. In Figure 3, the camera (
The video information from 2) is encoded by the video codec (6), and sent to the video codec transmission interface unit (81).
Each packet is divided into packets of a certain length, stored in the data memory (88), and sequentially sent to the CPU (84).
), a header is added to the data as shown in Figure 4, and the line controller (86) sends the line (110)
sent to.

On the other hand, audio information from the microphone (4) is transmitted using an audio codec (
7), and is divided into fixed packet size lengths at the audio codec transmission interface section (83).
Each packet is stored in the data memory (88), a header is added to the data as shown in FIG. 4 under the control of the CPU (84), and the data is transmitted from the line control unit (86) to the line (110). Sent out.

Next, the packet from the line (110) is sent to the line controller (8).
6) is stored in the data memory (88) and sent to the CPU.
(84), the packet header is analyzed to determine whether it is an audio packet or a video packet, and the packet is sent via the audio codec reception interface section (91) or the video codec reception interface section (89), respectively. Audio codec (8) or video codec (6)
sent to.

The audio signal decoded by the audio codec (7) is output from the speaker (5), and the video signal decoded by the video codec (6) is displayed on the monitor (3).

[Problems to be Solved by the Invention] In the conventional video conference communication system, video information and audio information are separately packetized and transmitted as described above.
The number of packets sent to the line is the sum of video packets and audio packets, so the number of packets that must be processed by the packet transmission control unit is extremely large, and the CPU
The problem was that it exceeded the software processing capacity of the software.

This invention was made to solve the above problems, and its purpose is to provide a video conference communication system that can reduce the number of packets generated for communication. .

[Means for Solving the Problems] Therefore, in the present invention, encoded video information and audio information are multiplexed, packetized, and sent to a line, and on the receiving side, the packets from the line are combined with video information and audio information. The method is to decompose the data into two parts and decode each part.

[Operations] Video information and audio information are multiplexed and incorporated into one packet transmitted over the line.

[Example 1] An example of the present invention will be described below with reference to the drawings. 1st
The figure shows a schematic configuration of a video conference terminal device adopting the method of the present invention. In Figure 1, (2) is the camera, (3) is the monitor, (4) is the microphone, (5) is the speaker, (6) is the video codec, (7) is the audio codec, and (8) is the video and audio. A packet transmission control unit that assembles and disassembles information into packets, (81) is a video codec transmission interface unit, (83) is an audio codec transmission interface unit, and (101) is video information output from the video codec transmission interface unit (81). Parallel data, (102) is audio information parallel data output from the audio codec transmission interface unit (83), (82) is a multiplexing unit that multiplexes video/audio information parallel data, (103) is data to be transferred. bus, (84) is CPU, (85) is program memory,
(86) is a line control unit, (88) is a data memory, (1
10) is a line, (90) is a separation unit that separates multiplexed packet data, (108) is separated video information parallel data, (109) is separated audio information parallel data, (89) is video information Codec reception interface section (91) is an audio codec reception interface section.

FIG. 2 shows the format of the video data and audio data stored in the data memory (88).
N) is the audio data amount, (N3) is the video data times, and (N,) is the ladder size.

Next, the operation will be explained. In Figure 1, the camera (
The video information from 2) is encoded by the video codec (6), and the video codec transmission ink-face unit (81) converts the video information to a constant packet size length (Fig. 2) under the control of the multiplexer (82). N3 of the packet format shown in
) and transferred to the multiplexer (82). on the other hand,
The audio information from the microphone (4) is encoded by the audio codec (7) and sent to the audio codec transmission interface section (
83), the packet is divided into packets of a constant length (N2 in FIG. 2) under the control of the multiplexer (82) and transferred to the multiplexer (82).

The video/audio information parallel data (101) and (102) sent to the multiplexing unit (82) are sent to the multiplexing unit (82).
The data is written to a predetermined address in the data memory (88) under the control of , and N2 bytes of audio data and N3 bytes of video data are combined as shown in FIG.

Next, under the control of the CPU (84), a header of N1 bytes is added to the above combination data to form one packet. This packetized data is sent to the line (110) via the line control unit (86).

On the receiving side, the packet from the line (110) is written into the data memory (88) under the control of the line control section (86). The packets accumulated in the data memory (88) are sent to the CPU (84) and the separation unit (90).
) is transferred to the separation unit (90) and separated into audio information parallel data (109) and video information parallel data (10g) based on the size length of the audio/video information included in the header. The signals are then supplied to the audio codec (7) and the video codec (6) through the audio codec reception ink face unit (91) and video codec reception interface unit (89), respectively, and are decoded. The decoded audio signal and video signal are output to the speaker (5) and monitor (3), respectively.

[Effects of the Invention] As explained in detail above, in this invention, video information and audio information are multiplexed and then packetized, so the number of generated packets can be reduced compared to the conventional method. If the packet processing capacity of the packet transmission control unit is the same, the packet size can be made smaller, and the transmission and processing speeds are improved.

[Brief explanation of the drawing]

FIG. 1 is a block diagram of a video conference terminal device adopting the present invention, FIG. 2 is a diagram showing a packet format according to the present invention, FIG. 3 is a block diagram of a conventional video conference terminal device, and FIG. 4 is a block diagram of a conventional video conference terminal device. FIG. 3 is a diagram showing a packet format. In the figure, (6) is a video codec, (7) is an audio codec, (82) is a multiplexing section, (86) is a line control section, (88) is a data memory, and (90) is a separation section. In addition, in the figures, the same reference numerals indicate the same or equivalent parts. Agent: Patent Attorney Masuo Oiwa (and 2 others) Diagram illustrating the packet format according to the present invention Figure 2: Conventional packet: No.

Claims (1)

[Claims] The video information encoded by the video codec unit and the audio information encoded by the audio codec unit are multiplexed, then packetized and sent to the line. On the receiving side, the packets from the line are converted into video information and audio information. A video conference communication system characterized in that the video conference communication system is decomposed and decoded in a video codec section and an audio codec section.