JPH11261642A - Data transmission method and device thereof - Google Patents

Abstract

PROBLEM TO BE SOLVED: To obtain a superior data transmission method and a device, where multiplex control is conducted by checking a residual amount in each buffer, data are controlled so that untransmitted data are not resident in the buffer as much as possible, and a delay is suppressed with data with high read-time performance. SOLUTION: This data transmission system multiplexing a plurality of or single information from a plurality of devices 100-103 into a single or a plurality of packets and transmitting them is provided with buffers 104-107 that stores information data to be multiplexed onto packets, a buffer management means 109 that adaptively changes the priority from a residual amount of each buffer, and a multiplexer means 108 that multiplexes a plurality of data into a single or a plurality of packets, based on the information from the buffer management means 109. The buffer management means 109 controls priority so that untransmitted data are not resident in the buffer, in addition to the priority of predetermined media information, and delays are suppressed for data with high read-time performance.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a data transmission method and apparatus for use in a videophone or a video conference.

[0002]

2. Description of the Related Art When transmitting a plurality of media information data such as audio data, still images, moving images, terminal control information, etc. over a single communication link, the plurality of or the single media information data is converted into a single or a plurality of packets. Multiplex and transmit. At this time, in the method of multiplexing data into a packet, a priority is determined for each medium, and when data exists in a buffer between the medium and the multiplexing device, the data is multiplexed with a predetermined priority. Generally, the priority is determined in the order of audio data, terminal control information, moving image, and still image. The multiplexing device monitors the buffer in this order, and if there is data, multiplexes as much information as possible into the packet and transmits it. For the portion that cannot be sent, the buffer is monitored again based on the priority at the next sending opportunity, and if it can be sent, it is sent.

[0003]

However, in the conventional data transmission apparatus, when high-priority data occupies a communication link, low-priority untransmitted data remains in the buffer without being transmitted. To do
In the case of data having a high real-time property such as a moving image, there is a problem that a delay occurs until the residual data arrives, so that good image quality cannot be obtained.

The present invention solves the above-mentioned conventional problem. The present invention performs multiplexing control based on the amount of residual data in each buffer, controls the untransmitted data so that it does not stay in the buffer as much as possible, It is an object of the present invention to provide an excellent data transmission method and apparatus which suppresses delay for high data.

[0005]

SUMMARY OF THE INVENTION In order to achieve the above object, the present invention provides a buffer management means for adaptively changing the priority based on the remaining amount in a buffer, and a plurality of buffer management means based on information from the buffer management means. A multiplexing means for multiplexing data into single or plural packets is provided. As a result, in addition to the predetermined media information priority,
Control is performed so that untransmitted data does not stay in the buffer as much as possible, and delay can be suppressed for data having a high real-time property.

[0006]

DESCRIPTION OF THE PREFERRED EMBODIMENTS The present invention according to claim 1 of the present invention provides a data transmission method for multiplexing a plurality of or single pieces of information into a single or a plurality of packets and transmitting the multiplexed information. This is a data transmission method characterized by adaptively changing the priority for multiplexing according to the remaining amount of the buffer for storing data. This has the effect that the delay can be suppressed for high data.

According to a second aspect of the present invention, there is provided a data transmission method for multiplexing a plurality of or single pieces of information into a single or a plurality of packets and transmitting the multiplexed information, the buffer storing information data to be multiplexed into the packets. Is a data transmission method characterized by adaptively changing the priority for multiplexing based on the remaining amount of data and the priority set arbitrarily for each information data. It has the effect that it can be determined.

According to a third aspect of the present invention, there is provided a data transmission method for multiplexing a plurality of or single information into a single or a plurality of packets and transmitting the multiplexed information, the buffer storing information data to be multiplexed into the packets. Adaptively changing the priority for multiplexing based on the remaining amount of data and the priority arbitrarily set for each information data, and replacing the information data in the buffer based on the changed priority. This is a characteristic data transmission method, and has an effect that necessary information can be transmitted quickly by exchanging information data in a buffer.

According to a fourth aspect of the present invention, there is provided a buffer for storing information data to be multiplexed into a packet in a data transmission apparatus for multiplexing a plurality of or single information into a single or a plurality of packets and transmitting the multiplexed packet. Buffer management means for adaptively changing the multiplexing priority based on the remaining amount in the buffer; and multiplexing a plurality of data into a single packet or a plurality of packets based on information from the buffer management means. This is a data transmission device provided with a multiplexing unit, and has a function of performing control so that untransmitted data does not stay in a buffer as much as possible, and capable of suppressing delay in data having high real-time properties.

According to a fifth aspect of the present invention, there is provided a data transmission apparatus for multiplexing a plurality of or single pieces of information into a single or a plurality of packets and transmitting the multiplexed information, the buffer storing information data to be multiplexed into the packets. A data-based priority assigning means for changing the priority of the information data in the buffer for each data; and adaptively setting a priority for multiplexing based on the remaining amount in the buffer and the changed priority. And a multiplexing unit for multiplexing a plurality of data into a single packet or a plurality of packets based on information from the buffer management unit. It has the effect that the degree can be determined.

According to a sixth aspect of the present invention, there is provided a buffer for storing information data to be multiplexed into a packet in a data transmission apparatus for multiplexing a plurality of or a single piece of information into a single or a plurality of packets and transmitting the multiplexed packet. A data priority assigning means for changing the priority of the information data in the buffer for each data; a buffer replacing means for replacing the information data in the buffer based on the changed priority; Buffer management means for adaptively changing the priority for multiplexing based on the remaining amount of data and the changed priority, and a plurality of data into a single packet or a plurality of packets based on information from the buffer management means. And a multiplexing means for multiplexing the data. It has the effect that the signal can be quickly.

Hereinafter, an embodiment of the present invention will be described with reference to FIG.
This will be described with reference to FIG. (Embodiment 1) FIG. 1 shows a first embodiment of a data transmission apparatus according to the present invention. In FIG. 1, reference numeral 100 denotes an image encoding device for encoding a still image, a moving image, and other information; 101, an audio encoding device for encoding an audio signal;
Is a data transmission device that manages file, mail, and other data information, 103 is a terminal control device that manages terminal capability information, terminal setting information, etc., 104 is an image data buffer that stores image encoded data, and 105 is audio Audio data buffer for storing encoded data; 106, a data buffer for storing data; 107, a terminal control signal buffer for transmitting a terminal control signal to the terminal control device of the opposite station;
8 is a multiplexer for multiplexing a plurality or units of various data into single or multiple packets and transmitting the multiplexed data to a communication network;
Is a buffer management device for managing the buffers 104, 105, 106, 107.

The operation of the data transmission apparatus configured as described above will be described with reference to FIG. A moving image signal photographed by a camera or the like is binary encoded by the image encoding device 100 and stored in the image data buffer 104.
The image data to be stored is stored in a meaningful unit such as information of one screen. The audio signal collected by a microphone or the like is binary-coded by the audio encoding device 101 and stored in the audio data buffer 105. Further, data of the data transmission device 102 for transmitting data specified by the terminal user to the partner terminal or transmitting a certain amount of data at a certain time is accumulated in the data buffer 106. Also, data that must be notified to the terminal at the opposite station, such as the terminal status, is generated by the terminal control device 103, and the terminal control signal buffer 107
Is accumulated in The information of these media is executed asynchronously. Each piece of information is monitored by the buffer management unit 109 when stored in the buffer. Then, the multiplexer 108 is started at the timing when the data can be transmitted to the communication network, and the audio data buffer 105, the terminal control signal buffer 107, the image data buffer 104, the data buffer Data is extracted from 106, additional information such as error control information is added to each medium, and various data are multiplexed into single or plural packets and transmitted to a communication network.

Next, the operation of the buffer management unit 109 will be described. In the buffer management device 109, priorities are set in advance for various media in the order of, for example, audio, terminal control, image, and data. When the amount of data to be sent to the communication network is given from the multiplexer 108, the number of transmittable data is calculated for each medium based on the priority. At this time, in addition to the initially set priority, threshold processing is performed on the remaining amount of the buffer. When the remaining amount is smaller than the threshold, for example, when image data can be sent out a little more but a large amount of terminal control information is generated, the image is temporarily stored. Increase data priority. As a result, even if the communication network is occupied by data with a high priority, untransmitted data for one screen can be sent out. In addition, threshold processing is similarly performed on data and the like. When both data and image data are equal to or smaller than the threshold, the original priority is given priority.

As described above, according to the first embodiment of the present invention, untransmitted data is prevented from staying in the buffer as much as possible based on information from the buffer management means for adaptively changing the priority from the remaining amount of the buffer. Control
The delay can be suppressed for data having high real-time properties.

(Embodiment 2) FIG. 2 shows a data transmission apparatus according to a second embodiment of the present invention. In FIG.
Reference numeral 200 denotes an image encoding device that encodes still images, moving images, and other information; 201, an audio encoding device that encodes an audio signal; 202, a data transmission device that manages file, mail, and other data information; Is a terminal control device that manages terminal capability information, terminal setting information, etc., 204 is an image data buffer that stores image encoded data, 205 is an audio data buffer that stores audio encoded data, and 206 is data that stores data. 207 is a terminal control signal buffer for transmitting the terminal control signal to the terminal control device of the opposite terminal, and 208 is a data buffer for multiplexing various data or a plurality of single information into one or a plurality of packets for communication. A multiplexer 209 for transmitting data to the network is provided with buffers 204, 205, 206, and 207.
Is a data-based priority assigning means for the user to set a priority order for each data for each medium.

The operation of the data transmission device configured as described above will be described with reference to FIG. A moving image signal photographed by a camera or the like is binary encoded by the image encoding device 200 and stored in the image data buffer 204.
The image data to be stored is stored in a meaningful unit such as information of one screen. The audio signal collected by a microphone or the like is binary-coded by the audio encoding device 201 and stored in the audio data buffer 205. In addition, data from the data transmission device 202 that transmits data specified by the terminal user to the partner terminal or transmits a certain amount of data at a certain time is accumulated in the data buffer 206. Also, data that must be notified to the terminal at the opposite station, such as the terminal status, is generated by the terminal control device 203, and the terminal control signal buffer 207 is generated.
Is accumulated in The information of these media is executed asynchronously. Each piece of information is monitored by the buffer management unit 209 when stored in each buffer. By registering each medium in the data-based priority assigning means 210, when storing data in each buffer, a priority can be set for each data. The multiplexing device 208 is started at the timing when the data can be transmitted to the communication network, and the audio data buffer 205, the terminal control signal buffer 207, the image data buffer 204, and the data buffer Data is extracted from 206, additional information such as error control information is added to each medium, and various data are multiplexed into single or plural packets and transmitted to a communication network.

The buffer management unit 209 determines the data to be transmitted in consideration of the priority of the stored data and the remaining buffer amount. At that time, the priority set by the data-based priority assigning means 210 is followed. For example, when it is desired to increase the transmission priority of important information of an image, the data-specific priority assigning unit 210 sets the priority order of the data high, and does not set the priority order of other data. Information that is not set at this time is given a default value priority. The same applies to voice information, data, and terminal control. Information that can be delayed no matter how low the priority is set, and information that is desired to be sent early is set high. Buffer monitoring means 20
9 considers this information, and does not transmit information that can be delayed even if the information has a higher priority of the initial setting value until transmission becomes possible.

As described above, according to the second embodiment of the present invention, untransmitted data or untransmitted data is stored on the basis of information from the buffer management means for adaptively changing the priority based on the data-based priority and the remaining buffer capacity. Control is performed so that valid information does not stay in the buffer as much as possible, and delay can be suppressed for data with high real-time properties. In addition, the priority can be determined according to the user's request.

(Embodiment 3) FIG. 3 shows a data transmission apparatus according to a third embodiment of the present invention. In FIG.
Reference numeral 300 denotes an image encoding device for encoding still images, moving images, and other information; 301, an audio encoding device for encoding an audio signal; 302, a data transmission device for managing file, mail, and other data information; Is a terminal control device that manages terminal capability information, terminal setting information, etc., 304 is an image data buffer that stores image encoded data, 305 is an audio data buffer that stores audio encoded data, and 306 stores data 307 is a terminal control signal buffer for transmitting the terminal control signal to the terminal control device of the opposite station, and 308 is a communication device that multiplexes various data into a single or a plurality of packets by multiplexing a plurality or a single piece of information. A multiplexer 309 for transmitting data to the network is provided with buffers 304, 305, 306, 307.
Is a buffer management device that manages data, 310 is a data-based priority assigning unit that sets a priority order for each data for each medium, and 311 is a buffer replacement unit.

The operation of the data transmission apparatus configured as described above will be described with reference to FIG. A moving image signal captured by a camera or the like is binary-coded by the image coding device 300 and stored in the image data buffer 304.
The image data to be stored is stored in a meaningful unit such as information of one screen. The audio signal collected by a microphone or the like is binary-coded by the audio encoding device 301 and stored in the audio data buffer 305. In addition, data from the data transmission device 302 that transmits data specified by the terminal user to the partner terminal or transmits a certain amount of data at a certain time is accumulated in the data buffer 306. Also, data that must be reported to the terminal at the opposite station, such as the terminal status, is generated by the terminal control device 303, and the terminal control signal buffer 307 is generated.
Is accumulated in The information of these media is executed asynchronously. Each piece of information is monitored by the buffer management unit 309 when stored in the buffer. By registering each medium in the data-based priority assigning means 310, when storing data in each buffer, a priority can be set for each data. In addition, the buffer can be operated by using the buffer exchange means 311 to delete data from the buffer or to transmit high-priority data at the next transmission timing. Then, the multiplexer 308 is started at the timing when the data can be sent to the communication network, and the audio data buffer 305, the terminal control signal buffer 307, the image data buffer 304, the data buffer Data is extracted from 306, additional information such as error control information is added to each medium, and various data are multiplexed into a single or a plurality of packets and transmitted to a communication network.

The buffer management unit 309 determines the data to be transmitted in consideration of the priority of the stored data and the remaining buffer amount. At that time, the priority set by the data-based priority assigning means 310 is followed. For example, when it is desired to increase the transmission priority of important information of an image, the data-specific priority assigning means 310 sets the priority order of the data to be high, and does not set any other priority. Information that is not set at this time is given a default value priority. The same applies to voice information, data, and terminal control. Information that can be delayed no matter how low the priority is set, and information that is desired to be sent early is set high. Buffer monitoring means 30
9 considers this information, and does not transmit information that can be delayed even if the information has a higher priority of the initial setting value until transmission becomes possible. And buffer replacement means
At 311, the data is deleted or the data in the buffer is sorted based on the priority according to the changed priority.

As described above, according to the third embodiment of the present invention, based on the information from the buffer management means for adaptively changing the priority based on the data-based priority, the buffer replacement, and the remaining amount of the buffer, Control is performed so that transmission data or valid information does not stay in the buffer as much as possible, and delay can be suppressed for data having a high real-time property. In addition, the priority can be changed as desired by the user, and the data in each buffer can be replaced based on the changed priority.

[0024]

As described above, according to the present invention, untransmitted data or valid information is stored in the buffer as much as possible based on information from the buffer management means for adaptively changing the priority from the remaining amount in the buffer. Control is performed so as not to stagnate, and delay can be suppressed for data having high real-time properties.

[Brief description of the drawings]

FIG. 1 is a block diagram showing a first embodiment of a data transmission device of the present invention.

FIG. 2 is a block diagram showing a data transmission device according to a second embodiment of the present invention;

FIG. 3 is a block diagram showing a third embodiment of the data transmission device of the present invention.

[Explanation of symbols]

 100, 200, 300 Image encoding devices 101, 201, 301 Audio encoding devices 102, 202, 302 Data transmission devices 103, 203, 303 Terminal control devices 104, 204, 304 Image data buffers 105, 205, 305 Audio data Buffers 106, 206, 306 data buffers 107, 207, 307 terminal control signal buffers 108, 208, 308 multiplexers 109, 209, 309 buffer managers 210, 310 priority assigning means by data 311 buffer replacing means

Claims (6)

[Claims] 1. A data transmission method for multiplexing a plurality of or a single piece of information into a single or a plurality of packets and transmitting the multiplexed information, the priority of the multiplexing being determined by the remaining amount of a buffer for storing information data to be multiplexed into the packet. A data transmission method characterized by adaptively changing the order. 2. A data transmission method for multiplexing a plurality of or a single piece of information into a single or a plurality of packets and transmitting the multiplexed information, the remaining amount of a buffer for storing information data to be multiplexed into a packet, A data transmission method characterized by adaptively changing the priority for multiplexing according to the priority set in (1). 3. A data transmission method for multiplexing a plurality of or a single piece of information into a single or a plurality of packets and transmitting the multiplexed information, the remaining amount of a buffer for storing information data to be multiplexed into the packet, A data transmission method, wherein the priority for multiplexing is adaptively changed according to the priority set in (1), and information data in a buffer is replaced based on the changed priority. 4. A data transmission apparatus for multiplexing a plurality of or a single piece of information into a single or a plurality of packets and transmitting the multiplexed information, a buffer storing information data to be multiplexed into the packet, A data transmission apparatus comprising: buffer management means for adaptively changing the priority for multiplexing; and multiplexing means for multiplexing a plurality of data into a single packet or a plurality of packets based on information from the buffer management means. . 5. A data transmission apparatus for multiplexing a plurality of or a single piece of information into a single or a plurality of packets and transmitting the multiplexed information, a buffer for storing information data to be multiplexed into a packet, A data-based priority assigning means for changing the priority for each data, a buffer management means for adaptively changing the priority for multiplexing based on the remaining amount in the buffer and the changed priority, and the buffer Multiplexing means for multiplexing a plurality of data into a single packet or a plurality of packets based on information from a management means. 6. A data transmission apparatus for multiplexing a plurality of or a single piece of information into a single or a plurality of packets and transmitting the multiplexed information, a buffer for storing information data to be multiplexed into a packet, A priority assigning means for each data for changing the priority order every time, a buffer replacing means for replacing the information data in the buffer based on the changed priority, a remaining amount in the buffer and the changed priority Buffer management means for adaptively changing the priority for multiplexing based on
Multiplexing means for multiplexing a plurality of data into a single packet or a plurality of packets based on information from the buffer management means.