JP2014045243A - Video data distribution device and bidirectional interactive system including it - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a video data distribution device comprising structure that allows a distribution data amount to be reduced while preventing deterioration in quality of video data at each transmission side information processing terminal when the video data from a plurality of transmission side information processing terminals is distributed to one or more reception side information processing terminals.SOLUTION: A video data distribution device distributes video data received from two or more transmission side information processing terminals via a communication interface to at least one reception side information processing terminal. The video data distribution device distributes the received video data to the reception side information processing terminal while changing respective data amounts of the received video data in accordance with data amount variation patterns different from each other along the time axis direction so that the total data amount falls in a range of the maximum bandwidth of the reception side information processing terminal. The video data to be distributed is compressed in a scalable manner at each of the transmission side information processing terminals or at the video data distribution device.

Description

  The present invention relates to a video data distribution apparatus that centrally manages transmission / reception between a plurality of information processing terminals connected to each other via predetermined transmission means, and a bidirectional interactive system including the same.

  In recent years, for example, a multipoint TV conference system disclosed in Patent Document 1 is used as a communication system (bidirectional dialogue system) that realizes a two-way dialogue between client terminals located in remote locations (bases). There is a lot of research. Such a system that enables data exchange between specific information processing terminals can be easily constructed by using a widely used communication network such as the Internet, while the confidentiality of information transmitted and received in the system is reduced. It is necessary to secure.

  For example, the Internet VPN (Virtual Private Network) service, which has been attracting attention recently, is a web conference with high information confidentiality by virtually constructing a dedicated line on the Internet (general data communication line) which is a public network. This service provides a simple system. In a conference system using such a VPN service, VPN routers installed at a plurality of locations are connected via the Internet, and a plurality of information processing terminals are connected to a VPN router located at any location. Built in.

JP 09-149396 A

  As a result of examining the above-described prior art in detail, the inventors have found the following problems. That is, as disclosed in the above-mentioned Patent Document 1, in a multipoint TV conference apparatus such as an MCU, when video data from a plurality of transmission side information processing terminals is distributed to another reception side information processing terminal, FIG. As shown in FIG. 6A, a communication bandwidth defined by (number of terminals on the transmission side) × (amount of video data that can be transmitted per terminal) is required. Therefore, if the number of terminals on the transmission side increases, there is a problem that the necessary communication bandwidth increases (occurrence of transmission delay) accordingly.

  As a method for suppressing the communication bandwidth against the increase in the number of terminals on the transmission side, for example, a method for reducing the image quality of video data transmitted from each transmission side information processing terminal or a display size on the reception side information processing terminal A method for adjusting the resolution and image quality of the video data transmitted from the transmission-side information processing terminal is performed. In this case, the image quality degradation of the video data displayed on the receiving information processing terminal is recognized by the operator (conference participant) of the information processing terminal, or the video display method on the receiving information processing terminal is restricted. There was a problem.

  In addition, as shown in FIG. 6B, in the method of alternately distributing video data from each transmission-side information processing terminal, the display operation on the reception-side information processing terminal is delayed depending on the communication status. The possibility of occurrence is also fully considered.

  The present invention has been made in order to solve the above-described problems, and when transmitting video data from a plurality of transmission side information processing terminals to one or more reception side information processing terminals, each transmission side information processing is performed. It is an object of the present invention to provide a video data distribution apparatus having a structure for enabling the amount of distribution data to be reduced while suppressing deterioration in quality of video data of a terminal, and a bidirectional interactive system including the same.

  The video data distribution apparatus according to the present invention separates video data from two or more transmission-side information processing terminals from a plurality of information-processing terminals connected to each other via predetermined transmission means. The function of relaying to one or more information processing terminals on the receiving side of the above, and enables fine video quality control along the time axis direction with a simple device configuration. Here, the predetermined transmission means is a concept including a local LAN and a home LAN as well as a general communication network such as a public line and a mobile phone line, regardless of wired or wireless, such as the Internet. It means all communication paths located between information processing devices that perform transmission and reception. Further, video data transmitted / received between a plurality of information processing terminals may be composed of a plurality of image frames arranged along the time axis without being compressed in the time axis direction. It may be composed of a plurality of image frames that are also compressed in the direction.

  In order to solve the above-described problem, a video data distribution device according to the present invention includes at least a communication interface, a storage device, and a control device. The communication interface receives video data from two or more transmitting information processing terminals among a plurality of information processing terminals, and distributes the received video data to one or more receiving information processing terminals. The storage device stores the video data from each of the transmission side information processing terminals received via the communication interface. The control device performs scalable compression on each video data from the transmission side information processing terminal. The storage device is also used as a work area for scalable compression and the like executed by the control device.

  In particular, the control device receives video data (first and second video data) received from each of two or more transmission-side information processing terminals among a plurality of information processing terminals via a communication interface. When distributing to a processing terminal via a communication interface, the quality of video data from each transmitting information processing terminal is controlled in the time axis direction, and video quality is degraded by combining high-quality and low-quality video data. Reduce transmission volume while suppressing.

  For example, when the first and second video data are received via the communication interface from the first and second transmission-side information processing terminals among the plurality of information processing terminals, the control device first receives one or more receptions. The data amount of each of the first and second video data according to different data amount variation patterns along the time axis direction so that the total data amount falls within the range of the maximum use bandwidth allocated in advance to each of the side information processing terminals. Each of the first and second video data is scalable compressed while varying individually. Thereafter, the control device distributes the first and second video data, which are scalable compressed in accordance with different data amount variation patterns along the time axis direction, to one or more reception-side information processing terminals via the communication interface.

  Note that scalable compression means a compression method for encoding with hierarchical scalability so that a plurality of resolutions, a plurality of image quality, a plurality of bit rates, and the like can be extracted from a single compressed data. A data amount variation pattern associated with each video data from a plurality of transmission-side information processing terminals indicates a code amount (data amount) that is scalable and compressed along the time axis direction. For example, when the first and second video data are distributed to one or more receiving-side information processing terminals, the first data amount variation pattern associated with the first video data and the second video data are associated with each other. In addition, the second data amount variation pattern includes the first video data within the range of the maximum use bandwidth of the receiving information processing terminal to which the data amounts of the first and second video data subjected to scalable compression are to be distributed. The amount of data and the amount of second video data are set to be alternately increased. This is the same when video data from three or more transmitting information processing terminals is received.

  According to the present invention, scalable compression is performed so that each of a plurality of video data received from different transmitting information processing terminals as described above is composed of a high-quality part and a low-quality part along the time axis direction. By combining the high-quality part of one video data and the low-quality part of the other video data in the scalable compressed video data in this way, the transmission amount can be reduced while suppressing deterioration of the video quality of each of the combined video data. It becomes possible to reduce. That is, fine video quality control along the time axis direction of video data from a plurality of information processing terminals on the transmission side can be performed with a simple device configuration.

  In the video data distribution apparatus according to the present invention, when video data (first and second video data) from at least two transmission-side information processing terminals is received via a communication interface, In the data amount variation pattern associated with the video data, it is preferable that at least two or more data amounts are set along the time axis direction. In addition, when video data (first to third video data) from at least three transmission-side information processing terminals is received via the communication interface, the first data according to different data amount variation patterns along the time axis direction is used. Each of the first to third video data is scalable compressed while individually changing the data amount of each of the third video data. When scalable compression is performed on two or more video data, or three or more video data, the magnitude relationship between the data amount of one of the video data and the data amount of another video data is changed along the time axis direction. preferable.

  Note that scalable compression for video data may be performed in each of the transmission side information processing terminals. In this case, the control device adjusts the data amount of each video data from the transmission side information processing terminal. Specifically, the control device receives video data (first and second video data) received from each of two or more transmitting information processing terminals through a communication interface among the plurality of information processing terminals. When distributing to the information processing terminal via the communication interface, the quality of the video data to be distributed is controlled in the time axis direction by adjusting the amount of scalable compressed video data from each transmitting side information processing terminal. By combining high-quality and low-quality video data, the transmission volume is reduced while suppressing the deterioration of video quality.

  For example, when the first and second video data are received via the communication interface from the first and second transmission-side information processing terminals among the plurality of information processing terminals, the control device first receives one or more receptions. The data amount of each of the first and second video data according to different data amount variation patterns along the time axis direction so that the total data amount falls within the range of the maximum use bandwidth allocated in advance to each of the side information processing terminals. Adjust individually. Thereafter, the control device transmits the first and second video data, whose data amounts are individually adjusted according to different data amount variation patterns along the time axis direction, to one or more receiving side information processing via the communication interface. Deliver to the terminal.

  Note that scalable compression is a compression method in which encoding is performed with hierarchical scalability as described above. Therefore, the data amount of the scalable compressed video data can be adjusted by selecting for each scalability layer. For example, in the case where first and second video data that are scalable and compressed in advance at each of the transmission-side information processing terminals are distributed to one or more reception-side information processing terminals, the first data associated with the first video data The second data amount variation pattern associated with the amount variation pattern and the second video data is the maximum of the information processing terminal on the receiving side to which the data amounts of the first and second video data subjected to scalable compression are to be distributed. Within the range of the use band, the data amount of the first video data and the data amount of the second video data are set to be alternately increased. This is the same when video data from three or more transmitting information processing terminals is received.

  According to the present invention, the data amount adjustment is performed so that each of the plurality of video data received from different transmission-side information processing terminals as described above is composed of a high-quality part and a low-quality part along the time axis direction. By combining the high-quality part of one video data and the low-quality part of the other video data in the scalable compressed video data in this way, the transmission amount can be reduced while suppressing deterioration of the video quality of each of the combined video data. It becomes possible to reduce. That is, fine video quality control along the time axis direction of video data from a plurality of information processing terminals on the transmission side can be performed with a simple device configuration.

  In the video data distribution apparatus according to the present invention, when video data (first and second video data) from at least two transmission-side information processing terminals is received via a communication interface, In the data amount variation pattern associated with the video data, it is preferable that at least two or more data amounts are set along the time axis direction. In addition, when video data (first to third video data) from at least three transmission-side information processing terminals is received via the communication interface, the first data according to different data amount variation patterns along the time axis direction is used. The data amount of each of the third video data is individually adjusted. When adjusting the amount of scalable compressed video data of 2 or more and 3 or more, the magnitude relationship between the data amount of one of the video data and the data amount of another video data is changed along the time axis direction. Preferably it is done.

  In the video data distribution apparatus according to the present invention, the video data transmitted / received between a plurality of information processing terminals is preferably composed of image frames in accordance with the JPEG2000 standard.

  Each embodiment according to the present invention can be more fully understood from the following detailed description and the accompanying drawings. These examples are given for illustration only and should not be construed as limiting the invention.

  Further scope of applicability of the present invention will become apparent from the detailed description given below. However, the detailed description and specific examples, while indicating the preferred embodiment of the invention, are presented for purposes of illustration only and various modifications and improvements within the scope of the invention may It will be apparent to those skilled in the art from the detailed description.

  According to the present invention, when video data from a plurality of transmission-side information processing terminals is distributed to one or more reception-side information processing terminals, the amount of distribution data is suppressed while suppressing deterioration of the video data quality of each transmission-side information processing terminal. Can be reduced. Also, the video data of each transmitting information processing terminal is scalable compressed according to the corresponding data amount variation pattern, or the video data compressed by each transmitting information processing terminal is individually compressed according to the corresponding data amount variation pattern By adjusting the data amount, it is possible to flexibly change the video quality component in the time axis direction for each transmission-side information processing terminal using a device simpler than the transmission-side information processing.

It is a figure which shows the network structure for implement | achieving delivery of video data between several information processing terminals as one Embodiment of the interactive dialogue system which concerns on this invention. It is a figure which shows schematic structure of one Embodiment of the video data delivery apparatus which concerns on this invention. It is a figure for demonstrating a data structure also about the video data (it consists of several image frames) which has multiple types of hierarchical scalability. It is a conceptual diagram for demonstrating progressive order (data priority). It is a figure for demonstrating one delivery form of video data. It is a figure for demonstrating the delivery operation | movement of the conventional video data. It is a figure for demonstrating an example of the delivery operation | movement of the video data which concerns on this embodiment. It is a figure for demonstrating the video data decoding operation | movement delivered by this embodiment.

  Hereinafter, embodiments of a video data distribution apparatus according to the present invention will be described in detail with reference to the accompanying drawings. In the description of the drawings, the same elements are denoted by the same reference numerals, and redundant description is omitted.

  FIG. 1 is a diagram showing a network configuration for realizing distribution of video data among a plurality of information processing terminals as an embodiment of the interactive dialogue system according to the present invention. An interactive dialogue system realized by the network configuration shown in FIG. 1, for example, a video conference system, includes information processing terminals 30 </ b> A to 30 </ b> C (PCs) arranged at a plurality of bases 20 </ b> A to 20 </ b> C connected via the network 10. And a video data distribution device 100 that distributes video data received from the transmission side information processing terminal via the network 10 to the reception side information processing terminal via the network 10 between the plurality of bases 20A to 20C. . Note that a router for connecting a plurality of information processing terminals may be arranged at each site.

  In the base A (20A), an information processing terminal 30A (PC) used by a participant belonging to the base A among the participants in the video conference system is connected to the network 10. In the base B (20B), an information processing terminal 30B (PC) used by a participant belonging to the base B among the participants in the video conference system is connected to the network 10. Further, at the base C (20C), an information processing terminal 30C (PC) used by a participant belonging to the base C among the participants in the video conference system is connected to the network 10.

  FIG. 2 is a diagram showing a schematic configuration of the video data distribution apparatus 100 shown in FIG. The video data distribution apparatus 100 shown in FIG. 2 includes at least a communication device 120 (communication I / O) that is a communication unit that exchanges data between the control unit 110 that is a control unit and a network 10. ) And N (≧ 1) storage devices 130 </ b> A to 130 </ b> N as storage means, and a device interface 140 (including a drawing device and data transmission / reception I / O) for exchanging data with the peripheral device 150. . The storage devices 130A to 130N temporarily store video data transmitted and received between the PCs 30A to 30C as information processing terminals, and also application data such as a conference program executed by the control device 110. Stored. The storage devices 130A to 130N can also be used as a work area for encoding (scalable compression) performed by the control device 110. The basic configuration of the video data distribution apparatus 100 may be the same as the configuration of an NCU (Network Control Unit), which is a network resource on the network 10, in addition to the PCs 30A to 30C shown in FIG.

  The network 10 is a concept including a local LAN and a home LAN as well as a general communication network such as the public line and a cellular phone line, such as the Internet, whether wired or wireless, and transmits and receives packet data. It means all communication paths located between the information processing apparatuses 30A to 30C.

  The peripheral device 150 includes, for example, an external storage device, an input device such as a keyboard and a pointing device, and a display device.

  Note that the video data distribution apparatus 100 (FIG. 2) according to the present embodiment distributes video data (consisting of a plurality of image frames) having a plurality of types of hierarchical scalability (each image frame is scalable and compressed). ). Hereinafter, for the sake of simplicity, encoding of each packet of JPEG 2000, which is an international standard for image compression, will be described as a specific example of digital data having hierarchical scalability. JPEG2000 can give priority to the type of scalability. In the coded sequence, this order is expressed as a packet composition order (progression order) which is a data unit. There are four types of scalability that determine the progression order: layer (L), resolution level (R), component (C), and position (P).

FIG. 3 is a conceptual diagram for explaining the data structure of image data having a plurality of types of hierarchical scalability. Among the scalability of JPEG2000, the scalability that is the object of access control is represented by the layer (L) and the resolution level (R). ) Shows a decoding pattern of a packet coded sequence in JPEG2000 when it is limited to only (in the case of a grayscale image). Specifically, in FIG. 3, the layer number N _L of the layer (scalability L) is 3, and the layer number N _R of the resolution level (scalability R) is 3. The layer is also referred to as an image quality layer, and means arithmetically encoded data of a digital image corresponding to SNR (Signal / Noise Ratio) at the time of image reproduction. Since information having a higher influence on image quality is included in a higher layer, the quality of a reproduced image can be improved step by step by adding lower layer data to upper layer data.

In FIG. 3, P _{i, j} (i = 0,..., N _L-1 ; j = 0,..., N _R-1 ; i is a hierarchical number of scalability L; j is a hierarchical number of scalability) is image information. Represents a JPEG2000 packet with Expressing JPEG2000 coded image of a quality _{Q L,} in _{R, Q L,} the packet in order to obtain _R is surrounded by the frame A in FIG. _{3 P i, j (i =} 0, ..., L; j = 0,..., R) all need to be decrypted. However, if at least one of the packets P _{i, j} is decoded on the receiving side, there is no problem in normal reproduction of the image. Therefore, the packets P _{i, j} are individually encoded (scalable compression) in order to maintain the hierarchy in access control such as a QoS function.

  In JPEG2000 as described above, there are five types of progression order (data priority): LRCP, RLCP, RPCL, PCRL, and CPRL, each prioritized in order from the first element. FIG. 4 is a conceptual diagram for explaining the progressive order indicating the priority when decoding the JPEG2000 packet coded sequence shown in FIG. 4A is a decoding order in the LRCP progression order in which scalability L (layer) is given the highest priority, and FIG. 4B is an RLCP progression order in which scalability R (resolution level) is given the highest priority. Is the decoding order.

  Next, the video data distribution operation in the video conference system having the network configuration of FIG. 1 to which the video data distribution apparatus 100 according to the present embodiment is applied will be described in detail with reference to FIG. Although the following example corresponds to an embodiment in which scalable compression is performed in the video data relay apparatus 100, scalable compression may be performed on video data to be transmitted in the transmission-side information processing terminal. That is, when video data that has already been compressed by the transmission side information processing terminal is relayed, the video data relay device 100 can adjust the data amount by using the hierarchical structure of the video data. Specifically, by selecting the hierarchical level to be transmitted to the receiving information processing terminal for each scalability, it is possible to adjust the data amount of the video data that has already been scalable compressed by the transmitting information processing terminal.

  For example, in FIG. 5, the information processing terminal 30A at the site A (20A) becomes a transmission side information processing terminal that transmits the video data A to the video data distribution apparatus 100, and the information processing terminal 30B at the site B (20B) The information processing terminal 30C that transmits the data B to the video data distribution apparatus 100 and the information processing terminal 30C at the base C (20C) distributes the video data A and the video data B ( FIG. 5 shows a configuration of a receiving side information processing terminal that receives “A + B”).

  In the example of FIG. 5, when the video data (A + B) reaches the receiving side information processing terminal 30C at the base C from the video data distribution apparatus 100, the receiving side information processing terminal 30C transmits the received video data (A + B). The video data A from the side information processing terminal 30A and the video data B from the transmission side information processing terminal 30B are separated. Furthermore, the information processing terminal 30C on the receiving side decodes the video data A and the video data B that are finally received (which are scalable compressed for each image frame by the control device 110 of the video data distribution device 100). Then, the decoded data of the video data A and / or the video data B is displayed on a monitor or the like (may be temporarily stored in a recording device).

  Note that the number of terminals on the transmission side may be three or more. Also, the number of terminals on the receiving side may be two or more.

  Note that the conventional distribution operation of the video data (A + B) in the video data distribution apparatus 100 is as described above (see FIGS. 6 (a) and 6 (b)) and is used in advance assigned to the information processing terminal on the receiving side. The possibility of exceeding the bandwidth or causing a display delay on the information processing terminal side is high.

  Therefore, the video data distribution apparatus 100 according to the present embodiment has a communication interface 120 from each of two or more transmission side information processing terminals (in the example of FIG. 5, transmission side information processing terminals 30A and 30B) among a plurality of information processing terminals. When the video data A and the video data B received via the communication interface 120 are distributed to one or more receiving information processing terminals (the receiving information processing terminal 30C in the example of FIG. 5) via the communication interface 120, FIG. As shown, the quality of the video data A and video data B from each of the transmission-side information processing terminals 30A and 30B is controlled in the time axis direction, and high-quality and low-quality image frames (encoded data) are combined. Therefore, the transmission amount is reduced while suppressing the deterioration of the video quality. Specifically, when the high-quality encoded data in the image frame of the video data A and the low-quality encoded data in the image frame of the video data B are combined, the video data A is reduced in the following combination. The encoded data with the image quality and the encoded data with the high image quality of the video data B are combined. FIG. 7 is a diagram for explaining an example of the video data distribution operation according to the present embodiment.

  For example, let us consider a case where video data A and video data B transmitted from two transmission-side information processing terminals 30A and 30B are distributed to one reception-side information processing terminal 30C as in the network configuration of FIG.

  At this time, the video data A transmitted from the transmission-side information processing terminal 30A is set with a data amount variation pattern in which the amount of data after scalable compression varies as 70% → 30% → 70% → 30% →. The In FIG. 7, A1 is an image frame (encoded data) that is scalable compressed so that the data amount is 70%, and A2 is an image frame (encoded data) that is scalable compressed so that the data amount is 30%. Data). On the other hand, in the video data B transmitted from the transmission-side information processing terminal 30B, a data amount variation pattern is set in which the data amount after scalable compression varies as 30% → 70% → 30% → 70% →. . Note that the total data amount of the video data A and the video data B is within the range of the maximum usable bandwidth allocated in advance to the receiving side information processing terminal 30C.

  On the other hand, as shown in FIG. 7, the reception-side information processing terminal 30C to which the video data A and the video data B whose data amounts change alternately distributes the video data A and the video data B.

  FIG. 8 is a diagram for explaining the display operation of the video data A in the receiving side information processing terminal 30C. As shown in FIG. 8, the receiving side information processing terminal 30C converts the video data A (encoded data A that is scalable compressed for each image frame) separated from the received video data (video data A + B) for each image frame. The decoded image frames are adjusted to the display size and sequentially displayed on the display. Note that the image frame F1 shown in FIG. 8 is decoded data corresponding to encoded data that is scalable and compressed so that the data amount becomes 70%, and there is little adjustment of the display size. ) Is small. On the other hand, the image frame F2 is decoded data corresponding to encoded data that is scalable and compressed so that the data amount is 30%, and the display size is largely adjusted, so that the image quality deterioration (resolution) increases. In this way, in the information processing terminal 30C on the receiving side, the image frames that are updated at high speed are displayed in a state in which the low-quality frames are mixed between the high-quality frames. For this reason, even if a low-quality image frame is displayed on the display, it is difficult to perceive image quality degradation as an observer's feeling. As described above, according to the present embodiment, in the receiving side information processing terminal 30C to which the video data A + B is distributed, the data amount of the entire video data to be distributed is halved compared to the conventional case (FIG. 6A). Thus, both the video data A from the transmission side information processing terminal A and the video data B from the transmission side information processing terminal B can be simultaneously viewed while suppressing image quality deterioration.

  The video quality component controlled along the time axis direction may be image quality or resolution component. Arbitrary quality can be adopted as the combination of the video quality levels in the time axis direction, and the quality may be changed stepwise, for example, 70% → 60% → 30%.

  Further, depending on the importance of each video data transmitted from the transmission side information processing terminal, the ratio of the video data from the transmission side information processing terminal to be prioritized (data amount ratio with respect to the maximum used bandwidth) is different from other transmissions. It may be set to be larger than the side information processing terminal.

  In the above-described embodiment, an example in which video data from two transmission-side information processing terminals is distributed is shown. However, video data from three or more transmission-side information processing terminals is converted into one or more reception-side information processing terminals. Even if it is a case where it delivers to, as mentioned above (refer FIG. 7), what is necessary is just to combine a different quality ratio (data amount ratio) along a time-axis direction.

  Furthermore, even when the video data is compressed in the time axis direction, if the data amount of the next image frame does not satisfy the reference data amount (maximum usable bandwidth), it is cut by scalable compression with respect to the previous image frame. A configuration may be employed in which the image quality component is satisfied with the encoded data of the next image frame and distributed together with the encoded data of the next image frame.

  From the above description of the present invention, it is apparent that the present invention can be modified in various ways. Such modifications cannot be construed as departing from the spirit and scope of the invention, and modifications obvious to one skilled in the art are intended to be included within the scope of the following claims.

  DESCRIPTION OF SYMBOLS 10 ... Network, 20A-20C ... Base, 30A-30C ... Information processing terminal (PC), 100 ... Image | video data delivery apparatus, 110 ... Control apparatus, 120 communication interface, 130A-130N ... Memory | storage device.

Claims (9)

In a video data distribution apparatus that relays video data transmitted and received between a plurality of information processing terminals connected to each other via a predetermined transmission means,
A communication interface for transmitting and receiving the video data to and from the plurality of information processing terminals;
A storage device for storing video data from the transmission side information processing terminal received via the communication interface;
A controller for scalable compression of video data from the transmission-side information processing terminal,
The control device includes:
The first and second video data received from each of the plurality of information processing terminals via at least the first and second transmission side information processing terminals via the communication interface are transmitted to the one or more reception side information processing terminals. When delivering via the communication interface,
The first and second videos according to different data amount variation patterns along the time axis direction so that the total data amount falls within the range of the maximum use bandwidth allocated in advance to each of the one or more receiving side information processing terminals. Each of the first and second video data is scalable compressed while varying the amount of each data individually,
Delivering the first and second video data, which are scalable compressed according to different data amount variation patterns along the time axis direction, to the one or more receiving information processing terminals via the communication interface;
A video data distribution apparatus characterized by the above. In a video data distribution apparatus that relays video data transmitted and received between a plurality of information processing terminals connected to each other via a predetermined transmission means,
A communication interface for transmitting and receiving the video data to and from the plurality of information processing terminals;
A storage device for storing video data received from the transmission side information processing terminal via the communication interface, the video data being scalable compressed in the transmission side information processing terminal;
A controller for delivering scalable compressed video data from the transmission-side information processing terminal to a desired reception-side information processing terminal via the communication interface;
The control device includes:
The first and second video data received from each of the plurality of information processing terminals via at least the first and second transmission side information processing terminals via the communication interface, each of which is scalable and compressed. When delivering to the receiving information processing terminal via the communication interface,
The first and second videos according to different data amount variation patterns along the time axis direction so that the total data amount falls within the range of the maximum use bandwidth allocated in advance to each of the one or more receiving side information processing terminals. Adjust the amount of each data individually,
Delivering the first and second video data, the data amount of which is adjusted according to different data amount variation patterns along the time axis direction, to the one or more receiving information processing terminals via the communication interface;
A video data distribution apparatus characterized by the above.   3. The video data distribution according to claim 1, wherein at least two data amounts are set along the time axis direction in each data amount variation pattern of the first and second video data. apparatus. The control device transmits, to the communication interface, third video data from a third transmission information processing terminal different from the first and second transmission information processing terminals together with the first and second video data. Received through
Each of the first to third video data is scalable compressed while individually varying the data amount of each of the first to third video data according to different data amount variation patterns along the time axis direction. 4. The video data distribution apparatus according to claim 1, wherein the video data distribution apparatus is a video data distribution apparatus.   The control device is configured such that the data amount of video data from any one of the plurality of information processing terminals that has become a transmission-side information processing terminal is larger than the data amount of video data from other transmission-side information processing terminals. The video data distribution device according to claim 1, wherein each of the first and second video data is scalable compressed. The control device transmits, to the communication interface, third video data from a third transmission information processing terminal different from the first and second transmission information processing terminals together with the first and second video data. Received through
4. The video data distribution apparatus according to claim 2, wherein the data amount of each of the first to third video data is individually adjusted according to different data amount variation patterns along the time axis direction.   The control device is configured such that the data amount of video data from any one of the plurality of information processing terminals that has become a transmission-side information processing terminal is larger than the data amount of video data from other transmission-side information processing terminals. The video data distribution apparatus according to claim 2, wherein the data amount of each of the first and second video data is individually adjusted.   8. The video data distribution apparatus according to claim 1, wherein the video data transmitted and received between the plurality of information processing terminals is configured by an image frame according to the JPEG2000 standard. 9.   An interactive dialogue system including the video data distribution device according to any one of claims 1 to 8.

Images