JP2017153038A - Communication controller, communication control method and communication control program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To transmit a video of optimum quality to respective participants while a resource load of a server in a multi-point conference system is considered.SOLUTION: A communication controller for communicating media data with one or a plurality of terminals comprises: one or a plurality of encoding means for encoding media data with different encoding condition information in accordance with terminal capability information of respective terminals; communication state observing means for observing communication information with the respective terminals; load state observing means for observing load information of the communication controller; and encoding control means for dynamically controlling the encoding means connected to the respective terminals in response to the communication information with the respective terminals by the communication state observing means and the load information by the load state observing means.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a communication control device, a communication control method, and a communication control program. For example, a communication control device, a communication control method, and a communication control program that transmit media data in consideration of a server resource load in a multipoint conference system. Applicable.

  For example, in a multipoint conference system, a multipoint video conference server (MCU: Multipoint Control Unit) creates a virtual conference room on the server and transmits audio and video transmitted from a plurality of terminals participating in the conference room. Receive, select, combine, and transfer to each participant's terminal. This makes it possible to hold a video conference between multiple points.

  At this time, the media data (audio / video data) is encoded and transferred by some encoding method (codec) in order to compress the amount of data to be transferred. For video data in particular, depending on parameters such as codec, video size, bit rate, and frame rate, if the parameters are different, the video data is transmitted after being encoded (encoded) separately by an individual encoding device (encoder). There is a need to. These parameters depend on terminal capabilities such as receivable codec and video size, and network characteristics such as network bandwidth between the MCU and the terminal.

  In order to cope with various terminals and network characteristics, a typical MCU is equipped with a plurality of encoders and individually encodes each connected terminal. This method has the advantage that video of the best quality can be transmitted according to the capability and network characteristics of the terminal. However, since encoding processing that requires a large amount of calculation is performed for the number of connected terminals, many server resources are required. There is a drawback that the MCU becomes an expensive device.

  On the other hand, in the case of an MCU using a general-purpose PC server, there is a method in which only one encoder is used for each conference room and the same encoded video data is transmitted to all terminals. This method has an advantage that an inexpensive server can be used and a large number of participants can be connected because the encoding processing load is low. On the other hand, since there is only one encoder, it is necessary to match the minimum combination of parameters such as the minimum video size and the minimum bit rate among the connected terminals, and there is a disadvantage that a terminal with poor video quality appears. is there.

  As described above, there is a technique described in Patent Document 1 as a solution to the problem that it is difficult to improve the video quality for each terminal while suppressing the cost of the server.

  This classifies connected terminals into a plurality of groups according to terminal capabilities and network characteristics, and performs encoding in units of groups, thereby limiting the amount of server resources used and improving the video quality for each terminal as much as possible. It is a method to try. In particular, focusing on network bandwidth and packet loss rate, each terminal is classified into a group created in advance while observing the bandwidth and packet loss rate to each terminal.

JP 2010-141824 A

  The above-described conventional technique is not so problematic when only one meeting room is created on the server, but considering the simultaneous creation and use of a plurality of meeting rooms, grouping can be performed efficiently. There is a problem that can not be done.

  For example, for simplicity, the processing load of each encoder is the same, and in the case of a server that can operate 10 encoders at the same time, 10 groups may be created when there is only one conference room. However, when using 5 conference rooms at the same time, if 10 groups are created in each conference room, up to 50 encoders operate and become overloaded. It is necessary to limit to pieces. As described above, when the number of conference rooms increases, it is necessary to limit the number of groups that can be created in each conference room to a small number. As a result, there may be a problem that there are many terminals that have poor video quality. In addition, there are variations in network characteristics in certain conference rooms, and many encoders are desired. However, in other conference rooms, there is little variation and only one encoder can be used. The problem of getting worse can also arise.

  As described above, the conventional technology cannot flexibly group terminals considering a plurality of conference rooms, resulting in an increase in the number of terminals whose video quality deteriorates and the ineffective use of server resources. Can occur.

  Therefore, there is a need for a communication control device, a communication control method, and a communication control program that can transmit video of optimal quality to each participant while considering the resource load of the server in the multipoint conference system.

  In order to solve this problem, a communication control device according to a first aspect of the present invention is a communication control device that performs media data communication with one or more terminals. (1) According to terminal capability information of each terminal. One or a plurality of encoding means for encoding media data with different encoding condition information, (2) communication state observation means for observing communication information with each terminal, and (3) a communication control device Load state observing means for observing the load information, and (4) encoding means for connecting to each terminal based on the communication information between the terminals by the communication state observing means and the load information by the load state observing means. Coding control means for dynamically controlling.

  A communication control method according to a second aspect of the present invention is a communication control method in a communication control apparatus for communicating media data with one or a plurality of terminals. The communication control apparatus includes (1) terminal capability information of each terminal. Accordingly, one or a plurality of encoding steps for encoding media data with different encoding condition information, (2) a communication state observation step for observing communication information with each terminal, and (3) the communication A load state observing step for observing load information of the control device; and (4) encoding to be connected to each terminal based on communication information with each terminal in the communication state observing step and load information in the load state observing step. The means is dynamically controlled.

  The communication control program of the third aspect of the present invention is a communication control program for communicating media data with one or a plurality of terminals. (1) Different codes are used depending on terminal capability information of each terminal. One or a plurality of encoding means for encoding media data with the conversion condition information, (2) communication state observation means for observing communication information with each terminal, and (3) observing load information of the communication control device And (4) dynamically controlling the encoding means to be connected to each terminal based on the communication information between each terminal by the communication state observation means and the load information by the load state observation means. It functions as an encoding control means.

  ADVANTAGE OF THE INVENTION According to this invention, the image | video of optimal quality can be transmitted to each participant, considering the resource load of the server in a multipoint conference system.

It is an internal block diagram which shows the internal structure of the multipoint video conference apparatus (MCU) which concerns on embodiment. The conference room produced | generated in the multipoint video conference apparatus which concerns on embodiment, the encoder of each conference room, and the example of a connection between each encoder and each conference terminal are shown. It is a terminal capability-transmission rate relationship table which shows the correspondence of the terminal capability information which concerns on embodiment, and a required network transmission rate. It is a terminal capability-server load relationship table which shows the relationship between the terminal capability information which concerns on embodiment, and server load. It is a flowchart which shows the grouping process of the conference terminal in the multipoint video conference apparatus based on Embodiment. In an embodiment, it is a figure showing a connection state of a conference terminal at the time of conference establishment. In embodiment, it is explanatory drawing explaining the grouping process according to the network characteristic and server load after meeting holding (the 1). In embodiment, it is explanatory drawing explaining the grouping process according to the network characteristic and server load after meeting holding (the 2). In embodiment, it is explanatory drawing explaining the grouping process according to the network characteristic and server load after meeting holding (the 3). In embodiment, it is explanatory drawing explaining the grouping process according to the network characteristic and server load after meeting holding (the 4).

(A) Main Embodiments Hereinafter, embodiments of a communication control device, a communication control method, and a communication control program according to the present invention will be described in detail with reference to the drawings.

  This embodiment exemplifies a case where the present invention is applied to a multipoint video conference apparatus of a multipoint video conference system.

(A-1) Configuration of Embodiment FIG. 1 is an internal configuration diagram illustrating an internal configuration of a multipoint video conference apparatus (MCU) according to the embodiment.

  In FIG. 1, a multipoint video conference apparatus (MCU) 100 according to the embodiment includes a video processing unit 110. In addition, the video processing unit 110 includes a network characteristic observation unit 111, a server load observation unit 112, and an encoder control unit 113.

  Although the hardware configuration of the multipoint video conference apparatus 100 is not shown, it has a CPU, a ROM, a RAM, an EEPROM, an input / output interface, and the like as in the existing server. The CPU implements the functions of the multipoint video conference apparatus 100 by executing a processing program (for example, an encoder control program) stored in a storage device such as a ROM. Each function may be constructed by installing the processing program.

  The multipoint video conference apparatus 100 opens one or more virtual conference rooms and synthesizes media data including video and audio with a plurality of conference terminals connected to participate in each conference room. Select to transfer media data related to video conferencing.

  The multipoint video conference apparatus 100 newly adds a connection with a conference terminal that participates in each conference room from the middle, or cancels a connection with a conference terminal that leaves the conference room.

  The multipoint video conferencing apparatus 100 synthesizes media data including audio / video data. However, only the video processing unit 110 that particularly performs processing related to video data is shown here.

  The video processing unit 110 generates a data reception unit 31, a decoder 32, a screen synthesis unit 33, an encoder 34, and a data transmission unit 35 according to the terminal capability information of the conference terminal 1 for each conference room that is opened. Performs video data composition and transfer processing with the terminal.

  The data receiving unit 31 and the data transmitting unit 35 receive and transmit video data with each conference terminal participating in the conference room via the network. The data reception unit 31 and the data transmission unit 35 are generated by the number corresponding to the number of conference terminals participating in the conference room.

  The decoder 32 decodes the received video data received by the corresponding data receiving unit 31 and supplies it to the screen synthesis unit 33. The encoder 34 encodes the video data selected and synthesized by the screen synthesis unit 33 and supplies the encoded video data to the corresponding data transmission unit 35.

  Here, the encoding method performed by the encoder 34 and the decoder 32 is assumed to match the encoding method requested by each conference terminal. For example, when a conference room is opened, the video processing unit 110 acquires performance information including an encoding method from each conference terminal, and the video processing unit 110 performs encoding / decoding according to the encoding method requested by each conference terminal. Are generated.

  The screen synthesis unit 33 acquires video data from each of the plurality of decoders 32, selects video data necessary for the conference screen configuration from the plurality of video data, synthesizes the video data according to the conference screen configuration, To the corresponding encoder 34.

  The network characteristic observation unit 111 observes the network and acquires network characteristics such as a network communication band and a packet loss rate with each conference terminal. The network characteristic observation unit 111 notifies the encoder control unit 113 of the acquired network characteristic.

  Here, the network characteristic observation unit 111 checks the occurrence of packet loss, the presence / absence of a retransmission request, and the like for each conference terminal. For each conference terminal, based on the retransmission request from each conference terminal and the comparison result between the packet loss rate and the threshold value, the network characteristic observation unit 111 determines the network characteristics of each conference terminal.

  The server load observation unit 112 observes a server load such as a CPU load of the multipoint video conference apparatus 100 as a server and notifies the encoder control unit 113 of the server load.

  The encoder control unit 113 controls the operation of the encoder 34 generated in each conference room based on the network characteristic information from the network characteristic observation unit 111 and the server load information of the server load observation unit 112.

  The encoder control unit 113 creates and deletes each encoder 34 based on terminal capability information, network characteristic information, and server load information from each conference terminal, and sends data to the data transmission unit 35 between each encoder 34 and each conference terminal. Make an association.

  When performing the encoding process in each conference room, the encoder control unit 113 increases or decreases the number of the encoders 34 in the conference room based on the capability of the conference terminal, the network characteristics, and the load on the server, and which encoder and which conference terminal Grouping of each conference terminal related to whether or not to connect.

  FIG. 2 shows a conference room generated in the multipoint video conference apparatus 100 according to the embodiment, encoders of the conference rooms, and connection examples between the encoders and the conference terminals.

  Hereinafter, for example, numbers such as “1” of “conference room 1”, “encoder 1”, and “conference terminal 1” will be described as numbers for identifying the conference room, encoder, and conference terminal.

  In FIG. 2, the multipoint video conference apparatus 100 is assumed to have opened, for example, five virtual conference rooms 1 to 5.

  In the “conference room 1”, it is assumed that five conference terminals 1 to 5 participate in the conference, and the encoder 1 is connected to the five conference terminals 1 to 5.

  Thereafter, each of “conference terminal 6” to “conference terminal 10” is assumed to newly participate in “conference room 1”. At this time, “encoder 2” is generated with the participation of “conference terminal 6”, and encoder 2 is connected to conference terminal 6. Similarly, each of the conference terminal 7 to the conference terminal 10 newly joining the conference room 1 is connected to each of the encoder 3 to the encoder 6.

  In the “conference room 2”, it is assumed that three conference terminals 11 to 13 participate in the conference, and the encoder 7 is connected to the three conference terminals 11 to 13. Similarly, the “conference room 3”, the “conference room 4”, and the “conference room 5” are similarly connected to the encoder 8, the encoder 9, and the encoder 10 respectively at the conference terminal 14 to the conference terminal 16 and the conference terminal 17 to the conference. It is assumed that the terminal 19 and the conference terminal 20 to the conference terminal 22 are connected.

  First, the encoder control unit 113 (FIG. 1) acquires terminal capability information including information on the encoding method from the conference terminal that requests participation in each conference room when the conference room is opened, and the terminal capability of each conference terminal. The required network transmission rate is determined according to the information.

  Here, the terminal capability information is information relating to the capability of the conference terminal to execute the video conference, and is information including, for example, the encoding method, the number of pixels, the frame rate, and the like required by the conference terminal.

  Also, the amount of video data encoded varies depending on the terminal capabilities of the conference terminal. Furthermore, the network transmission speed required by the conference terminal differs depending on the difference in the amount of video data encoded. Therefore, in this embodiment, the encoder control unit 113 refers to the table illustrated in FIG. 3 and obtains a necessary network transmission rate corresponding to the terminal capability information desired to be acquired from each conference terminal.

  FIG. 3 is a terminal capability-transmission rate relationship table showing a correspondence relationship between terminal capability information and a required network transmission rate according to the embodiment.

  Here, the terminal capability-transmission rate relationship table illustrated in FIG. 3 will be described.

  In FIG. 3, with reference to the encoding amount when the terminal capability information is “encoding method: H.264”, “number of pixels: 1920 × 1080”, “frame rate: 30 fps (frame / second)”, The relationship between the amount of coding and the required network transmission rate according to each terminal capability information was created.

  That is, when the terminal capability information is “encoding method: H.264”, “number of pixels: 1920 × 1080”, and “frame rate: 30 fps (frame / second)”, the encoding amount A by the encoding method is set to “ The standard is a case where “1 time”, the number of pixels B is “1 time”, the frame rate C is “1 time”, and the total coding amount D (= A × B × C) is “1 time” (see FIG. 3 “conference terminal” is referred to in the lowermost section in the “conference terminal 1-conference terminal 22” column).

  When this standard is used as a base, for example, when “encoding method: H.264”, “number of pixels: 1920 × 1080”, and “frame rate: 60 fps”, if the above is used as a reference, encoding by the encoding method is performed. Since the amount A is considered to be “1 time”, the number of pixels B is “1 time”, and the frame rate C is considered to be “2 times”, the total coding amount D (relative value) can be considered to be “2 times” ( The “conference terminal” in FIG. 3 is the second description from the bottom in the “conference terminal 1-conference terminal 22” column).

  Similarly, for example, in the case of “encoding method: H.265”, “number of pixels: 1920 × 1080”, and “frame rate: 30 fps”, the encoding amount A by the encoding method is set to “0” based on the above. .5x ", the number of pixels B is" 1x ", and the frame rate C is" 1x ", so the total coding amount D (= A x B x C) is considered to be" 0.5 times " ("Conference terminal" in FIG. 3 is referred to as the third description from the bottom in the "Conference terminal 1-Conference terminal 22" column).

  Similarly, in the case of other terminal capability information, the total encoding amount D (= A ×) in the case of “encoding method: H.265”, “number of pixels: 1920 × 1080”, and “frame rate: 60 fps”. (B × C) is “1 ×” (see “Conference terminal” in FIG. 3 is the third description from the top in the “Conference terminal 1-Conference terminal 22” column), and “Encoding method: H.265” ”,“ Number of pixels: 3840 × 2160 ”, and“ frame rate: 30 fps ”, the total encoding amount D (= A × B × C) is“ double ”(“ conference terminal ”in FIG. (Refer to the second description from the top in the “Conference terminal 1 -Conference terminal 22” column), “Encoding method: H.265”, “Number of pixels: 3840 × 2160”, “Frame rate: 60 fps” The total encoding amount D (= A × B × C) is “4 times” (“conference terminal” in FIG. 3). Referring to the top of the description in "conference terminal 1 conference terminal 22" column).

  As described above, the degree (relative degree) of the required network transmission rate of the conference terminal is defined based on the total coding amount according to the terminal capability information.

  In FIG. 3, the network transmission speed required for the conference terminal is divided into a plurality of values according to the value of the total coding amount D of the coding method. More specifically, the transmission rate is set to four levels “lowest speed (level 1)”, “low speed (level 2)”, “high speed (level 3)”, “highest” according to the value of the total coding amount D. “High-speed (level 4)”.

  That is, the network transmission speed required for each conference terminal corresponding to the capabilities of each terminal shown in FIG. 3 is as follows (here, the required network transmission speed is shown in FIG. (See the description in the "Required network transmission speed" column).

  Necessary when the total encoding amount D is “1 ×” and the terminal capability information is “encoding method: H.264”, “number of pixels: 1920 × 1080”, “frame rate: 30 fps”. The transmission speed of the network is “low speed (2)”.

  Similarly, when the total encoding amount D is “double” and the terminal capability information is “encoding method: H.264”, “number of pixels: 1920 × 1080”, “frame rate: 60 fps” The required network transmission rate is “high speed (3)”.

  Necessary when the total encoding amount D is “0.5 times” and the terminal capability information is “encoding method: H.265”, “number of pixels: 1920 × 1080”, “frame rate: 30 fps” The transmission speed of the network becomes “minimum speed (1)”.

  Necessary when the total encoding amount D is “1 ×” and the terminal capability information is “encoding method: H.265”, “number of pixels: 1920 × 1080”, and “frame rate: 60 fps”. The transmission speed of the network is “low speed (2)”.

  Necessary when the total coding amount D is “double” and the terminal capability information is “encoding method: H.265”, “number of pixels: 3840 × 2160”, “frame rate: 30 fps” The transmission speed of the network is “high speed (3)”.

  Necessary when the total encoding amount D is “4 times” and the terminal capability information is “encoding method: H.265”, “number of pixels: 3840 × 2160”, “frame rate: 60 fps”. The transmission speed of the network is “highest speed (4)”.

  Next, with reference to FIG. 4, the encoder control unit 113 obtains a server load ratio according to the terminal capability information of the conference terminal.

  FIG. 4 is a terminal capability-server load relationship table showing a relationship between the terminal capability information and the server load according to the embodiment.

  Here, the terminal capability-server load relationship table illustrated in FIG. 4 will be described.

  In FIG. 4 as well, each terminal capability information is “encoding method: H.264”, “number of pixels: 1920 × 1080”, and “frame rate: 30 fps (frame / second)”. A server load factor relationship according to terminal capability information was created.

  That is, when the terminal capability information is “encoding method: H.264”, “number of pixels: 1920 × 1080”, and “frame rate: 30 fps”, the server load ratio E by the encoding method is set to “1”. Based on the case where the server load ratio F (= D × E) is “1” (see “Conference terminal” in FIG. 4 in the “Conference terminal 1−Conference terminal 22” column). .

  When this standard is used as a base, for example, when “encoding method: H.264”, “number of pixels: 1920 × 1080”, and “frame rate: 60 fps”, if the above is used as a reference, the total number of encoding methods Since the encoding amount D is “2 times” and the server load ratio E by the encoding method is considered to be “1 time”, the server load ratio F (relative value) is “2 times” (FIG. 4 "conference terminal" is referred to the second description from the bottom in the "conference terminal 1-conference terminal 22" column).

  Similarly, for example, in the case of “encoding method: H.265”, “number of pixels: 1920 × 1080”, and “frame rate: 30 fps”, based on the above, the total encoding amount D by the encoding method is Since the server load ratio E by the encoding method is considered to be “4 times”, the server load ratio F is “2 times” (the “conference terminal” in FIG. (Refer to the third description from the bottom in the “conference terminal 1-conference terminal 22” column).

  Similarly, in the case of other terminal capability information, the server load ratio F in the case of “encoding method: H.265”, “number of pixels: 1920 × 1080”, and “frame rate: 60 fps” is “4 times”. (Refer to the third description from the top in the “Conference terminal 1-Conference terminal 22” column for “Conference terminal” in FIG. 4), “Encoding method: H.265”, “Number of pixels: 3840 × 2160” ”And“ frame rate: 30 fps ”, the server load ratio F is“ 8 times ”(“ conference terminal ”in FIG. 4 is the second entry from the top in the“ conference terminal 1-conference terminal 22 ”column). The server load ratio F in the case of “encoding method: H.265”, “number of pixels: 3840 × 2160”, and “frame rate: 60 fps” is “16 times” (see “Conference” in FIG. 4). "Terminal" in the "Conference terminal 1-Conference terminal 22" column Referring to the top of the described).

(A-2) Operation | movement of embodiment Below, the operation | movement of the encoder control process in the multipoint video conference apparatus 100 which concerns on embodiment is demonstrated in detail, referring drawings.

  FIG. 5 is a flowchart showing conference terminal grouping processing in the multipoint video conference apparatus 100 according to the embodiment.

  FIG. 6 is a diagram illustrating a connection state of the conference terminal when the conference is opened in the embodiment. 7 to 10 are explanatory diagrams for explaining grouping processing according to network characteristics and server load after the conference is held.

  6 to 10 will be briefly described. 6 to 10, “Group of conference room” indicates a group of conference room 1 to conference room 5. “Conference terminal” indicates a conference terminal that participates (connects) to each of the conference rooms 1 to 5.

  “Terminal capability (highest capability)” is terminal capability information (spec information) acquired from the conference terminal when the conference terminal is connected to the multipoint video conference apparatus 100. Here, “encoding method”, “number of pixels”, and “frame speed” are included.

  The “network characteristic variation” is an observation result of the network characteristic of each conference terminal acquired by the network characteristic observation unit 111. That is, the network bandwidth with the conference terminal, the packet loss rate, the retransmission request, and the like are observed. For example, the description “high speed OK” corresponds to a level such as “high speed” among the four levels “highest speed”, “high speed”, “low speed”, and “lowest speed” illustrated in FIG. (For example, “high-speed OK” corresponds to the levels of “high speed”, “low speed”, and “lowest speed” between the multipoint video conference apparatus 100 and the conference terminal. It means that communication is possible at a transmission speed, and “high-speed OK” means that communication cannot be performed between the multipoint video conference apparatus 100 and the conference terminal at a transmission speed corresponding to the “highest speed” level. Means state.)

  “Determined terminal capability” indicates terminal capability information provided to the conference terminal by the encoder connected to the conference terminal. That is, specification information provided to the conference terminal by the encoder group.

  The “transmission speed of the selected network” is the transmission speed of the network between the multipoint video conference apparatus 100 (encoder) to which the conference terminal is connected and the conference terminal. For example, the description of “high speed” is a transmission rate corresponding to a level such as “high speed” among the four levels “highest speed”, “high speed”, “low speed”, and “lowest speed” illustrated in FIG. It shows that there is.

  As shown in FIG. 6, the conference terminal 1 to the conference terminal 5 participate in the “conference room 1” when the conference of the “conference room 1” is held.

  As described above, the encoder control unit 113 acquires terminal capability information from each of the conference terminal 1 to the conference terminal 5 when the conference terminal is connected.

  Here, terminal capability information (“terminal capability (highest capability)”) of conference terminal 1 to conference terminal 5 is “encoding method: H.265”, “number of pixels: 3840 × 2160”, “frame rate”. : 60 fps ".

  Therefore, referring to FIG. 3, encoder control unit 113 determines that “necessary network transmission speed; highest speed” based on the terminal capabilities of conference terminal 1 to conference terminal 5.

  However, the network characteristic observation unit 111 determines that the network characteristics of the conference terminals 1 to 5 are at the “high speed” level.

  Here, the terminal capabilities of the conference terminal 1 to the conference terminal 5 can support the network transmission speed “highest speed” level. This means that it is possible to cope with cases of “high speed”, “low speed”, and “lowest speed” which are lower than the “highest speed” level.

  Then, the network characteristics of the conference terminal 1 to the conference terminal 5 by the network characteristic observation unit 111 are at the “high speed” level, but the transmission speed of the conference terminal 1 to the conference terminal 5 can correspond to the “highest speed” level.

  Therefore, the encoder control unit 113 converts the conference terminal 1 to the conference terminal 5 into “encoding method: H.265”, “number of pixels: 3840 × 2160”, “frame rate: 30 fps”, “selected network transmission rate”. : Connect to the “encoder 1” executed at “high speed” (that is, the conference terminal 1 to the conference terminal 5 have the “encoding method”, “number of pixels”, and “frame speed” at which the network characteristics are at the “high speed” level. Connect to the encoder).

  The conference terminals “conference room 2” to “conference room 5” are also connected to “encoder 7” to “encoder 10” in the same manner as described above.

  Then, the case where the conference terminals 6 to 10 newly participate in the “conference room 1” will be described.

  In FIG. 5, the encoder control unit 113 adds “conference terminals 6 to 10” to “conference room 1”, and in the case of network characteristics OK and server load OK (S101), the encoder control unit 113 displays “conference room 1”. In “conference terminals 6 to 10” added in “”, the conference terminals 6 to 10 are allocated to the encoders 2 to 6 as shown in FIG. 7 (S102).

  Here, “network characteristic OK” indicates that the current network transmission rate is less than or equal to the required network transmission rate based on the terminal capability of the conference terminal in FIG. That is, when the transmission speed according to the specifications of the conference terminal is at the “highest speed” level, if it is equal to or lower than the “highest speed” level, it is determined as “network OK”. Otherwise, it is “network characteristic NG”.

  “Server load OK” indicates that the sum of the current server load factor and the server load factor based on the terminal capability of the conference terminal in FIG. 4 is lower than a predetermined threshold.

  In FIG. 7, the terminal capabilities of the conference terminal 6 are “encoding method: H.265”, “number of pixels: 3840 × 2160”, and “frame rate: 60 fps”. With reference to FIG. 3, the encoder control unit 113 determines that the transmission speed of the conference terminal 6 can cope with the “highest speed” level. The network characteristic of the conference terminal 6 by the network characteristic observation unit 111 is “the highest speed”. “OK” level. Moreover, since the server load factor by the server load observation unit 112 is lower than the threshold value, the number of encoders can be increased.

  Here, the server load factor by the server load monitoring unit 112 is, for example, “the current server load factor” and “the server load factor converted from“ the ratio F of the server load corresponding to the terminal capability of the conference terminal ”” Is added. In the case of the conference terminal 6, the “ratio F of the server load corresponding to the terminal capability of the conference terminal” is “16 times the top of the“ conference terminal 1 -conference terminal 22 ”column of“ conference terminal ”in FIG. It is.

  Therefore, “encoder 2” to be executed at “encoding method: H.265”, “number of pixels: 3840 × 2160”, “frame rate: 60 fps”, “selected network transmission rate: highest speed” is generated, The conference terminal 6 is connected to the “encoder 2”.

  The terminal capabilities of the conference terminal 7 are “encoding method: H.265”, “number of pixels: 3840 × 2160”, and “frame rate: 60 fps”. When it is determined that the transmission speed of the conference terminal 7 can cope with the “highest speed” level with reference to FIG. 3, the network characteristic of the conference terminal 7 by the network characteristic observation unit 111 is the “low speed OK” level. However, the conference terminal 7 can respond. Moreover, since the server load factor by the server load observation unit 112 is lower than the threshold value, the number of encoders can be increased. Therefore, “Encoder 3” to be executed at “Encoding method: H.265”, “Number of pixels: 1920 × 1080”, “Frame rate: 60 fps”, and “Selected network transmission rate: Low” is generated, and the conference is performed. The terminal 7 is connected to the “encoder 3”.

  The terminal capabilities of the conference terminal 8 are “encoding method: H.265”, “number of pixels: 3840 × 2160”, and “frame rate: 60 fps”. When it is determined that the transmission speed of the conference terminal 8 can cope with the “highest speed” level with reference to FIG. 3, the network characteristic of the conference terminal 8 by the network characteristic observation unit 111 is the “lowest speed OK” level. Although it is lower than the “high speed” level, the conference terminal 7 can respond. Moreover, since the server load factor by the server load observation unit 112 is lower than the threshold value, the number of encoders can be increased. Therefore, “encoder 4” to be executed at “encoding method: H.265”, “number of pixels: 1920 × 1080”, “frame rate: 30 fps”, “selected network transmission rate: lowest speed” is generated, The conference terminal 8 is connected to the “encoder 4”.

  The terminal capabilities of the conference terminal 9 are “encoding method: H.264”, “number of pixels: 1920 × 1080”, and “frame rate: 60 fps”. When it is determined that the transmission speed of the conference terminal 8 can cope with the “high speed” level with reference to FIG. 3, the network characteristic of the conference terminal 9 by the network characteristic observation unit 111 is at the “high speed OK” level. Yes. Moreover, since the server load factor by the server load observation unit 112 is lower than the threshold value, the number of encoders can be increased. Therefore, “Encoder 5” is generated to be executed at “Encoding method: H.264”, “Number of pixels: 1920 × 1080”, “Frame rate: 60 fps”, and “Selected network transmission rate: High speed”. The terminal 9 is connected to the “encoder 5”.

  The terminal capabilities of the conference terminal 10 are “encoding method: H.264”, “number of pixels: 1920 × 1080”, and “frame rate: 30 fps”. When it is determined with reference to FIG. 3 that the transmission speed of the conference terminal 10 can cope with the “low speed” level, the network characteristic of the conference terminal 10 by the network characteristic observation unit 111 is the “high speed OK” level. Moreover, since the server load factor by the server load observation unit 112 is lower than the threshold value, the number of encoders can be increased. Therefore, an “encoder 6” that executes at “encoding method: H.264”, “number of pixels: 1920 × 1080”, “frame rate: 30 fps”, and “selected network transmission rate: low speed” is generated, and the conference is performed. The terminal 10 is connected to the “encoder 6”.

  In FIG. 5, the encoder control unit 113 adds “conference terminals 6 to 10” to “conference room 1”. In the case of network characteristics NG and server load OK (S103), the encoder control unit 113 displays “conference room 1”. In “conference terminals 6 to 10” added in “”, the conference terminals 6 to 8 are assigned to the encoder 4 and the conference terminals 9 to 10 are assigned to the encoder 6 as shown in FIG. 8 (S104).

  8, the terminal capabilities of the conference terminal 6 are “encoding method: H.265”, “number of pixels: 3840 × 2160”, and “frame rate: 60 fps”. When the encoder control unit 113 determines that the transmission speed of the conference terminal 6 can handle the “highest speed” level with reference to FIG. 3, the network characteristic of the conference terminal 6 by the network characteristic observation unit 111 is “high-speed OK”. "Is the level. Moreover, since the server load factor by the server load observation unit 112 is lower than the threshold value, the number of encoders can be increased.

  However, since the network characteristic is NG in S103, the encoder control unit 113 uses the network characteristic observation unit 111 to determine the transmission rate of the network that can be added. Here, as an example, it is assumed that the transmission rate of the network that can be added is one line of communication at the “low speed” level and one line of communication at the “lowest speed” level.

  Therefore, the encoder control unit 113 executes “encoder” executed at “encoding method: H.265”, “number of pixels: 1920 × 1080”, “frame rate: 30 fps”, and “selected network transmission rate: lowest speed”. 4 ”is connected to the conference terminal 6.

  That is, the encoder control unit 113 uses the same encoding method for one line of communication at the “lowest speed” level at the network transmission speed that can be added, and the network transmission speed becomes the “lowest speed”. The encoder 4 is connected to the conference terminal 6.

  Here, the encoder 4 is generated in the state illustrated in FIG. In the grouping process, groups are sequentially reconfigured according to changes in network characteristics and server load. Therefore, according to the flowchart of FIG. 5, the encoder control unit 113 sequentially switches the encoders to be connected based on the network characteristics and server load of each conference terminal, and performs grouping reconfiguration. The same applies hereinafter.

  The terminal capabilities of the conference terminal 7 are “encoding method: H.265”, “number of pixels: 3840 × 2160”, and “frame rate: 60 fps”. When it is determined that the transmission speed of the conference terminal 7 can cope with the “highest speed” level with reference to FIG. 3, the network characteristic of the conference terminal 7 by the network characteristic observation unit 111 is at the “low speed OK” level. Moreover, since the server load factor by the server load observation unit 112 is lower than the threshold value, the number of encoders can be increased. Therefore, the conference terminal 7 is assigned to the “encoder 4” executed at “encoding method: H.265”, “number of pixels: 1920 × 1080”, “frame rate: 30 fps”, and “selected network transmission rate: lowest speed”. Connect.

  In other words, the encoder control unit 113 has the same encoding method in accordance with one line of “minimum speed” communication at the network transmission speed that can be added, and the network transmission speed becomes “lowest speed”. The encoder 4 is connected to the conference terminal 7.

  The terminal capabilities of the conference terminal 8 are “encoding method: H.265”, “number of pixels: 3840 × 2160”, and “frame rate: 60 fps”. When it is determined that the transmission speed of the conference terminal 8 can cope with the “highest speed” level with reference to FIG. 3, the network characteristic of the conference terminal 8 by the network characteristic observation unit 111 is the “lowest speed OK” level. Moreover, since the server load factor by the server load observation unit 112 is lower than the threshold value, the number of encoders can be increased. Therefore, the “encoder 4” executed at “encoding method: H.265”, “number of pixels: 1920 × 1080”, “frame rate: 30 fps”, “selected network transmission rate: lowest speed” is connected to the conference terminal. 8 is connected.

  In other words, the encoder control unit 113 has the same encoding method in accordance with one line of “minimum speed” communication at the network transmission speed that can be added, and the network transmission speed becomes “lowest speed”. The encoder 4 is connected to the conference terminal 8.

  The terminal capabilities of the conference terminal 9 are “encoding method: H.264”, “number of pixels: 1920 × 1080”, and “frame rate: 60 fps”. When it is determined that the transmission speed of the conference terminal 9 can cope with the “high speed” level with reference to FIG. 3, the network characteristic of the conference terminal 9 by the network characteristic observation unit 111 is the “high speed OK” level. Moreover, since the server load factor by the server load observation unit 112 is lower than the threshold value, the number of encoders can be increased. Therefore, the “encoder 6” executed at “encoding method: H.264”, “number of pixels: 1920 × 1080”, “frame rate: 30 fps”, and “selected network transmission rate: low speed” is connected to the conference terminal 9. Connect.

  In other words, the encoder control unit 113 has the same encoding method in accordance with one line of “low speed” level communication at the network transmission speed that can be added, and the encoder 6 has the network transmission speed “low speed”. To the conference terminal 9.

  The terminal capabilities of the conference terminal 10 are “encoding method: H.264”, “number of pixels: 1920 × 1080”, and “frame rate: 30 fps”. When it is determined with reference to FIG. 3 that the transmission speed of the conference terminal 10 can cope with the “low speed” level, the network characteristic of the conference terminal 10 by the network characteristic observation unit 111 is the “high speed OK” level. Moreover, since the server load factor by the server load observation unit 112 is lower than the threshold value, the number of encoders can be increased. Therefore, the “encoder 6” executed at “encoding method: H.264”, “number of pixels: 1920 × 1080”, “frame rate: 30 fps”, and “selected network transmission rate: low speed” is transferred to the conference terminal 10. Connect.

  In other words, the encoder control unit 113 has the same encoding method in accordance with one line of “low speed” level communication at the network transmission speed that can be added, and the encoder 6 has the network transmission speed “low speed”. To the conference terminal 10.

  In FIG. 5, the encoder control unit 113 adds “conference terminals 6 to 10” to “conference room 1”, and in the case of network characteristics OK and server load NG (S105), the encoder control unit 113 displays “conference room 1”. 9, the conference terminals 6 to 7 and 9 to 10 are assigned to the encoder 6 and the conference terminal 8 is assigned to the encoder 4 as shown in FIG. 9 (S106).

  In FIG. 9, the terminal capabilities of the conference terminal 6 are “encoding method: H.265”, “number of pixels: 3840 × 2160”, and “frame rate: 60 fps”. With reference to FIG. 3, the encoder control unit 113 determines that the transmission speed of the conference terminal 6 can cope with the “highest speed” level. The network characteristic of the conference terminal 6 by the network characteristic observation unit 111 is “highest speed OK”. "Is the level. Moreover, since the server load factor by the server load observation unit 112 exceeds the threshold value, the number of encoders cannot be increased.

  In S105, since the server load is NG, the encoder control unit 113 uses the server load observation unit 112 to add the “server load ratio F corresponding to the server load factor” and the “server load of the server load”. Judgment is made regarding the “capability of the terminal corresponding to the ratio F” (“encoding method”, “number of pixels”, “frame rate”).

  Here, as an example, it is assumed that the “server load ratio F corresponding to the server load factor” that can be added is “three times”. Further, the “capability of the terminal corresponding to the server load ratio F” that can be added is “the encoding method: H.264, where the server load ratio F is“ 1 ”” in consideration of the encoding method and network characteristics. ”,“ Number of pixels: 1920 × 1080 ”,“ Frame rate: 30 fps ”, and“ Encoding method: H.265 ”in which the server load ratio F is“ 2 times ”,“ Number of pixels: 1920 ” It is assumed that the encoder has “× 1080” and “frame rate: 30 fps”.

  Therefore, the encoder control unit 113 executes “encoder 6” executed at “encoding method: H.265”, “number of pixels: 1920 × 1080”, “frame rate: 30 fps”, and “selected network transmission rate: low speed”. To the conference terminal 6.

  That is, the encoder control unit 113 considers the encoding method and the network characteristics, and the “encoding method: H.264” in which “the server load ratio F corresponding to the server load factor” that can be added corresponds to “1 time”. ”,“ Number of pixels: 1920 × 1080 ”, and“ Frame rate: 30 fps ”are connected to the conference terminal 6.

  The terminal capabilities of the conference terminal 7 are “encoding method: H.265”, “number of pixels: 3840 × 2160”, and “frame rate: 60 fps”. When it is determined that the transmission speed of the conference terminal 7 can cope with the “highest speed” level with reference to FIG. 3, the network characteristic of the conference terminal 7 by the network characteristic observation unit 111 is at the “low speed OK” level. Further, the server load factor by the server load observation unit 112 exceeds the threshold value, and the number of encoders cannot be increased. Therefore, the conference terminal 7 is connected to the “encoder 6” executed at “encoding method: H.265”, “number of pixels: 1920 × 1080”, “frame rate: 30 fps”, and “selected network transmission rate: low speed”. Connect.

  That is, the encoder control unit 113 considers the encoding method and the network characteristics, and the “encoding method: H.264” in which “the server load ratio F corresponding to the server load factor” that can be added corresponds to “1 time”. ”,“ Number of pixels: 1920 × 1080 ”, and“ Frame rate: 30 fps ”are connected to the conference terminal 7.

  The terminal capabilities of the conference terminal 8 are “encoding method: H.265”, “number of pixels: 3840 × 2160”, and “frame rate: 60 fps”. When it is determined that the transmission speed of the conference terminal 8 can cope with the “highest speed” level with reference to FIG. 3, the network characteristic of the conference terminal 8 by the network characteristic observation unit 111 is the “lowest speed OK” level. Further, the server load factor by the server load observation unit 112 exceeds the threshold value, and the number of encoders cannot be increased. Therefore, the “encoder 4” executed at “encoding method: H.265”, “number of pixels: 1920 × 1080”, “frame rate: 30 fps”, “selected network transmission rate: lowest speed” is connected to the conference terminal. 8 is connected.

  That is, the encoder control unit 113 considers the encoding method and the network characteristics, and the “encoding method: H.265” in which the “server load ratio F corresponding to the server load factor” that can be added corresponds to “double”. ”,“ Number of pixels: 1920 × 1080 ”, and“ Frame rate: 30 fps ”are connected to the conference terminal 6.

  The terminal capabilities of the conference terminal 9 are “encoding method: H.264”, “number of pixels: 1920 × 1080”, and “frame rate: 60 fps”. When it is determined that the transmission speed of the conference terminal 9 can cope with the “high speed” level with reference to FIG. 3, the network characteristic of the conference terminal 9 by the network characteristic observation unit 111 is the “high speed OK” level. Further, the server load factor by the server load observation unit 112 exceeds the threshold value, and the number of encoders cannot be increased. Therefore, the “encoder 6” executed at “encoding method: H.264”, “number of pixels: 1920 × 1080”, “frame rate: 30 fps”, and “selected network transmission rate: low speed” is connected to the conference terminal 9. Connect.

  That is, the encoder control unit 113 considers the encoding method and the network characteristics, and the “encoding method: H.264” in which “the server load ratio F corresponding to the server load factor” that can be added corresponds to “1 time”. ”,“ Number of pixels: 1920 × 1080 ”, and“ Frame rate: 30 fps ”are connected to the conference terminal 9.

  The terminal capabilities of the conference terminal 10 are “encoding method: H.264”, “number of pixels: 1920 × 1080”, and “frame rate: 30 fps”. When it is determined with reference to FIG. 3 that the transmission speed of the conference terminal 10 can cope with the “low speed” level, the network characteristic of the conference terminal 10 by the network characteristic observation unit 111 is the “high speed OK” level. Further, the server load factor by the server load observation unit 112 exceeds the threshold value, and the number of encoders cannot be increased. Therefore, the “encoder 6” executed at “encoding method: H.264”, “number of pixels: 1920 × 1080”, “frame rate: 30 fps”, and “selected network transmission rate: low speed” is transferred to the conference terminal 10. Connect.

  That is, the encoder control unit 113 considers the encoding method and the network characteristics, and the “encoding method: H.264” in which “the server load ratio F corresponding to the server load factor” that can be added corresponds to “1 time”. ”,“ Number of pixels: 1920 × 1080 ”, and“ Frame rate: 30 fps ”are connected to the conference terminal 10.

  In FIG. 5, the encoder control unit 113 adds “conference terminals 6 to 10” to “conference room 1”, and in the case of network characteristics NG and server load NG (S107), the encoder control unit 113 displays “conference room 1”. In “conference terminals 6 to 10” added in “”, the conference terminals 1 to 7 and 9 to 10 are assigned to the encoder 6 and the conference terminal 8 is assigned to the encoder 4 as shown in FIG. 10 (S108).

  10, the terminal capabilities of the conference terminals 1 to 5 are “encoding method: H.265”, “number of pixels: 3840 × 2160”, and “frame rate: 60 fps”. With reference to FIG. 3, the encoder control unit 113 determines that the transmission speed of the conference terminals 1 to 5 can cope with the “highest speed” level. The network characteristic of the conference terminal 6 by the network characteristic observation unit 111 is “ “High-speed OK” level. Moreover, since the server load factor by the server load observation unit 112 exceeds the threshold value, the number of encoders cannot be increased.

  In S107, because of the network characteristics NG and the server load NG, the encoder control unit 113 uses the network characteristic observation unit 111 to determine the transmission rate of the network that can be added. Here, as an example, if one line of “high speed” level communication is deleted, the network transmission speed that can be added is one line of “low speed” level communication and one line of “lowest speed” level communication. Suppose that it is minutes.

  Furthermore, the encoder control unit 113 uses the server load observation unit 112 to add “a server load ratio F corresponding to the server load rate” and “add a terminal capability corresponding to the server load ratio F” ( "Encoding method", "Number of pixels", "Frame rate").

  Here, as an example, when the server load ratio F corresponding to the server load factor is “8 times”, the “server load ratio F corresponding to the server load factor” that can be added is “3 It is assumed that it is “double”.

  In addition, the “capability of the terminal corresponding to the server load ratio F” to be deleted is “encoding method: H.264” in which the server load ratio F is “8 times” in consideration of the encoding method and network characteristics. It is assumed that the encoder has “265”, “number of pixels: 3840 × 1080”, and “frame speed: 30 fps”.

  Furthermore, the “capability of the terminal corresponding to the server load ratio F” can be added to the “encoding method: H.264” in which the server load ratio F corresponds to “1 time” in consideration of the encoding method and network characteristics. H.264 ”,“ number of pixels: 1920 × 1080 ”,“ frame rate: 30 fps ”, and“ encoding method: H.265 ”in which the server load ratio F is“ double ”,“ number of pixels: It is assumed that the encoder has “1920 × 1080” and “frame rate: 30 fps”.

  Therefore, the conference terminal 1 to the “encoder 6” executed at “encoding method: H.264”, “number of pixels: 1920 × 1080”, “frame rate: 30 fps”, and “selected network transmission rate: low speed”. 5 is connected.

  That is, the encoder control unit 113 considers the network characteristics and the encoding method, the transmission rate of the network becomes “low”, and “the ratio F of the server load corresponding to the server load factor” corresponds to “1 time”. The encoder 6 having “encoding method: H.264”, “number of pixels: 1920 × 1080”, and “frame speed: 30 fps” is connected to the conference terminal 1-5 (the encoder to be connected to the conference terminal 1-5) The encoder 1 is changed to the encoder 6).

  The terminal capabilities of the conference terminal 6 are “encoding method: H.265”, “number of pixels: 3840 × 2160”, and “frame rate: 60 fps”. With reference to FIG. 3, the encoder control unit 113 determines that the transmission speed of the conference terminal 6 can cope with the “highest speed” level. The network characteristic of the conference terminal 6 by the network characteristic observation unit 111 is “highest speed OK”. "Is the level. Moreover, since the server load factor by the server load observation unit 112 exceeds the threshold value, the number of encoders cannot be increased. Therefore, the conference terminal 6 is connected to the “encoder 6” executed at “encoding method: H.264”, “number of pixels: 1920 × 1080”, “frame rate: 30 fps”, and “selected network transmission rate: low speed”. Connect.

  That is, the encoder control unit 113 considers the network characteristics and the encoding method, the transmission rate of the network becomes “low”, and “the ratio F of the server load corresponding to the server load factor” corresponds to “1 time”. The conference terminal 6 is connected to an encoder 6 having “encoding method: H.264”, “number of pixels: 1920 × 1080”, and “frame rate: 30 fps”.

  The terminal capabilities of the conference terminal 7 are “encoding method: H.265”, “number of pixels: 3840 × 2160”, and “frame rate: 60 fps”. When it is determined that the transmission speed of the conference terminal 7 can cope with the “highest speed” level with reference to FIG. 3, the network characteristic of the conference terminal 7 by the network characteristic observation unit 111 is at the “low speed OK” level. Further, the server load factor by the server load observation unit 112 exceeds the threshold value, and the number of encoders cannot be increased. Therefore, the conference terminal 7 is connected to the “encoder 6” executed at “encoding method: H.264”, “number of pixels: 1920 × 1080”, “frame rate: 30 fps”, and “selected network transmission rate: low speed”. Connect.

  That is, the encoder control unit 113 considers the network characteristics and the encoding method, the transmission rate of the network becomes “low”, and “the ratio F of the server load corresponding to the server load factor” corresponds to “1 time”. The conference terminal 7 is connected to the encoder 6 having “encoding method: H.264”, “number of pixels: 1920 × 1080”, and “frame rate: 30 fps”.

  The terminal capabilities of the conference terminal 8 are “encoding method: H.265”, “number of pixels: 3840 × 2160”, and “frame rate: 60 fps”. When it is determined that the transmission speed of the conference terminal 8 can cope with the “highest speed” level with reference to FIG. 3, the network characteristic of the conference terminal 8 by the network characteristic observation unit 111 is the “lowest speed OK” level. Further, the server load factor by the server load observation unit 112 exceeds the threshold value, and the number of encoders cannot be increased. Therefore, the “encoder 4” executed at “encoding method: H.265”, “number of pixels: 1920 × 1080”, “frame rate: 30 fps”, “selected network transmission rate: lowest speed” is connected to the conference terminal. 8 is connected.

  That is, the encoder control unit 113 considers the network characteristics and the coding method, the transmission speed of the network is “lowest speed”, and “the ratio F of the server load corresponding to the server load factor” corresponds to “double”. The encoder 4 having “encoding method: H.265”, “number of pixels: 1920 × 1080”, and “frame rate: 30 fps” is connected to the conference terminal 8.

  The terminal capabilities of the conference terminal 9 are “encoding method: H.264”, “number of pixels: 1920 × 1080”, and “frame rate: 60 fps”. When it is determined that the transmission speed of the conference terminal 9 can cope with the “high speed” level with reference to FIG. 3, the network characteristic of the conference terminal 9 by the network characteristic observation unit 111 is the “high speed OK” level. Further, the server load factor by the server load observation unit 112 exceeds the threshold value, and the number of encoders cannot be increased. Therefore, the “encoder 6” executed at “encoding method: H.264”, “number of pixels: 1920 × 1080”, “frame rate: 30 fps”, and “selected network transmission rate: low speed” is connected to the conference terminal 9. Connect.

  That is, the encoder control unit 113 considers the network characteristics and the encoding method, the transmission rate of the network becomes “low”, and “the ratio F of the server load corresponding to the server load factor” corresponds to “1 time”. The conference terminal 9 is connected to the encoder 6 having “encoding method: H.264”, “number of pixels: 1920 × 1080”, and “frame rate: 30 fps”.

  The terminal capabilities of the conference terminal 10 are “encoding method: H.264”, “number of pixels: 1920 × 1080”, and “frame rate: 30 fps”. When it is determined with reference to FIG. 3 that the transmission speed of the conference terminal 10 can cope with the “low speed” level, the network characteristic of the conference terminal 10 by the network characteristic observation unit 111 is the “high speed OK” level. Further, the server load factor by the server load observation unit 112 exceeds the threshold value, and the number of encoders cannot be increased. Therefore, the “encoder 6” executed at “encoding method: H.264”, “number of pixels: 1920 × 1080”, “frame rate: 30 fps”, and “selected network transmission rate: low speed” is transferred to the conference terminal 10. Connect.

  That is, the encoder control unit 113 considers the network characteristics and the encoding method, the transmission rate of the network becomes “low”, and “the ratio F of the server load corresponding to the server load factor” corresponds to “1 time”. The conference terminal 10 is connected to the encoder 6 having “encoding method: H.264”, “number of pixels: 1920 × 1080”, and “frame rate: 30 fps”.

  As described above, when there is little variation in the terminal capability information and network characteristics of the connected conference terminals, only one encoder may be used in each conference room.

  However, if there is a conference room where the terminal capabilities and network characteristics of the conference terminal vary widely, the number of encoders used in the conference room is increased, and terminals with similar terminal capabilities and network characteristics are grouped and assigned to each encoder. Better.

  For example, assigning an encoder with a smaller video size to a group with low terminal capability, or assigning an encoder with a low bit rate to a group of terminals with low network bandwidth, etc. Do not fall.

  At this time, considering the server load of the multipoint video conference apparatus 100, when the number of conference rooms simultaneously used is small and the server load is low, the number of encoders may be increased. Conversely, when the number of conference rooms used simultaneously is large and the server load is high, the number of encoders used in each conference room is reduced.

  For example, consider a case in which five conference rooms are used at the same time on a server capable of simultaneously operating ten encoders as mentioned in the above example. If there is little variation in terminal capabilities and network characteristics in each conference room, a total of five encoders may be used, one encoder in each conference room, and the server load is still sufficient.

  Here, when the number of participants increases in one conference room and the variation of the terminal capability and network characteristics increases, the encoder is increased to divide the terminals into groups. Since the server load does not become overloaded until 10 encoders operate in the entire server, the number of encoders can be increased to 6 in this conference room.

(A-3) Effects of Embodiment As described above, conventionally, it is not possible to flexibly perform grouping of terminals in consideration of a plurality of conference rooms. There was a problem that could not be used effectively.

  On the other hand, according to this embodiment, the server resources are maintained while maintaining the video quality of each terminal by flexibly performing grouping by increasing / decreasing the number of encoders in consideration of the server load as described above. Also has the effect of being able to use it effectively.

  DESCRIPTION OF SYMBOLS 100 ... Multipoint video conference apparatus (MCU), 110 ... Video processing part, 111 ... Network characteristic observation part, 112 ... Server load observation part, 113 ... Encoder control part, 31 ... Data reception part, 32 ... Decoder, 33 ... Screen Synthesis unit, 34... Encoder, 35... Data transmission unit.

Claims (7)

In a communication control device for communicating media data with one or more terminals,
One or a plurality of encoding means for encoding media data with different encoding condition information according to the terminal capability information of each terminal;
Communication state observation means for observing communication information between each of the terminals,
Load state observation means for observing load information of the communication control device;
Coding control means for dynamically controlling coding means to be connected to each terminal based on communication information between the terminals by the communication status observation means and load information by the load status observation means; A communication control apparatus comprising: The encoding control means includes
When the load information is less than a threshold and the communication information of the terminal satisfies the communication characteristics according to the terminal capability information of the terminal,
The communication control apparatus according to claim 1, wherein new encoding means for encoding with the encoding condition information corresponding to the terminal capability information of the terminal is connected to the terminal. The encoding control means includes
When the load information is less than a threshold and the communication information of the terminal does not satisfy the communication characteristics according to the terminal capability information of the terminal,
Encoding means for encoding with the coding condition information according to the terminal capability information of the terminal, wherein the load information is less than the threshold value and the communication information of the terminal satisfies the communication characteristics according to the terminal capability information of the terminal The communication control device according to claim 1, wherein the communication control device is connected to the terminal. The encoding control means includes
When the load information exceeds the threshold and the communication information of the terminal satisfies the communication characteristics according to the terminal capability information of the terminal,
Connect another encoding means that encodes with the encoding condition information according to the terminal capability information of the terminal, the load information being less than the threshold value and satisfying the communication characteristics according to the terminal capability information of the terminal. The communication control device according to any one of claims 1 to 3, wherein The encoding control means includes
When the load information exceeds the threshold and the communication information of the terminal does not satisfy the communication characteristics according to the terminal capability information of the terminal,
Another encoding means for encoding with the encoding condition information satisfying the terminal capability information of the terminal, wherein the load information is less than the threshold value, and the communication information of the terminal satisfies the communication characteristics according to the terminal capability information of the terminal. The communication control device according to claim 1, wherein the communication control device is connected to the terminal. In a communication control method in a communication control apparatus for communicating media data with one or a plurality of terminals,
The communication control device
One or a plurality of encoding steps for encoding media data with different encoding condition information according to the terminal capability information of each terminal,
A communication state observation step of observing communication information with each of the terminals;
A load state observation step of observing load information of the communication control device;
An encoding control step for dynamically controlling the encoding means to be connected to each terminal based on the communication information between each terminal in the communication state observation step and the load information in the load state observation step; A communication control method comprising: In a communication control program for communicating media data with one or more terminals,
Computer
One or a plurality of encoding means for encoding media data with different encoding condition information according to the terminal capability information of each terminal;
Communication state observation means for observing communication information between each of the terminals,
Load state observation means for observing load information of the communication control device;
Coding control means for dynamically controlling coding means to be connected to each terminal based on communication information between the terminals by the communication status observation means and load information by the load status observation means; A communication control program characterized by causing it to function.

Images