JP2010124232A - Conference system and conference method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a technique for reducing the load of a relay device. <P>SOLUTION: When accepting a request for conference setting from a client terminal 150, a conference server 110 selects a less loaded video router 130 out of a plurality of video routers 130A to 130C and notifies the client terminal 150, which will participate in a conference, of a communication address of the selected video router 130 to set the conference. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to a technique for relaying video data or audio data obtained from a plurality of client terminals by a plurality of relay devices.

  In a conventional video conference system, for example, as in the technology described in Patent Document 1, a terminal is installed in a room where a video conference is held, and video and audio obtained from a plurality of terminals are transmitted to a relay device such as a relay server. Then, the data is distributed from the relay server to each terminal.

Japanese Patent Laid-Open No. 2001-313915

  In the technique described in Patent Literature 1, video and audio obtained from a plurality of terminals are distributed from the relay device to each terminal, so that the number of terminals participating in the conference increases or the number of conferences held. When the number increases, the burden on the relay device increases, and the video and audio to be distributed may be delayed.

  Therefore, an object of the present invention is to provide a technique for reducing the load on the relay device.

  In order to solve the above problems, in the present invention, a relay apparatus that transmits video data or audio data obtained from a client terminal is appropriately selected.

  For example, the present invention is a conference system having a plurality of client terminals, a plurality of relay devices, and a conference management server, wherein the control unit of the conference management server is a client terminal that is a partner of the conference from the client terminal. When a conference setting request is received, a process for selecting a relay device to be used in the conference to be set from the plurality of relay devices by a predetermined method and specifying a communication address of the selected relay device Processing to notify the client terminal that participates in the conference to be set, and processing to notify the selected relay device of information specifying the communication address of the client terminal that participates in the conference to be set, The control unit of the client terminal receives at least one of video data captured by the imaging unit and audio data collected by the audio collecting unit. A process of transmitting to the communication address of the relay device notified from the management server is performed, and the control unit of the relay device is at least one of video data and audio data received from a client terminal participating in the set conference One of them is transferred to a client terminal participating in the set conference.

  As described above, according to the present invention, the burden on the relay device can be reduced.

  FIG. 1 is a schematic diagram of a conference system 100 according to the first embodiment of the present invention.

  As shown in the figure, the conference system 100 includes a conference management server 110, video routers 130A to 130C as relay devices (hereinafter referred to as video routers 130 when not distinguished from each other), and client terminals 150A to 150C (hereinafter referred to as “routers”). The conference management server 110, the video router 130, and the client terminal 150 are capable of transmitting and receiving information to and from each other via the network 170. ing.

  FIG. 2 is a schematic diagram of the conference management server 110. As illustrated, the conference management server 110 includes a storage unit 111, a control unit 115, an input unit 120, an output unit 121, and a communication unit 122.

  The storage unit 111 includes a client information storage area 112 and a meeting holding information storage area 113.

  The client information storage area 112 stores client information having information for specifying the communication address of the client terminal 150 used for the conference. For example, in this embodiment, a client information table 112a as shown in FIG. 3 (schematic diagram of the client information table 112a) is stored.

  The client information table 112a has a client ID column 112b and an address column 112c.

  Information for identifying each client terminal 150 is stored in the client ID column 112b. Here, the client ID assigned to each client terminal 150 for identifying the client terminal 150 is stored as information for specifying the client terminal 150.

  The address column 112c stores information for specifying the communication address (IP address or the like) of the client terminal 150 specified by the client ID column 112b.

  Returning to FIG. 2, the conference holding information storage area 113 includes a client terminal 150 participating in a conference set via the conference management server 110 and a video router 130 through which the client terminal 150 transmits and receives information. Conference holding information having information to be specified is stored. For example, in the present embodiment, a conference holding information table 113a as shown in FIG. 4 (schematic diagram of the conference holding information table 113a) is stored.

  The conference holding information table 113a has a conference ID column 113b, a video router ID column 113c, a client ID column 113d, and an address column 113e.

  In the conference ID column 113b, information for specifying a conference set via the conference management server 110 is stored. Here, in the present embodiment, a conference ID, which is identification information assigned when each conference is set, is stored as information for identifying the conference.

  Information for specifying the video router 130 is stored in the video router ID column 113c. Here, in this embodiment, the video router ID allocated in advance to each video router 130 is stored as information for specifying the video router 130.

  The client ID column 113d stores information (here, client ID) that identifies the client terminal 150 participating in the conference specified by the conference ID column 113b.

  The address field 113e stores information for specifying a communication address assigned to the client terminal 150 specified by the client ID field 113d.

  The control unit 115 includes an overall control unit 116, a call control unit 117, and a conference management unit 118.

  The overall control unit 116 controls the entire processing in the conference management server 110.

  For example, in the present embodiment, necessary information is stored in the client information storage area 112 and updated. Specifically, the overall control unit 116 receives the input of the client ID and communication address of the client terminal 150 via the input unit 120, and performs a process of storing the input information in the corresponding column of the client information table 112a. .

  The call control unit 117 performs call control for setting a conference.

  For example, when the call control unit 117 receives a call (conference setting request) message designating the client ID or communication address of another client terminal 150 from the client terminal 150 via the communication unit 122, the call control unit 117 uses it in the conference. The video router 130 to be selected is selected. In the present embodiment, the call control unit 117 selects the client terminal 150 that transmits and receives information from the video router 130 in order from the smallest number.

  Specifically, when there is a video router 130 that has not been selected, the call control unit 117 selects the video router 130 in a predetermined order, and all the video routers 130 have already been selected. If the number of client terminals 150 connected to the video router 130 is small, the selection is made in order from the smallest number of client terminals 150 (a predetermined order when the number of client terminals 150 is the same).

  Note that when the number of client terminals 150 accommodated in one video router 130 has reached a predetermined number, the call control unit 117 selects another video router 130 for one conference. In this case, the selection of the video router 130 is also performed in a predetermined order as described above, or in an order in which the number of accommodated client terminals 150 is small.

  Then, the call control unit 117 calls the call message corresponding to the communication address of the client terminal 150 specified by the client ID specified in the received call message or the protocol determined in advance in the specified communication address. Process to send. Here, it is assumed that the call message includes the communication address of the video router 130 used by the client terminal 150 that is the destination of the call message.

  Then, when receiving a response message for responding to the conference in response to such a call message, the call control unit 117 allocates a conference ID that is unique for each conference, and uses the conference ID and the conference ID. The video router ID assigned to the video router 130 used in the specified conference, the client ID assigned to the client terminal 150 participating in the conference specified by the conference ID, and the conference ID are specified. A communication address assigned to a terminal participating in the conference is specified, a routing process command is issued to the conference management unit 118 described later, and the conference is set.

  When the call control unit 117 receives a call (request to join a conference) message specifying a conference ID of a conference that has already been held via the communication unit 122, the client that has transmitted the call message The video router 130 used by the terminal 150 is selected.

  Here, the call control unit 117 determines that the number of client terminals 150 accommodated in the video router 130 used in the conference requested to participate in the received call message has not reached the predetermined number. In this case, the video router 130 that is used in the conference and does not reach the predetermined number of the client terminals 150 that are accommodated is selected.

  On the other hand, when the number of client terminals 150 accommodated in the video router 130 used in the conference for which participation is requested by the received call message has reached a predetermined number, the call control unit 117 As described above, the video router 130 is selected in a predetermined order or an order in which the number of accommodated client terminals 150 is small.

  Then, the call control unit 117 includes a conference ID of a conference requested to participate in the received call message, a video router ID allocated to the video router 130 used in the conference specified by the conference ID, A client ID and a communication address allocated to the client terminal 150 that has transmitted the call message are specified, a routing process command is issued to the conference management unit 118 described later, and participation in the conference is set.

  When the call control unit 117 receives a cancellation notification specifying the communication address assigned to the client terminal 150 from the client terminal 150, the call control unit 117 specifies the communication address and sends a routing cancellation processing command to the conference management unit 118. And canceling the participation of the client terminal 150 that has issued the cancellation notification from the already held conference.

  The conference management unit 118 performs processing for managing a conference set via the conference management server 110.

  For example, when the conference management unit 118 receives a routing processing command from the call control unit 117, the conference ID specified by the routing processing command is not stored in the conference ID column 113b of the conference holding information table 113a. Adds a new record to the conference holding information table 113a, and stores the conference ID, video router ID, client ID, and communication address specified by the routing processing command in the added record, and the communication unit 122 Then, a process of transmitting a routing instruction specifying the conference ID, the video router and the communication address specified by the routing processing command to the video router 130 is performed.

  When the conference management unit 118 receives a routing processing command from the call control unit 117, the conference ID specified by the routing processing command is already stored in the conference ID column 113b of the conference holding information table 113a. Stores information for specifying the video router ID, client ID, and communication address specified in the routing processing command by adding a new line to the record in which the conference ID is stored in the conference ID column 113b. At the same time, a process of transmitting a routing instruction specifying the conference ID, the video router ID, and the communication address specified by the routing processing command to the video router 130 via the communication unit 122 is performed.

  When the conference management unit 118 receives a routing cancellation processing command from the call control unit 117, the communication address specified by the routing cancellation processing command is stored in the address column 113e of the conference holding information table 113a. Delete line information. In addition, when the information of all the lines matched with meeting ID is deleted, the record of the said meeting ID is deleted.

  Then, the conference management unit 118 transmits a routing cancellation instruction including information specifying the communication address included in the routing cancellation processing instruction to the video router 130 via the communication unit 122.

  The input unit 120 receives input of information.

  The output unit 121 outputs information.

  The communication unit 122 transmits and receives information via the LAN 200.

  The conference management server 110 described above includes, for example, an external storage device such as a CPU (Central Processing Unit) 901, a memory 902, and an HDD (Hard Disk Drive) as shown in FIG. 5 (schematic diagram of the computer 900). 903, a reading device 905 for reading and writing information to and from a portable storage medium 904 such as a CD-ROM (Compact Disk Read Only Memory) and a DVD-ROM (Digital Versatile Disk Read Only Memory), a keyboard, This can be realized by a general computer 900 including an input device 906 such as a mouse, an output device 907 such as a display, and a communication device 908 such as a NIC (Network Interface Card) for connecting to a communication network.

  For example, the storage unit 111 can be realized by the CPU 901 using the memory 902 or the external storage device 903, and the control unit 115 loads a predetermined program stored in the external storage device 903 into the memory 902. The input unit 120 can be realized by the CPU 901 using the input device 906, and the output unit 121 can be realized by the CPU 901 using the output device 907. The communication unit 122 can be realized by the CPU 901 using the communication device 908.

  The predetermined program is downloaded from the storage medium 904 via the reading device 905 or from the network via the communication device 908 to the external storage device 903, and then loaded onto the memory 902 and executed by the CPU 901. You may do it. Alternatively, the program may be directly loaded on the memory 902 from the storage medium 904 via the reading device 905 or from the network via the communication device 908 and executed by the CPU 901.

  FIG. 6 is a schematic diagram of the video router 130. As illustrated, the video router 130 includes a storage unit 131, a control unit 135, and a communication unit 139.

  The storage unit 131 includes a video router information storage area 132 and a routing information storage area 133.

  The video router information storage area 132 stores video router information having information for specifying the communication address of the video router 130. For example, in the present embodiment, a video router information table 132a as shown in FIG. 7 (schematic diagram of the video router information table 132a) is stored.

  The video router information table 132a has a video router ID column 132b and an address column 132c.

  In the video router ID column 132b, information for identifying the video router 130 (here, the video router ID) is stored.

  The address field 132c stores information for specifying the communication address of the video router 130 specified in the video router ID field 132b.

  Returning to FIG. 6, the routing information storage area 133 stores routing information having the communication address of the client terminal 150 participating in the conference and information for specifying the video router 130 used in the conference. For example, in this embodiment, a routing information table 133a as shown in FIG. 8 (schematic diagram of the routing information table 133a) is stored.

  The routing information table 133a has a conference ID column 133b, a video router ID column 133c, and an address column 133d.

  In the conference ID column 133b, information (here, a conference ID) for specifying a conference set via the conference management server 110 is stored.

  The video router ID column 133c stores information (here, a video router ID) that identifies a video router used in the conference specified by the conference ID column 133b.

  In the address column 133d, information for specifying a communication address assigned to the client terminal 150 participating in the conference specified in the conference ID column 133b is stored.

  Returning to FIG. 6, the control unit 135 includes an overall control unit 136 and a routing information management unit 137.

  The overall control unit 136 controls the entire processing in the video router 130.

  For example, in the present embodiment, the overall control unit 136, via the communication unit 139, information that identifies the video router 130 (here, the video router ID), information that identifies the communication address of the video router 130, Is received and stored in the video router information table 132.

  In the present embodiment, the overall control unit 136 performs a routing process according to the routing information table 133a.

  Specifically, the overall control unit 136 identifies the communication address of the transmission source of the video data or audio data received from the communication unit 139, and the identified communication address is the conference ID corresponding to the address field 133d of the routing information table 133a. The record in the column 133b is specified.

  Next, in the row where the video router ID stored in the video router ID column 133c included in the specified record is the ID of the own device, the overall control unit 136 determines the communication address stored in the address column 133d. In the row where the communication address other than the communication address of the transmission source is acquired and the video router ID stored in the video router ID column 133c included in the specified record is not the ID of the own device, the video router The record of the video router information table 132a whose ID is stored in the video router ID column 132b is specified, and the communication address stored in the address column 132c of the specified record is acquired.

  Then, the overall control unit 136 transfers the received video data or audio data to the acquired communication address. Note that a conference ID is attached to video data or audio data to be transferred.

  Further, when receiving video data or audio data from another video router 130, the overall control unit 136 stores the conference ID attached to the received video data or audio data in the conference ID column 133b. The record of the routing information table 132a is specified, the line in which the ID of the own device is stored in the video router ID column 133c of the specified record is specified, and the communication address stored in the address column 133d of the specified row is acquired. Then, the received video data or audio data is transferred to the acquired communication address.

  The routing information management unit 137 manages the routing information table 133a.

  For example, when the routing information management unit 137 receives a routing instruction from the conference management server 110, when the conference ID specified by the routing instruction is not stored in the conference ID column 133b of the routing information table 133a, A new record is added to the routing information table 133a, and the conference ID, video router ID, and communication address specified by the routing instruction are stored in the added record.

  In addition, when the routing information management unit 137 receives a routing instruction from the conference management server 110, when the conference ID specified by the routing instruction is already stored in the conference ID column 133b of the routing information table 133a. Then, a new line is added to the record in which the conference ID is stored in the conference ID column 133b, and the video router ID and the communication address specified by the routing instruction are stored.

  When the routing information management unit 137 receives a routing cancellation instruction from the conference management server 110, the communication address specified in the routing cancellation instruction is information on the row stored in the address column 133d of the routing information table 133a. Is deleted. In addition, when the information of all the lines matched with meeting ID is deleted, the record of the said meeting ID is deleted.

  The communication unit 139 transmits and receives information via the network 170.

  The video router 130 described above can be realized by a general computer 900 as shown in FIG.

  For example, the storage unit 131 can be realized by the CPU 901 using the memory 902 or the external storage device 903, and the control unit 135 loads a predetermined program stored in the external storage device 903 into the memory 902. The communication unit 139 can be realized by the CPU 901 using the communication device 908.

  The predetermined program is downloaded from the storage medium 904 via the reading device 905 or from the network via the communication device 908 to the external storage device 903, and then loaded onto the memory 902 and executed by the CPU 901. You may do it. Alternatively, the program may be directly loaded on the memory 902 from the storage medium 904 via the reading device 905 or from the network via the communication device 908 and executed by the CPU 901.

  FIG. 9 is a schematic diagram of the client terminal 150. As illustrated, the client terminal 150 includes a storage unit 151, a control unit 153, an imaging unit 159, a sound collection unit 160, an input unit 161, a video output unit 162, an audio output unit 163, and a communication unit. 164.

  The storage unit 151 stores information necessary for processing at the client terminal 150. For example, in the present embodiment, at least one of video data and audio data transmitted / received to / from the video router 130, the communication address of the conference management server 110, and the like are stored.

  The control unit 153 includes an overall control unit 154, a communication control unit 155, a video synthesis unit 156, and a voice synthesis unit 157.

  The overall control unit 154 controls the entire processing at the client terminal 150.

  For example, in the present embodiment, the overall control unit 154 specifies the client ID or communication address allocated to the client terminal 150 that sets the conference from the operator of the client terminal 150 via the input unit 161 described later. When an input of a conference setting instruction is received, a call message including the input client ID or communication address is generated, and the generated call message is transmitted to the conference management server 110 via the communication control unit 155 and the communication unit 164. Process to send to.

  In addition, when receiving a call message for setting a conference, the overall control unit 154 notifies the operator of the client terminal 150 that there has been an incoming call for setting the conference. Then, when the control unit 154 receives an input of an intention indicating that the conference is to be performed via the input unit 161, the overall control unit 154 transmits a response message to the conference management server 110 via the communication control unit 155 and the communication unit 164. Process.

  Here, notification that there has been an incoming call is performed by, for example, displaying a predetermined incoming call message on a video output unit 162 (to be described later) or outputting a ring tone from an audio output unit 163 (to be described later). Good.

  Further, in the present embodiment, the overall control unit 154 performs processing for outputting video data and audio data obtained via an imaging unit 159 and a sound collection unit 160 described later to the communication control unit 155.

  Further, the overall control unit 154 performs a process of outputting the video or audio synthesized by the video synthesis unit 156 or the audio synthesis 157 to the video output unit 162 or the audio output unit 163.

  The communication control unit 155 transmits and receives information via the communication unit 164.

  In addition, the communication control unit 155 outputs video data transmitted from different transmission sources to the video synthesis unit 156 and outputs audio data transmitted from different transmission sources to the audio synthesis unit 157.

  In the present embodiment, the communication control unit 155 transmits the video data and audio data output from the overall control unit 154 to the video router 130 as separate transmission data.

  The video composition unit 156 synthesizes the video data obtained from the communication control unit 155. Video data can be synthesized by dividing one screen into specific areas and inserting video data transmitted from a specific transmission source into a predetermined area. However, the present invention is not limited to this mode. For example, a part or all of a plurality of video data may be overlapped.

  The voice synthesis unit 157 synthesizes voice data obtained from the communication control unit 155. Here, as a technique for synthesizing audio data, an existing technique may be used, and a detailed description thereof will be omitted.

  The imaging unit 159 captures an image. The captured video is output to the overall control unit 154 as video data.

  The sound collection unit 160 collects sound. The collected sound is output to the overall control unit 154 as sound data.

  The input unit 161 receives input of information.

  The video output unit 162 outputs video data.

  The audio output unit 163 outputs audio data.

  The communication unit 164 transmits and receives information via the LAN 200.

  The client terminal 150 described above includes, for example, a general computer 900 as shown in FIG. 5, an imaging device (not shown) such as a video camera device, a sound collecting device (not shown) such as a microphone, a speaker, and the like. This can be realized by providing an audio output device (not shown).

  For example, the storage unit 141 can be realized by the CPU 901 using the memory 902 or the external storage device 903, and the control unit 143 loads a predetermined program stored in the external storage device 903 into the memory 902. The image capturing unit 159 can be realized by using the image capturing apparatus by the CPU 901, and the sound collecting unit 160 can be realized by using the sound collecting apparatus by the CPU 901. The input unit 161 can be realized by using the input device 906 by the CPU 901, the video output unit 162 can be realized by using the output device 907 by the CPU 901, and the audio output unit 163 can be realized by the CPU 901. The communication unit 164 can be realized by using an audio output device. It can be realized by using the communication device 908.

  The predetermined program is downloaded from the storage medium 904 via the reading device 905 or from the network via the communication device 908 to the external storage device 903, and then loaded onto the memory 902 and executed by the CPU 901. You may do it. Alternatively, the program may be directly loaded on the memory 902 from the storage medium 904 via the reading device 905 or from the network via the communication device 908 and executed by the CPU 901.

  FIG. 10 is a sequence diagram illustrating processing when a conference is performed in the conference system 100.

  Here, FIG. 10 shows a process when a call is set from the client terminal 150A to the client terminals 150B and 150C to set a conference, but the present invention is not limited to such a mode.

  First, the overall control unit 154 of the client terminal 150A receives a conference setting instruction specifying the client ID assigned to the client terminals 150B and 150C for setting the conference from the operator of the client terminal 150A via the input unit 161. When the input is accepted, a call message including the input client ID is generated, and the communication control unit 155 is instructed to transmit to the conference management server 110. The communication control unit 155 receives the call message (conference setting request). ) Is transmitted to the conference management server 110 via the communication unit 164 (S10).

  In the conference management server 110 that has received such a call message, the call control unit 177 extracts the client ID included in the call message, and adds “1” to the number of extracted client IDs. The number of terminals is calculated, and the video router 130 used by the client terminal 150 participating in the conference is selected (S11).

  The selection of the video router 130 is performed by, for example, counting the number of client terminals 150 accommodated (connected) for each video router ID with reference to the video router ID column 113c and the client ID column 113d. Select in ascending order. Here, when there are a plurality of video routers 130 in the minimum number counted, they may be selected in a predetermined order.

  In this sequence, the video router 130A is selected for the client terminal 150A and the client terminal 150B, and the video router 130B is selected for the client terminal 150C.

  Then, the call control unit 117 selects the call message having the video router ID of the video router 130A selected in step S11 for the client terminal 150B, and the client terminal 150C selected in step S11. A call message having the video router ID of the video router 130B is transmitted via the communication unit 122 (S12, S13).

  In the client terminal 150B that has received such a call message, whether the overall control unit 154 displays a predetermined incoming call message on the video output unit 162 or outputs a ring tone from the audio output unit 163, for example. When the operator of the client terminal 150B is notified that a call for setting the conference has been made, and the input of the intention display indicating the conference is received via the input unit 161, the communication unit 164 is Then, a response message is transmitted to the conference management server 110 (S14).

  Similarly, in the client terminal 150 </ b> C that has received such a call message, the overall control unit 154 displays a predetermined incoming message on the video output unit 162 or receives a ring tone from the audio output unit 163. Or the operator of the client terminal 150C is notified that there has been a call for setting the conference, and via the input unit 161, an input of an intention display indicating that the conference is to be performed is received. A response message is transmitted to the conference management server 110 via the communication unit 164 (S15).

  In the conference management server 110 that has received such a response message, the conference management unit 118 allocates a conference ID of the conference held by the current client terminals 150A, 150B, and 150C, and generates a new record in the conference holding information table 113a. The generated conference ID, the video router ID of the video router 130 selected in step S11, and the client IDs and communication addresses of the client terminals 150A, 150B, and 150C that communicate with the selected video router 130. And the allocated conference ID, the video router ID of the selected video router 130, and the communication addresses of the client terminals 150A, 150B, and 150C that transmit / receive information to / from the selected video router 130. Having roux The Ingu instruction, via the communication unit 122, and transmits to the video router 130 selected in step S11 (S16, S17).

  In the conference management server 110 that has received such a response message, the call control unit 119 transfers the response message to the client terminal 150A via the communication unit 122 (S18). The call control unit 119 includes the video router ID of the video router 130A and the conference ID in the response message to be transferred.

  In steps S16 and S17, the routing information management unit 137 of the video router 130 that has received the routing instruction adds a new record to the routing information table 133a, and the conference ID, video router ID, and communication included in the routing instruction. The address is stored in the corresponding column, and the overall control unit 136 performs routing processing according to such a record.

  For example, in the video router 130A that has received the video data and audio data from the first client terminal 150A, the overall control unit 136 stores the communication address of the transmission source of the video data and audio data in the address field 133d of the routing information table 133a. In the recorded record, the line in which the video router ID of the own apparatus is stored in the video router ID column 133c is specified, and video data or audio data among the communication addresses stored in the address column 133d of the specified line Get a communication address outside the communication address of the sender.

  Further, the overall control unit 136 stores the video router ID of its own device in the video router ID column 133c in the record in which the communication address of the transmission source of the video data and audio data is stored in the address column 133d of the routing information table 133a. The line that has not been specified is specified, and the video router ID stored in the video router ID column 133c of the specified line is specified. Then, the communication address corresponding to the identified video router ID is acquired from the video router information table 132a.

  Then, the overall control unit 136 transfers the video data or audio data to the communication address acquired as described above. A conference ID is attached to video data or audio data to be transferred.

  In the video router 130B that has acquired the video data or audio data from the other video router 130A, the conference ID attached to the received video data or audio data is stored in the conference ID column 133b of the routing information table 133. In the specified record, the line in which the video router ID of the own device is stored in the video router ID field 133c is specified, and the communication address stored in the address field 133d of the specified line is acquired. The video data or audio data is transferred to the acquired communication address.

  The video routers 130A and 130B that have received the video data from the client terminals 150B and 150C perform the above processing, so that the video data or audio data acquired by the client terminals 150A, 150B, and 150C is converted into the other client terminals 150A. , 150B, 150C.

  Note that, in the client terminals 150A, 150B, and 150C that have received the video data and audio data from the other client terminals 150A, 150B, and 150C, the video synthesis unit 156 synthesizes the video data, and the audio synthesis unit 157 Compositing is performed (S19, S20, S21), and they are output to the video output unit 162 and the audio output unit 163, respectively.

  FIG. 11 is a sequence diagram illustrating processing when the client terminal 150 participates in a conference already held in the conference system 100.

  Note that FIG. 11 illustrates processing when the client terminal 150C participates in a conference held between the client terminal 150A and the client terminal 150B, but the present invention is not limited to such a mode.

  Further, the operator of the client terminals 150A and 150B, for example, communicates the conference ID included in the response message transferred in step S18 of FIG. 10 to the operator of the client terminal 150C that permits participation by means such as communication. By notifying, the operator of the client terminal 150C can be allowed to participate in the conference.

  First, the operator of the client terminal 150C obtains the conference ID allocated for each conference by communication or the like from the operator of the client terminal 150A that has set the conference, and specifies the acquired conference ID (call participation message) Request) is transmitted to the conference management server 110 (S30).

  In the conference management server 110 that has received such a call message, the call control unit 177 selects the video router 130 used by the client terminal 150 participating in the conference (S31).

  The selection of the video router 130 is performed, for example, by identifying a record in the conference holding information table 113a in which the conference ID included in the outgoing call message is stored in the conference ID column 113b, and from the video router ID column 113 of the identified record. The video router 130 used in the conference is identified, and the number of client terminals 150 connected to the video router 130 is calculated from the client ID column 113d for each video router 130 used in the conference. When the number of participating client terminals obtained by adding “1” to the calculated value does not exceed a predetermined threshold value, the smallest number of participating client terminals among the video routers 130 already used (If there are a plurality of items, a predetermined order) is selected.

  On the other hand, when the number of participating client terminals does not exceed a predetermined threshold, the other video router 130 with the smallest number of accommodated client terminals 150 (in the case where there are a plurality of client terminals 150) , A predetermined order).

  Here, in this sequence, the video router 130B is selected for the client terminal 150C.

  And the meeting management part 118 of the meeting management server 110 specifies the record of the meeting holding information table 113a in which the meeting ID included in the outgoing call message of step S30 is stored in the meeting ID column 113b, and the specified record A new line is created, and the video router ID of the video router 130 selected in step S31 and the client ID and communication address of the client terminal 150C that communicates with the selected video router 130 correspond to the generated line. The communication unit 122 receives a routing instruction for identifying the conference ID, the video router ID of the selected video router 130, and the communication address of the client terminal 150C that transmits and receives information with the selected video router 130. Via the conference ID specified in the call message And transmits to the video router 130 used in the conference are constant (already video router 130B that are selected by the video router 130A and the step S31 are used) (S32, S33).

  In steps S32 and S33, the routing information management unit 137 of the video routers 130A and 130B that received the routing instruction records the record of the routing information table 133a in which the conference ID included in the routing instruction is stored in the conference ID column 133b. The new line is added to the specified record, the video router ID and the communication address included in the routing instruction are stored in the corresponding columns, and the overall control unit 136 performs the routing process according to such a record. Do.

  As described above, in the present embodiment, video data and audio data can be efficiently distributed using a plurality of video routers 130.

  Next, a second embodiment of the present invention will be described.

  In the second embodiment of the present invention, the conference management server 210 and the video router 230 are different from those of the first embodiment, and therefore, items related to these will be described below.

  FIG. 12 is a schematic diagram of the conference management server 210. As shown in the figure, the conference management server 210 includes a storage unit 211, a control unit 215, an input unit 120, an output unit 121, and a communication unit 122, as in the first embodiment. Since the storage unit 211 and the control unit 215 are different from each other, these related items will be described below.

  The storage unit 211 includes a client information storage area 112, a conference holding information storage area 113, and a communication status information storage area 214, and a communication status information storage area 214 is provided as compared with the first embodiment. The points related to this point will be described below.

  In the communication status information storage area 214, information for specifying the communication status (communication load) of the video router 230 used in the conference system 100 is stored. For example, in the present embodiment, a communication status information table 214a as shown in FIG. 13 (schematic diagram of the communication status information table 214a) is stored.

  As illustrated, the communication status information table 214a has a video router ID column 214b and a communication speed column 214c.

  Information for identifying the video router 230 used in the conference system 100 (here, the video router ID) is stored in the video router ID column 214b.

  The communication speed column 214c stores information specifying the communication speed (bit / s) transmitted from the video router 2302 specified in the video router ID column 214b.

  Returning to FIG. 12, the control unit 215 includes an overall control unit 116, a call control unit 217, a conference management unit 118, and a communication status management unit 219, and performs call control as compared with the first embodiment. Since the unit 217 and the communication status management unit 219 are different, items related to these will be described below.

  The call control unit 217 performs call control for setting a conference.

  For example, when the call control unit 217 receives a call (conference setting request) message specifying the client ID or communication address of another client terminal 150 from the client terminal 150 via the communication unit 122, the call control unit 217 uses the call control unit 217 in the conference. The video router 230 to be selected is selected.

  Here, the call control unit 217 in the present embodiment refers to the communication status information table 214a stored in the communication status information storage area 214, and selects the video router 230 with the lightest communication load (the highest communication speed). select. When there are a plurality of video routers 230 having the lightest communication load (the fastest communication speed), an arbitrary selection method, for example, a predetermined order or the client terminal 150 accommodated in the video router 230 is selected. The selection may be made in order from the smallest number.

  Note that the processing in the call control unit 217 in this embodiment is the same as the processing in the call control unit 117 in the first embodiment except for the selection processing of the video router 230.

  The communication status management unit 219 performs processing for storing communication status information sent from each video router 230 in the communication status information table 214a.

  Specifically, the communication status management unit 219 specifies (stores) a record in which the video router ID included in the communication status information transmitted from each video router 230 is stored in the video router ID column 214b. If not, a new record is created and the video router ID is stored), and information specifying the communication speed included in the communication status information is stored (updated) in the communication speed column 214c of the corresponding record. Perform the process.

  FIG. 14 is a schematic diagram of the video router 230. As shown in the figure, the video router 230 includes a storage unit 131, a control unit 235, and a communication unit 139. Since the control unit 235 is different from that of the first embodiment, the control is described below. Items related to the unit 235 will be described.

  The control unit 235 includes an overall control unit 136, a routing information management unit 137, and a communication status processing unit 238. Compared with the first embodiment, the control unit 235 is provided with a communication status processing unit 238. Since they are different, items related to the communication status processing unit 238 will be described below.

  The communication status processing unit 238 specifies the communication status of video data and audio data transmitted via the communication unit 139, and transmits the communication status information specifying the specified communication status via the communication unit 139 to the conference management server 210. Process to send to.

  Specifically, the communication status processing unit 238 calculates the average value of the communication speed (bps) of the video data and audio data transmitted via the communication unit 139 in a predetermined period, and specifies the calculated communication speed. Communication status information including the information to be transmitted and the video router ID of the own device is generated and transmitted to the conference management server 210 via the communication unit 139 at a specific time (specific cycle or the like).

  As described above, in the second embodiment of the present invention, since video data and audio data are transmitted using the video router 230 with a light communication load, video data and audio data can be efficiently transmitted. .

  In the embodiment described above, the conference ID is used as information for identifying each conference, and the client ID is used as information for identifying each client terminal 150. However, the present invention is not limited to such an aspect. The telephone numbers assigned to the conference system 100 in advance are used as information for identifying each conference, and the telephone numbers allocated to each client terminal 150 are used as information for identifying each client terminal 150. It is also possible to use numbers. In such a case, a call is made to the telephone number assigned to the client terminal 150 for which a conference is to be set (when a conference is set for a plurality of client terminals 150, a plurality of telephone numbers are set to “ * "Or" # "to connect, etc.), a conference can be set by the same process as described above, and if you want to join a conference that has already been set, call the phone number assigned to the conference to join By applying, it becomes possible to participate in the conference by the same process as described above.

  In the embodiment described above, the video routers 130 and 230 are selected in the order of decreasing number of client terminals 150 accommodated in the video router 130 or in descending order of the communication speed of the video router 230. However, the present invention is not limited to such an embodiment. For example, when the order of video routers to be selected is determined in advance and the number of client terminals 150 accommodated in the selected video router exceeds a predetermined threshold, The next video router may be selected according to the order. In such a case, the threshold value is obtained by subtracting a specific number from the maximum number of video routers accommodated, so that even if a client terminal 150 that participates in the conference later appears, the threshold value can be flexibly handled. Will be able to.

  Further, when a client terminal 150 that communicates via the video router is determined in advance for each video router (a plurality of video routers are allocated to one client terminal), and a conference is performed using the client terminal 150 It is also possible to select the video router assigned to the client terminal 150 having the smallest number of communicating client terminals 150 and the fastest communication speed. . In such a case, by changing the number of allocated video routers or allocating a video router that is close to the client terminal 150 by the processing capability of the video router, it is efficient. Transmission can be performed.

Schematic diagram of a conference system. Schematic diagram of a conference management server. Schematic diagram of a client information table. Schematic of a meeting holding information table. Schematic diagram of a computer. Schematic diagram of a video router. Schematic of a video router information table. Schematic diagram of a routing information table. Schematic of a client terminal. The sequence diagram which shows the process at the time of conducting a meeting in a conference system. The sequence diagram which shows the process at the time of a client terminal participating in the meeting already held in the meeting system. Schematic diagram of a conference management server. Schematic of a communication status information table. Schematic diagram of a video router.

Explanation of symbols

100 Conference system 110, 210 Conference management server 111, 211 Storage unit 112 Client information storage region 113 Conference holding information storage region 214 Communication status information storage region 115, 215 Control unit 116 Overall control unit 117, 217 Call control unit 118 Conference management unit 219 Communication status management unit 130, 230 Video router 131 Storage unit 132 Video router information storage region 133 Routing information storage region 135, 235 Control unit 136 Overall control unit 137 Routing information management unit 238 Communication status processing unit 150 Client terminal 151 Storage unit 153 Control unit 154 Overall control unit 155 Communication control unit 156 Video synthesis unit 157 Audio synthesis unit 159 Imaging unit 160 Sound collection unit 162 Video output unit 163 Audio output unit

Claims (6)

A conference system having a plurality of client terminals, a plurality of relay devices, and a conference management server,
The control unit of the conference management server
When receiving a conference setting request specifying a client terminal of a conference partner from the client terminal, a process of selecting a relay device to be used in the conference to be set from a plurality of relay devices by a predetermined method;
A process of notifying information identifying the communication address of the selected relay device to a client terminal participating in the conference to be set;
A process for notifying the selected relay device of information identifying the communication address of the client terminal participating in the conference to be set,
The control unit of the client terminal performs a process of transmitting at least one of the video data captured by the imaging unit and the audio data collected by the audio collecting unit to the communication address of the relay device notified from the management server. Done
The control unit of the relay device transfers at least one of video data and audio data received from a client terminal participating in the set conference to the client terminal participating in the set conference To do the
A conference system characterized by The conference system according to claim 1,
The control unit of the management server
Processing for storing in the storage unit meeting holding information that identifies the relay device and the client terminal that is holding the conference via the relay device;
When receiving a conference setting request specifying the client terminal of the other party of the conference from the client terminal, the number of connections of the client terminal for each relay device is calculated from the conference holding information, and the client is selected from the plurality of relay devices. Selecting a relay device with the least number of terminal connections,
A conference system characterized by The conference system according to claim 2,
The control unit of the management server
Upon receiving a request for joining a meeting that specifies a meeting to join from the client terminal, the number of connections of the client terminal for each relay device selected in the meeting to be joined is calculated from the meeting holding information, and the calculated number of connections Processing for determining whether or not the number exceeds a predetermined number;
If the calculated number of connections does not exceed the predetermined number, select the one with the smallest number of client terminal connections among the relay devices that do not exceed the number, and calculate the predetermined number of connections. If it exceeds, calculate the number of client terminal connections for each relay device that is not used in the conference to participate, and select the one with the smallest number of client terminal connections,
A process for notifying information identifying the communication address of the selected relay device to the client terminal that has transmitted the conference participation request;
Performing a process of notifying the selected relay device of information specifying the communication address of the client terminal participating in the conference;
A conference system characterized by The conference system according to claim 1,
The control unit of the relay device performs a process of transmitting information specifying a processing load to the management server,
The control unit of the management server
Processing for storing information specifying the processing load received from the relay device in a storage unit as communication status information;
When receiving a conference setting request specifying the client terminal of the other party of the conference from the client terminal, the relay device having the lightest processing load is identified from the communication status information, and the identified relay device is selected. ,
A conference system characterized by The conference system according to claim 4,
The control unit of the management server
When a request to join a meeting specifying a meeting to be joined is received from the client terminal, the processing load for each relay device selected in the meeting to be joined is specified from the meeting holding information, and the specified processing load is the lightest A process of selecting a relay device;
A process for notifying information identifying the communication address of the selected relay device to the client terminal that has transmitted the conference participation request;
Performing a process of notifying the selected relay device of information specifying the communication address of the client terminal participating in the conference;
A conference system characterized by A conference method performed by a conference system having a plurality of client terminals, a plurality of relay devices, and a conference management server,
When the control unit of the conference management server receives a conference setting request specifying the client terminal of the other party of the conference from the client terminal, a relay device to be used in the conference to be set is determined in advance from the plurality of relay devices. A process of performing a selection process according to a specified method;
A process in which the control unit of the conference management server performs a process of notifying a client terminal participating in a conference to set information for specifying a communication address of the selected relay device;
A process in which the control unit of the conference management server performs a process of notifying the selected relay device of information specifying a communication address of a client terminal participating in the conference to be set;
A process in which the control unit of the client terminal transmits at least one of the video data captured by the imaging unit and the audio data collected by the audio collection unit to the communication address of the relay device notified from the management server. The process of doing,
A process in which the control unit of the relay device transfers at least one of video data and audio data received from a client terminal participating in the set conference to the client terminal participating in the set conference Providing the process of
A meeting method characterized by

Images