JP2970645B2 - Multipoint connection conference system configuration method, multipoint connection conference system, server device and client device, and storage medium storing multipoint connection conference system configuration program - Google Patents

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a multipoint connection conference system configuration method, a multipoint connection conference system, a server device, a client device, and a storage medium storing a multipoint connection conference system configuration program. Multi-point connection conference system configuration method, multi-point connection conference system, server device, client device, and multi-point connection conference system configuration for full-duplex real-time multi-point connection audio conference by a plurality of terminals in an IP network The present invention relates to a storage medium storing a program.

[0002]

2. Description of the Related Art As a first conventional method, an application called an Internet telephone for performing real-time two-way voice communication in an IP network such as the Internet has begun to spread. This Internet telephone system normally makes a one-to-one call between terminals, but there is also a system in which a plurality of terminals are connected to enable a multi-person conference using this. As shown in FIG. 16, they transmit the same voice data to all other communication partners (conference participants).

As a second method, there is a method using a multipoint connection server for connecting a plurality of terminals. This is because, as shown in FIG. 17, each terminal transmits voice data to the multipoint connection server, and the multipoint connection server mixes the voice data of each terminal participating in the conference, and One audio data is transmitted to each terminal. With this method, only 2 × N data flows with respect to the number of participants N in the conference, and even when the number of participants increases, the processing amount at each terminal is the same as in the case of one-to-one communication. In addition, the amount of data flowing through the network does not increase so much.

[0004] As a third method, as shown in FIG. 18, a dedicated device (M
There is a method using a CU (Multipoint Control Unit). Since the mixing of audio data from each terminal is performed by a dedicated device called MCU, there is no possibility that the multipoint connection server cannot process the data. As a result, multiple participants can talk at the same time, and a multi-party conference can be performed. The usability is greatly improved.

As a fourth method, as shown in FIG. 19, the multipoint connection server does not perform mixing of audio data, but regards one terminal as a sender, and receives audio from the transmission terminal device. The process of distributing only data to other terminals and transmitting the data, and the process of switching the sender, and controlling the communication between the terminals so that only one-to-one communication is performed at the same time as shown in FIG. There is something to do.

[0006]

However, in the above-mentioned first conventional method, as the number of participants in the conference increases, the processing amount in each terminal increases, and the processing cannot be completed. As the number of people increases, the amount of data flowing in the network also increases. For example, in the case of one-to-one, two data flows in both directions, but for three people, 2 × 3 = 6,
For 4 people, 3 × 4 = 12, which is (N−
1) × N data flows in the network.

There is a second method for solving the above-mentioned problem of the first method. However, in order to realize a system, in the current technology, compressed audio data is directly mixed. Therefore, it is necessary to perform a process of decompressing, mixing, compressing again, and transmitting each terminal at the multipoint connection server. Therefore, the amount of processing at the multipoint connection server is significantly increased. When this processing amount is performed only by software on a current computer, the processing amount is too small to be processed. If these processes are forcibly executed by the multipoint connection server, there is a problem that, due to an increase in the processing time, a delay occurs in the voice data sent from the multipoint connection server, and the conference itself becomes inconsistent.

Further, there is a third method for solving the above-mentioned problem of the second method. However, since a dedicated device is required, the system becomes expensive. . In addition, since a dedicated device is used, the maximum number of connectable terminals is fixed by the MCU device, and there is a problem that flexibility as a system is impaired.

Further, in order to solve the above problem, a fourth
However, in such a system, there is a problem that, even though it is a multipoint connection, only one person can talk at the same time, so that usability is significantly reduced. In particular, since calls are half-duplex communication at intervals, there is a case where the user cannot speak when he / she wants to talk, and there is a problem that stress of the conference participants increases.

[0010] The present invention has been made in view of the above points, and in a multipoint connection server, a multipoint connection conference system in which a plurality of participants can simultaneously talk without using a special dedicated device. It is an object of the present invention to provide a configuration method, a multipoint connection conference system, a server device, a client device, and a storage medium storing a multipoint connection conference system configuration program.

[0011]

FIG. 1 is a diagram for explaining the principle of the present invention. The present invention (claim 1) relates to a method for configuring a multipoint connection conference system for performing multipoint voice communication on a network in which a plurality of clients and a server are connected. In a control data packet, register the client as a client participating in the conference, and assign a different voice data packet transfer port number to each client participating in the conference,
Manages (step 1), transmits a control data packet including a voice data packet transfer port number that differs for each client to the client (step 2), and when each client receives the control data packet from the server, A plurality of different audio data packet transfer port numbers are set as audio data packet reception port numbers of the own client (step 3), and the audio data packets received for each audio data reception port number are converted into analog audio data. A plurality of routines are activated (step 4), the processing load state of the client is measured (step 5), and the input voice is transmitted to the server as a voice data packet only when the input voice is a certain volume or higher. And the processing load status of the client The control data packet including to process load state value transmitted to the server (step 6), the server
A processing load state value for each client is received from the client (step 7), the processing load state value is recorded (step 8), and the amount of voice data packets currently being transferred is measured for each client (step 9). The processing load state when the client receives and decompresses the next audio data packet to be transferred is predicted for each client (step 10). If the predicted processing state value is equal to or smaller than a certain value, The voice data packet to be transferred next is transferred as it is, and if it is equal to or greater than a certain value, a part of the voice data packet to be transferred next is not transferred but the rest is transferred (step 11). Adds multiple analog audio data output by the decompression routine to the audio data packet received from the server to one analog audio data. , To play (step 12).

According to the present invention (claim 2), in a server,
The number of clients currently transmitting voice data packets is measured, and a control data packet including the measured number of clients transmitting voice data packets is transmitted to all participating clients, and the client is transmitting voice data packets. The control data packets including the number of clients are received from the server, the decompression routine is activated by the number of clients transmitting the audio data packets, and the activated decompression routine receives the audio data while receiving the audio data packets from the server. Sort by port number.

According to the present invention (claim 3), in the server,
A test packet is transmitted to the client, the client receives the test packet, transmits a response packet corresponding to the reception to the server, and the server receives the response packet from the client, and transmits a test packet transmission time. Calculate the response time for the client to respond from the reception time of the response packet, measure the delay time required for the next voice data packet to be transmitted to reach the client from the response time, and calculate the delay time from the predetermined value If it is smaller, the audio data packet to be transferred next is transferred as it is, and if it is larger than the predetermined value, part of the audio data packet to be transferred next is not transferred and the rest is transferred.

FIG. 2 is a diagram showing the principle of the present invention. The present invention (Claim 4) provides a multipoint connection conference system for performing multipoint voice communication on a network to which a plurality of clients 200 and a server 100 are connected, an IP network interface, and a data communication terminal. Means for receiving a control data packet of a conference holding request or a conference participation request transmitted from the server, a means for registering the data communication terminal which has transmitted the conference holding request or the conference participation request as a client participating in the conference, Means for transmitting a control data packet for the conference holding request or the conference participation request to the server 100, and for converting analog voice data to digital voice data. Converts the digital voice data into voice data packets, and In a system in which a client 200 is a data communication terminal having means for transmitting received voice data packets, converting received voice data packets into digital voice data, and converting the digital voice data into analog voice data, the server 100 A port number management means 120 for assigning a different voice data packet transfer port number to each of the middle clients 200; a control data packet sending means 160 for sending a control data packet including a different voice data packet transfer port to each client 200; Voice packet receiving means 1 for receiving voice data packets transmitted by client 200
40, a voice data packet in which the received voice data packet is transferred to all participating clients other than the source client by the port number management means 120 using the allocated voice data packet transfer port number of the source client 200. Transfer means 150 and client 2
00, a control data packet receiving unit 170 for receiving a control data packet including a processing load status value indicating the processing load status of the own client, and a transfer amount measuring unit 11 for measuring the current transfer amount of each client 200.
2, a load state value predicting unit 111 for predicting a processing load state value when the client 200 receives and decompresses the next audio data packet to be transferred based on the measurement result of the transfer amount measuring unit 112; If the processing load state value predicted by the value prediction unit 111 is equal to or less than a predetermined value,
Voice packet transfer control for transferring the next voice data packet to be transferred as it is and, if the value is equal to or greater than a predetermined value, controlling not to transfer part of the next voice data packet to be transferred but to transfer the rest. The client 200 measures the volume of the input voice, and if the input voice is higher than a predetermined volume based on the measured value, the client 200 converts the input voice into a voice data packet. And the converted voice data packet
0, a processing load state measuring means 240 for measuring the processing load state of the own client, and a control data packet including the processing load state value measured by the processing load state measuring means 240. 100, a control packet receiving unit 221 for receiving a control data packet including a different voice data packet transfer port number for each client, transferred from the server 100, and a different control packet receiving unit 221 for each client. Port number setting means 220 for setting a plurality of voice data packet transfer port numbers as voice data packet reception port numbers of its own client
A decompression routine 210 for converting a received voice data packet into analog voice data, a decompression routine activation means 230 for activating a plurality of decompression routines 210 for each voice data reception port number, and an analog output from the decompression routine 210. A reproduction unit 271 for adding the audio data to one analog audio data and reproducing the same;

According to the present invention (claim 5), in the server 100, a client number measuring means for measuring the number of clients currently transmitting a voice data packet, and a client transmitting a voice data packet based on the measurement result of the client number measuring means. Means for transmitting control data packets including the number of clients transmitting the voice data packets from the server 100; and It has means for activating the decompression routine 210 by the number of clients transmitting data packets, and means for distributing the activated decompression routine 210 for each audio data reception port number during reception of audio data packets from the server 100.

According to the present invention (claim 6), in the server 100, means for transmitting a test packet to the client 200, means for receiving a response packet from the client 200 to the test packet, and transmission time of the search packet Means for calculating a response time required for the client to respond from the reception time of the response packet, means for measuring a delay time required for the next voice data packet to be transmitted to reach the client from the response time, and a delay time If is smaller than a predetermined value, the next audio data packet to be transmitted is transferred as it is, and if larger than the predetermined value, some of the next audio data packets to be transmitted are not transferred and the rest are not transferred. The client 200 has a unit for receiving the inspection packet transmitted from the server 100; And means for transmitting a response packet corresponding to the reception of the test packet to the server 100.

According to a seventh aspect of the present invention, there is provided a multipoint connection conference system for performing multipoint voice communication on a network to which a plurality of clients and servers are connected. A means for receiving a control data packet of a conference holding request or a conference participation request transmitted from a terminal, a means for registering the data communication terminal that has transmitted the conference holding request or the conference participation request as a client participating in the conference, A server device, which is a data communication terminal for operation, comprising: a port number management means for assigning a different voice data packet transfer port number to each client participating in a conference; and a control including a different voice data packet transfer port for each client. Control data packet transmitting means for transmitting a data packet,
The voice packet receiving means for receiving the voice data packet transmitted by the client, and the received voice data packet to the clients participating in all the conferences other than the client of the transmission source, the allocated voice data of the client of the transmission source by the port number management means. A voice data packet transfer unit for transferring the packet by a packet transfer port number, a control data packet receiving unit for receiving a control data packet including a processing load state value transmitted from the client and indicating a processing load state of the own client, A transfer amount measuring unit for measuring the transfer amount of each client, and a load for predicting a processing load state value when the client receives and decompresses the next audio data packet to be transferred based on the measurement result of the transfer amount measuring unit. The processing load predicted by the state value prediction means and the load state value prediction means Status value is equal to or less than a predetermined value,
Voice packet transfer control for transferring the next voice data packet to be transferred as it is and, if the value is equal to or greater than a predetermined value, controlling not to transfer part of the next voice data packet to be transferred but to transfer the rest. Means.

According to the present invention (claim 8), the number of clients measuring means for measuring the number of clients currently transmitting voice data packets, and control including the number of clients transmitting voice data packets as a result of measurement by the number of clients measuring means. Means for transmitting the data packet to all participating clients.

According to the present invention (claim 9), means for transmitting a test packet to a client, means for receiving a response packet from the client for the test packet,
A means for calculating the response time required for the client to respond from the transmission time of the search packet and the reception time of the response packet, and measuring the delay time required for the next transmitted voice data packet to reach the client from the response time If the delay time is smaller than a predetermined value, the next audio data packet to be transferred is directly transferred, and if the delay time is larger than the predetermined value, a part of the next transferred audio data packet is Means for transferring the rest without transferring.

[0020] The present invention (claim 10) provides a multipoint connection conference system for performing multipoint voice communication on a network to which a plurality of clients and servers are connected.
Means for transmitting a control data packet for the conference holding request or the conference participation request to the server, having a network interface, converting analog voice data into digital voice data, and converting the digital voice data into voice data packets; A client device which is a data communication terminal having means for transmitting to the IP network, converting received voice data packets into digital voice data, and converting the digital voice data into analog voice data. A sound measuring / controlling means for measuring the sound volume and converting the input sound into a sound data packet when the input sound is higher than a predetermined sound volume, and sound data for transmitting the converted sound data packet to the server; Measures packet transmission means and processing load status of own client Processing load state measuring means, processing load state value transmitting means for transmitting a control data packet including the processing load state value measured by the processing load state measuring means to the server, and different voices for each client transferred from the server. A control packet receiving means for receiving a control data packet including a data packet transfer port number, and a port number setting for setting a plurality of different voice data packet transfer port numbers for each client as the own client's voice data packet reception port number Means, a decompression routine for converting a received voice data packet into analog voice data, and for each voice data reception port number,
A decompression routine activation means for activating a plurality of decompression routines, and a reproduction means for adding the analog audio data output from the decompression routine to one analog audio data and reproducing the same.

According to the present invention (claim 11), a means for receiving a control data packet including the number of clients transmitting voice data packets from a server, and a means for starting a decompression routine by the number of clients transmitting voice data packets. And means for distributing the activated decompression routine for each audio data reception port number during reception of audio data packets from the server.

The present invention (claim 12) has means for receiving a test packet transmitted from a server, and means for transmitting a response packet corresponding to the reception of the test packet to the server. The present invention (claim 13) relates to a multipoint connection conference system for performing multipoint voice communication on a network in which a plurality of clients and a server are connected.
A means for receiving a control signal for a conference holding request or a conference participation request transmitted from the data communication terminal, the control means having a P network interface, and a data communication terminal transmitting the conference holding request or the conference participation request; Means for registering as a participating client, and a storage medium that stores a multipoint connection conference system configuration program, which is mounted on a server that is a data communication terminal that performs conference management,
A port number management process for assigning a different voice data packet transfer port number to each client participating in the conference; a control data packet sending process for transmitting a control data packet including a different voice data packet transfer port for each client; The voice packet receiving process of receiving voice data packets to be transmitted, and the transfer of the allocated voice data packets of the source client by the port number management process to all participating clients other than the source client in the conference. Voice data packet transfer process to transfer by port number for
A control data packet receiving process that receives a control data packet that includes a processing load status value that indicates the processing load status of its own client, a transfer amount measurement process that measures the current transfer amount of each client, and a measurement result of the transfer amount measurement process On the basis of, the client receives a voice data packet to be transferred next, and a load state value prediction process for predicting a processing load state value when decompressed, and a processing load state value predicted in the load state value prediction process, If the value is equal to or less than the predetermined value, the next audio data packet to be transferred is transferred as it is. If the value is equal to or more than the predetermined value, part of the next audio data packet to be transferred is not transferred and the rest is transferred. And a voice data packet transfer control process.

According to the present invention (claim 14), the number of clients measuring process for measuring the number of clients currently transmitting voice data packets, and the control including the number of clients transmitting voice data packets as the measurement result of the number of clients measuring process. And transmitting the data packet to all participating clients.

The present invention (claim 15) provides a process of transmitting a test packet to a client, a process of receiving a response packet from the client for the test packet, a transmission time of a search packet, and reception of a response packet. A process of calculating a response time required for the client to respond from the time; a process of measuring a delay time required for the next transmitted voice data packet to reach the client from the response time; and a process in which the delay time is longer than a predetermined value. If it is smaller, the next audio data packet to be transferred is transferred as it is, and if it is larger than a predetermined value, a part of the next audio data packet to be transferred is not transferred, but the rest is transferred.

[0025] The present invention (claim 16) relates to a multipoint connection conference system for performing multipoint voice communication on a network to which a plurality of clients and servers are connected.
Means for transmitting a control data packet for the conference holding request or the conference participation request to the server, having a network interface, converting analog voice data into digital voice data, and converting the digital voice data into voice data packets; A multipoint connection conference mounted on a client which is a data communication terminal having means for transmitting to the IP network, converting received voice data packets into digital voice data, and converting the digital voice data into analog voice data. A storage medium storing a system configuration program, wherein a sound measurement / control process for measuring a volume of an input voice and converting the input voice into a voice data packet when the input voice is equal to or higher than a predetermined volume based on the measured value. And send the converted voice data packet to the server. An audio data packet transmission process, a processing load state measurement process for measuring the processing load state of the own client, and a processing load state value for transmitting a control data packet including the processing load state value measured by the processing load state measurement process to the server. A control packet receiving process for receiving a control data packet including a different voice data packet transfer port number for each client transferred from the server, and a different voice data packet transfer port number for each client. A port number setting process for setting a plurality of port numbers for receiving voice data packets, and a decompression routine starting process for starting a plurality of decompression routines for converting received voice data packets into analog voice data for each port number for receiving voice data. , Stretch The analog audio data output from the routine is added to the one analog voice data, and a reproducing process of reproducing.

The present invention (claim 17) provides a process of receiving a control data packet including the number of clients transmitting voice data packets from a server, and a process of starting a decompression routine by the number of clients transmitting voice data packets. And a process of distributing the active decompression routine for each audio data reception port number during reception of audio data packets from the server.

The present invention (claim 18) has a process of receiving a test packet transmitted from a server, and a process of transmitting a response packet corresponding to the reception of the test packet to the server. As described above, in the present invention, the client inputs the remarks of the client user, converts the analog voice data into voice data packets, and transmits the voice data packets to the server. Basically, the server that has received the packet forwards the voice data packet to all clients other than the source client. Then, even when voice data packets are received from a plurality of clients, a plurality of voice data packets are transferred as they are without performing voice mixing as in the conventional multipoint connection conference system, and voice mixing is performed by the client. In such a system, the processing load on the server is reduced, but the processing load on the client is increased, and a multipoint connection conference system cannot be realized only by software.

However, in the present invention, by controlling the voice data packet transferred from the server, an increase in the processing load on the client is suppressed, and the multipoint conference system is realized only by software. In addition, an increase in the number of speakers and an increase in voice data packets to be transferred may cause a delay due to tightness depending on the state of the transmission path. In the multipoint conferencing system according to the present invention, such a problem is also measured by using a time until a search packet is transmitted from the server to the client and a response packet is received from the client, and the delay time is measured. This can be avoided by changing the transfer method of the voice data packet to be transmitted based on the above.

[0029]

FIG. 3 is a diagram for explaining the outline of the operation of the multipoint connection conference system according to the present invention. In the figure, it is assumed that client A and client B are senders, client C is a receiver, and these clients are connected to a server via a network. The server manages a port number management table including a port number for client A, a port number for client B, and a port number for client C as port numbers to be assigned to each client, and a processing load state value of the own client transmitted from the client. , A processing load detection routine to recognize the processing capacity of each client from the current transfer amount to the client,
And a path state detection routine for detecting the state of the transmission path to each client.

Here, the voice data packets A1 to A5 of the client A, which is the sender, are compressed and sent to the server.
1 to B5 are compressed and sent to the server. The client A receives the audio data packet of the client B from the server (using the client port number). The client B receives the audio data packet of the client A from the server (using the port number for the client A). For the client C, the processing load is detected by the processing load detection routine of the server (the client C, which has insufficient processing capability), and some of the audio data packets of the clients A and B are not transmitted. The clients A and B receive, mix, and reproduce the data at the respective set port numbers. As a result, a multipoint connection that allows simultaneous transmission is achieved.

Here, the processing for holding a multi-person participation conference will be described. FIG. 4 shows a sequence of holding a multipoint connection conference system according to the present invention. The data communication terminal A that holds a conference transmits a control data packet including a conference holding command to the server, and issues a conference holding request (step 101). When the server receives this,
Execute a process of managing a conference by the data communication terminal A;
The conference by the data communication terminal A is registered in the ongoing conference list. Then, it regards the data communication terminal A as the client A participating in the conference, and transmits a control data packet including a command of approval for holding to the client A (step 1).
02). At this time, the server assigns a transfer port number of the client A and registers it in the port number management table of the server.

Next, the data communication terminal B participating in the conference
Transmits a conference information request command to the server (step 103), transmits a conference ongoing list in the conference information to the data communication terminal B from the server (step 104), and executes a conference by the client A from the conference ongoing list. Is selected, and a control data packet including a command to join this conference is transmitted to the server (step 105). The server receiving this registers the data communication terminal B as the client B in the process of managing the conference held by the client A, allocates the transfer port number of the client B, and registers it in the port number management table. Then, a control data packet including the conference participation approval command and the port number for client A is transmitted to client B (step 106). Receiving this, the client B sets the transfer port number of the client A as the voice data packet reception port number in its own client.

The server transmits a conference change command and a control data packet including the transfer port number of client B to client A (step 107). Upon receiving this, the client A sets the transfer port number of the client B as the voice data packet reception port number in the client A itself. Next, the data communication terminal C participating in the conference also performs the same processing as the client B, registers as the client C, and includes the conference participation approval command, the transfer port number of the client A, and the transfer port number of the client B. A control data packet is transmitted (step 111). The client C sets these port numbers as the voice data packet receiving port numbers in the client C itself.

Then, client A and client B
Then, the conference change command transmitted from the server and the transfer port number of client C are received (step 11).
2, Step 113), and set the transfer port number of the client C as the voice data packet reception port in the client itself. When the client receives the port number for each client, the client activates an expansion routine for expanding the audio data packet received for each port number into analog audio data.

Next, the transfer sequence of the voice data packet according to the present invention will be described. FIG. 5 shows a transfer sequence of a voice data packet in the multipoint conference system according to the present invention. The processing load detection routine included in the figure receives a packet including the processing load state value from each client, measures the current state and the amount of transfer to each client, and thereby transfers the packet to the next client. With respect to the transfer amount, a processing load state value of the client when it is received is calculated.

The client transmits a voice data packet to the server only when the input voice has a certain volume or more (= when it is determined that voice has been input). Therefore, the voice data packet is transmitted to the server only from the client of the speaking participant. Further, the client transmits a control data packet including a processing load state value indicating the current processing load state of the client to the server.

The server receives and records the processing load state value for each client, and updates it each time a new processing load state value is received. Then, the server calculates the processing load state value when the client receives and expands the next audio data packet to be transferred from the processing load state value and the current transfer amount to each client. Hereinafter, this series of server functions is referred to as a processing load processing routine.

If the calculated processing load state value of the client does not exceed a certain value, the server transfers the voice data packet to be transferred next as it is, and calculates the processing load state value of the client. When the number of voice data packets to be transferred exceeds, part of the next voice data packet to be transferred is not transferred, and the rest is transferred. In other words, the number of audio data packets to be transferred is reduced and the amount of audio data packets that can be processed is transferred to a client with low processing capacity. Then, at the time of transfer, the transfer is performed to all the conference participating clients except the source client by the transfer port number of the source client registered in the port number management table.

When the client receives the voice data packet transferred from the server, the voice data packet receiving port number is set for each source client, so that the voice data is received for each source client. And expand and play. When audio data packets are transmitted from a plurality of clients, the audio data packets are received and decompressed for each source client, mixed, and reproduced. This allows only software
A plurality of simultaneous messages can be heard by each client, and a plurality of simultaneous messages can be heard with little delay even in a client having a low processing load capability.

As another method of starting the decompression routine in the client, the number of clients transmitting voice data packets is measured in the server, and the control data packet including the measurement result is transmitted to the client during the conference. Notify all clients. The client receives the measurement result, and activates the decompression routine for the number of transmitting clients that are the measurement result. Then, a decompression routine is allocated to the port number being received, and the voice data packet is decompressed for each transmission source client. With this method, a method different from the above-described method of starting the decompression routine in the client can be adopted.

Further, when the number of speakers increases and the amount of transfer increases, the transmission path may become tight and delay may occur. Even in such a case, it is possible to reduce the delay by adding the following functions. The server sends a test packet to each client, and upon receipt of each packet, each client returns a response packet. The server receives the response packet, and calculates the response time required for the client to respond from the transmission time of the test packet and the response packet reception time. From the response time, the delay time required for the next audio data packet to be transferred to reach the client is measured (hereinafter, this series of server functions is referred to as a path state detection routine). The server is
If the delay time is smaller than a certain value, the next audio data to be transferred is transferred as it is. I do.

Thus, even when the available bandwidth of the transmission path between the server and the client is narrow, a plurality of simultaneous messages can be heard with little delay.

[0043]

Embodiments of the present invention will be described below with reference to the drawings. [First Embodiment] FIG. 6 shows a system configuration of a first embodiment of the present invention. The system shown in FIG.
0, the port number management table 120 of the server 100, the processing load detection routine 110, the client A200, the client B300, and the client C30.
0, a client D 400 and an intranet / IP network 10.

FIG. 7 shows the configuration of the server according to the first embodiment of the present invention. The server 100 includes a network interface unit 105, a port number management table 120, a voice data packet transfer control unit 130, a voice data packet reception unit 140, a voice data packet transfer unit 150, conference information / conference control command / port number for transfer / information. It comprises a transmission section 160, a conference information control command information reception section 170, a conference operation control section 180, and a transfer port number management section 190.

The processing load detection routine 110 receives a control data packet including a processing load state value transmitted from the client and indicating the processing load state of the own client. A transfer amount measuring unit 112 for measuring the amount, a processing load state value prediction for predicting a processing load state value when the client receives and decompresses the next audio data packet to be transferred from the processing load state value and the transfer amount measurement result. It comprises a unit 111.

The voice data packet transfer control unit 130
A voice data packet thinning process according to the expected processing load state value is performed. That is, if the processing load state value predicted by the processing load state value prediction unit 111 of the processing load detection routine 110 is equal to or smaller than a certain value, the voice data packet to be transferred next is transferred as it is, and the predicted processing If the load state value is equal to or more than a certain value, a part of the voice data packet to be transferred next is not transferred, and the remaining part is transferred.

Voice data packet receiving section 140 receives a voice data packet transmitted by the client. The voice data packet transfer unit 150 transfers the received voice data packet to all participating clients other than the source client by referring to the port number management table 120 with reference to the port number management table 120. Transfer using the port number.

The conference information / conference control command / transfer port number / information transmitting section 160 transmits a control data packet including a voice data packet transfer port number which differs for each client. The conference information control command / information receiving unit 170 receives, via the IP network interface 105, a control data packet of a conference holding request or a conference participation request transmitted from the data communication terminal.

The conference operation control unit 180 registers the data communication terminal that has transmitted the conference hosting request and the conference participation request as a client participating in the conference. The transfer port number management unit 190 allocates and manages a different voice data packet transfer port number on the port number management table 120 for each client participating in the conference.

FIG. 8 shows the configuration of a client according to the first embodiment of the present invention. The configuration of the client shown in FIG.
Although the client 200 will be described as an example, the other clients 300, 400, and 500 have the same configuration. The client 200 includes a decompression routine unit 210, a transfer port number setting unit 220, a conference information / conference control command /
Transfer port number / information receiving section 221, conference information / control command / information transmitting section 222, conference information processing section 223,
Conference information display section 224, decompression routine control section 230, processing load state value measurement section 240, processing load state value transmission section 25
0, voice data packet receiving unit 261, voice input device 2
62, an input audio volume measurement / control unit 263, an input audio conversion unit 264, an audio data packet transmission unit 265, an audio data mixing unit 271, an audio output device 272, and a network interface unit 280.

The conference information / conference control command / transfer port number / information receiving unit 221 receives a control data packet transferred from the server 100 and containing a different voice data packet transfer port number for each client. The transfer port number setting unit 220 sets a plurality of different voice data packet transfer port numbers for each client as voice data packet reception port numbers of the own client.

The conference information display section 224 displays a list of participants of the conference information. The conference information processing unit 223 processes conference information / conference control command / port number for transfer / conference information acquired by the information receiving unit 221. The conference information / control command / information transmitting unit 222 transmits a control data packet of a conference holding request or a conference participation request to the server 100.

The extension routine control section 230 executes the extension routine of the extension routine section 210 for converting the received audio data packet into analog audio data for each audio data reception port number set by the transfer port number setting section 220. Start more than one. The processing load state value measurement unit 240
Measure the processing load status value of the client itself.

The processing load state value transmitting section 250 transmits a control data packet including the processing load response value of the client to the server 100. Input voice volume measurement / control unit 2
63 measures the voice input from the voice input device 262. The input voice conversion unit 264 performs processing such as compression on the input voice.

From the measurement result, the voice data packet transmitting unit 265 determines that the input voice is higher than a certain volume.
The server 100 converts the input voice into voice data packets.
, And if the input audio is below a certain volume,
Do nothing. The audio data mixing unit 271 adds the analog audio data output from the decompression routine unit 210 to one analog audio data and reproduces it.

In the audio output device 272, the audio data mixing section 272 outputs reproduced audio data. In the present embodiment, an example is shown in which the server 100 operates a multipoint conference while detecting the processing load state of each client participating in the conference. LAN1 connected by Ethernet
0, server 100, client A200, client B300, client C400, client D
500 are connected. The server 100 is a personal computer (P) having a network interface.
C), a PC having a client network interface and having a microphone, a speaker, and Internet telephone software.

Clients 200, 300, 400, 5
00, the input voice is considered as a voice data packet only when the input voice is a certain volume or higher, and the server 10
Send to 0. Further, the client transmits a control data packet including a processing load state value indicating the processing load state of the client to the server 100. Server 100
Receives the processing load status value, the processing load detection routine 110 of the server 100 records the processing load status value, and measures the amount of voice data packets currently being transferred for each client. Then, the processing load state when the client receives and expands the voice data packet to be transferred next from them is predicted for each client. If the predicted processing state value is equal to or less than a certain value, the server 100 transfers the audio data packet to be transferred next as it is, and if it is equal to or more than a certain value,
Of the audio data packets to be transmitted next, some are not transmitted, and the rest are transmitted.

The client holds a conference or
The transfer port numbers for each client registered in the port number management table 120 of the server 100 when participating in the conference are “5000” for the client A, “5002” for the client B, and “5002” for the client C.
4 "and the client D is" 5006 ". The transfer port number for each client is notified from the server 100 to all the clients, and the client sets this transfer port number as the port number for the voice data packet reception number in its own client. For example,
In the case of the client A 200, the port number “5002” for the client B and the port number “50” for the client C
04 "and the client D port number" 5006 "are notified from the server 100 and set as the voice data packet receiving port number of the own client.

Then, here, the client D400
Is low, and in the client D400, when two or more decompression routines are simultaneously operated, the CPU usage rate is assumed to exceed 90%. FIG. 9 shows a voice data packet transfer sequence according to the first embodiment of the present invention. While the client A 200 is speaking, the client B 300
Starts transmitting, the audio data packet is transmitted from the client A 200 and the client B 300 to the server 100. The server 100 receives these, refers to the port number management table 120, and checks the client A20
The voice data packet from port number 0 is the port number “500”.
At "0", the voice data packet from the client B300 is transferred to all clients except the transmission source at the port number "5002". At the time of transfer, the server 100 activates the processing load detection routine 110, and predicts the processing load state value when the client receives and expands the next audio data packet to be transferred for each client. When the predicted processing state value is equal to or less than a certain fixed value (the processing load state value is the CPU usage rate, and the certain value is the CPU usage rate 9
0%), the next audio data packet to be transferred is transferred as it is, and if the CPU usage rate is 90% or more, a part of the next audio data packet to be transferred is not transferred. Transfer the rest. By the processing of the processing load detection routine, the server 100
00, if the voice data packets from the client A 200 and the client B 300 are transferred as they are, the CPU usage rate is found to exceed 90%. Do not transfer some, transfer the rest. Other clients still have enough processing power and the CPU usage does not exceed 90%.
0 transfers two voice data packets as they are.

The client A 200 is connected to the client B
The audio data packet transferred by the transfer port number “5002” for the client B is expanded and reproduced by the reception port number “5002” for the client B, and the client B 300
Transmits the voice data packet transferred by the transfer port number “5000” for the client A to the client A
Received at the receiving port number of "5000" for decompression and reproduction. Client C400 and Client D400
Is the transfer port number "5000" for client A
And the transfer port number “5002” for client B
Are received by the reception port number “5000” for the client A and the reception port number “5002” for the client A, respectively, and are decompressed, mixed, and reproduced. Since less voice data packets are transferred to the client D400 with low processing capability, the client D400 also has less delay,
Two voice data packets can be processed, and simultaneous speeches of the two can be heard in real time.

As a result, even a client having a low processing ability can hear a simultaneous utterance of a plurality of persons with little delay,
A multipoint connection conference can be realized only by software. Also,
As another embodiment, a method using the number of clients will be described. FIG. 10 shows the configuration of a server according to another embodiment of the first embodiment of the present invention, and FIG. 11 shows the configuration of a client according to another embodiment of the first embodiment of the present invention. 10 differs from the server configuration in FIG. 7 in that a transfer client number measurement unit 131 and a transfer client number information transmission unit 132 are added.
8 is different from the client configuration in FIG. 8 in that a decompression routine control unit 220 is used instead of the transfer client number information reception unit 290 and the decompression routine control unit 230.
This is a configuration in which a decompression routine control unit 291 having a different function is added.

In the server 100, the number-of-transferred-clients measuring unit 131 measures the number of clients currently transmitting voice data packets, and transmits the number-of-transferred-clients information transmitting unit 13.
2 notifies a control data packet including the measurement result to all clients participating in the conference. Client 200
Receives the measurement result by the transfer client number information receiving unit 290 and activates the decompression routine 210 by the number of transmission clients as the result. Then, the decompression routine 210 is assigned to the port number being received, and the voice data packet is decompressed for each transmission source client.

[Second Embodiment] FIG. 12 shows a second embodiment of the present invention.
1 shows a system configuration of the embodiment. In this embodiment, the server 1
000 shows an example of operating a multipoint conference while detecting the state of the transmission path to each client. A server 1000, a client A2000, a client B3000, a client C4000, and a client D5000 are connected to a LAN 20 connected by Ethernet.

The server 1000 is a PC having a network interface, and the client is a PC having a network interface and has a microphone, a speaker, and Internet telephone software.
The client transmits the input voice to the server 1000 as a voice data packet only when the input voice has a certain volume or higher. Server 1000 transmits a search packet to the client, and receives a response packet from the client to the test packet.

FIG. 13 shows the configuration of a server according to the second embodiment of the present invention. The server 1000 shown in the figure includes a path state detection routine 1 including a delay time prediction unit 1110, a test packet transmission unit 1120, and a response packet reception unit 1130.
100, port number management table 120, voice data packet transfer control section 1300, voice data packet transfer section 1400, voice data packet reception section 1500, conference information / conference control command / port number for transfer / information transmission section 1600, conference information / Control command / information receiving section 170
0, conference operation control unit 1800, transfer port number management unit 1900, and network interface unit 1050
Consists of

In the configuration shown in the figure, the difference from FIG. 7 is the configuration of the route state detection routine 1100.
20 sends an inspection packet to the client 20
00, and based on the response packet received by the response packet receiving unit 1130, the delay time estimating unit 1110
In the above, the delay time is calculated. As a result, the voice data packet transfer control unit 1300 compares the predetermined time with the calculated delay time, and controls the transfer of the voice data packet based on the result.

FIG. 14 shows the configuration of a client according to the second embodiment of the present invention. Client 2000 shown in FIG.
Is a decompression routine unit 2100, a conference information / conference control command / function student port number / information reception unit 2210, a conference information / control command / information transmission unit 2220, a conference information processing unit 2230, a conference information display unit 2240, a decompression routine Control section 2300, inspection packet receiving section 2400, response packet transmitting section 2500, voice input device 2620, input voice volume measurement / control section 2630, input voice conversion section 264
0, an audio data packet transmission unit 2650, an audio data mixing unit 2710, an audio output device 2720, and a network interface unit 2800.

In the configuration shown in the figure, the difference from FIG.
000 is transmitted from the response packet transmitting unit 2500 to the server 1000 to notify the server 1000 that the test packet has been received. The path state detection routine 1100 of the server 1000 calculates the response time required for the client to respond from the transmission time of the inspection packet and the reception time of the response packet. Calculate the delay time required to perform If the calculated delay time is equal to or less than a certain value, the server 1000 transfers the next audio data packet to be transferred as it is. Do not transfer some, transfer the rest.

The client holds a conference or
When participating in the conference, the transfer port numbers for each client registered in the port number management table 1200 of the server 1000 are “5000” for the client A, “5002” for the client B, and “502” for the client C.
04 "and the client D is" 5006 ". The transfer port number for each client is notified from the server 1000 to all the clients, and the client sets the transfer port number as the voice data packet reception port number in its own client.

FIG. 15 shows a voice data packet transfer sequence according to the second embodiment of the present invention. In the figure, for example, in the case of the client A2000, the port number “5002” for the client B, the port number “5004” for the client C, and the port number “50” for the client D
"06" is notified from the server 1000, and is set as the port number for receiving the voice data packet of the own client (steps 301, 302, 303).

Here, it is assumed that the transmission path between the server 1000 and the client D5000 is tight, and that when two voice data packets are transmitted to the client D5000, a large delay occurs. If the client B3000 starts speaking while the client A2000 is speaking, the audio data packet is transmitted from the client A2000 and the client B3000 to the server 1.
000 (steps 304 and 305).

The server 1000 receives these, refers to the port number management table 1200, and
The voice data packet from 2000 has the port number “5”.
000 ", the voice data packet from the client B 3000 is also transferred to all clients participating in the conference other than the transmission source with the port number" 5002 "(step 30).
6, 307, 308, 309). When transferring, server 1
000 starts the path state detection routine 1100 and calculates the delay time required for the next audio data packet to be transferred to reach the client.

In this case, when transferring the audio data packet from the client B 3000, the server 1000 activates the path state detecting routine 1100, and the client A 2000, B 3000, C 4000, D5
Calculate the delay time up to 000. Client A20
In the transmission paths up to 00, B3000, C4000, and D5000, the transmission path is vacant, so this delay time does not exceed a certain value (here, 100 msec). Is already tight, so this delay time is 100ms
exceeds ec. As a result, the server 1000 understands that the transmission path to the client D5000 is currently tight, and does not transfer a part of the next two-sentence voice data packet to the client D5000. Transfer the rest. Since there is still enough bandwidth in the transmission path to another client and the delay time does not exceed 100 msec, the server 1000 transfers the voice data packet of two sentences as it is.

The client A2000 expands and reproduces the audio data packet transferred at the transfer port number "5002" for the client B using the reception port number 5002 for the client B (step 310). The audio data packet transferred at the transfer port number “5000” for A is received at the reception port number “5000” for the client A, and is expanded / reproduced (step 311). The client C4000 and the client D5000 transfer the two voice data packets transferred by the transfer port number “5000” for the client A and the transfer port number “5002” for the client B to the reception port number “5000” for the client A. And the receiving port number “5002” for client A separately,
Playback (steps 312, 313) allows the two people to hear the voice simultaneously.

The transmission path to the client D5000 is tight, and if two voice data packets are transferred as they are, a delay will occur. Since the amount is reduced, the delay can be reduced even in the client D5000, and the statements of the client A2000 and the client B3000 can be heard.

As a result, even on a transmission line where the available bandwidth is small, it is possible to hear simultaneous speeches of a plurality of persons with a small delay, and a multipoint connection conference can be realized only by software.
Also, in the above embodiment, FIGS. 7, 8, 10, and 1
1, the configuration of FIG. 13 and FIG. 14 has been described, but the components of the server and the client shown in these figures are respectively constructed as programs and stored in a storage device of a telephone used as a server or a client, or The present invention can be easily realized by storing it in a portable storage medium such as a floppy disk or a CD-ROM and installing it in the storage device of these telephones when implementing the present invention. Further, it is also possible to store them in a storage device shared with the Internet telephone software of each telephone.

The present invention is not limited to the above embodiment, but can be variously modified and applied within the scope of the claims.

[0078]

As described above, according to the present invention, it is possible to construct a system in which a plurality of participants can simultaneously talk on a server without using a special dedicated device. Become. As a result, a full-duplex multipoint connection conference system can be constructed at low cost.

[Brief description of the drawings]

FIG. 1 is a diagram for explaining the principle of the present invention.

FIG. 2 is a principle configuration diagram of the present invention.

FIG. 3 is a diagram for explaining an outline of an operation of the multipoint connection conference system of the present invention.

FIG. 4 is a sequence for holding a multipoint connection conference system according to the present invention.

FIG. 5 is a transfer sequence of a voice data packet of the multipoint conference system according to the present invention.

FIG. 6 is a system configuration diagram of the first embodiment of the present invention.

FIG. 7 is a configuration diagram of a server according to the first embodiment of this invention.

FIG. 8 is a configuration diagram of a client according to the first embodiment of this invention.

FIG. 9 is an audio data packet transfer sequence according to the first embodiment of the present invention.

FIG. 10 is a configuration diagram of a server according to a second embodiment of this invention.

FIG. 11 is a configuration diagram of a client according to a second embodiment of this invention.

FIG. 12 is a system configuration diagram of a second embodiment of the present invention.

FIG. 13 is a configuration diagram of a server according to a second embodiment of this invention.

FIG. 14 is a configuration diagram of a client according to the second embodiment of this invention.

FIG. 15 is an audio data packet transfer sequence according to the second embodiment of the present invention.

FIG. 16 is an example of a conventional multipoint connection using only terminals.

FIG. 17 is an example of a multipoint connection using a conventional server.

FIG. 18 is an example of a multipoint connection server using a conventional MCU.

FIG. 19 is an example of a conventional talker switching type multipoint connection server.

FIG. 20 is an example of a conventional call switching type multipoint connection server.

[Explanation of symbols]

Reference Signs List 100 server 105 network interface unit 110 processing load detection routine 111 load state value prediction unit, processing load state value prediction unit 112 transfer amount measurement unit, transfer amount measurement unit 113 processing load state value reception unit 120 port number management unit, port number management Table 130 Voice packet transfer control means, voice data packet transfer control section 131 Transfer client number measuring section 132 Transfer client number information transmitting section 140 Voice data packet receiving means, voice data packet receiving section 150 Voice data packet transfer means, voice data packet transfer Unit 160 control data packet transmission means, conference information / conference control command / transfer port number / information transmission unit 170 control data packet reception means, conference information / control command / information reception unit 180 conference operation control unit 90 Transfer Port Number Management Unit 200 Client 210 Decompression Routine 220 Port Number Setting Unit, Transfer Port Number Setting Unit 221 Control Packet Receiving Unit, Conference Information / Conference Control Command / Transport Port Number / Information Receiving Unit 222 Conference Information / Control Command / information transmission section 223 Conference information processing section 224 Conference information display section 230 Decompression routine activation section, Decompression routine control section 240 Processing load state measurement section, Processing load state value measurement section 250 Processing load state value transmission section, Processing load state value Transmission unit 261 Audio data packet receiving unit, audio data packet receiving unit 262 Audio input device 263 Volume measurement / control unit, input audio volume measurement / control unit 264 Audio data packet transmission unit, input audio conversion unit 265 Audio data packet transmission unit 270 Reproduction means 271 Audio data mixing unit 272 Audio output device 280 Network interface unit 290 Transfer client number information reception unit 291 Decompression routine control unit 1000 Server 1050 Network interface unit 1100 Route state detection routine 1110 Delay time prediction unit 1120 Inspection packet transmission unit 1130 Response packet reception unit 1200 port number management table 1300 audio data packet transfer control unit 1400 audio data packet transfer unit 1500 audio data packet reception unit 1600 conference information / conference control command / port number for transfer / information transmission unit 1700 conference information / control command / information reception unit 1800 Conference operation control unit 1900 Transfer port number management unit 2000 Client 2100 Decompression routine unit 2200 Transfer port number Setting section 2210 conference information / conference control command / port number for transfer / information receiving section 2220 conference information / control command / information transmitting section 2230 conference information processing section 2240 conference information display section 2400 inspection packet receiving section 2500 response packet transmitting section 2610 voice Data packet receiving unit 2620 Voice input device 2630 Input voice volume measurement / control unit 2640 Input voice conversion unit 2650 Voice data packet transmission unit 2710 Voice data mixing unit 2720 Voice output device 2800 Network interface unit

──────────────────────────────────────────────────続 き Continuing on the front page (72) Inventor Hiroshi Koyano Nippon Telegraph and Telephone Corporation 3-9-1-2 Nishishinjuku, Shinjuku-ku, Tokyo (56) References JP-A-57-83949 (JP, A) Kaihei 3-124145 (JP, A) (58) Field surveyed (Int. Cl. ⁶ , DB name) H04L 12/18 H04L 12/28 H04L 12/56 H04M 3/56

Claims (18)

(57) [Claims] 1. A multipoint connection conference system configuration method for performing multipoint voice communication on a network in which a plurality of clients and a server are connected, wherein the server controls a conference holding request and a conference participation request from the client. Receiving in a data packet, registering the client as a client participating in the conference, and assigning and managing a different port number for voice data packet transfer for each client participating in the conference, and managing the different voice data packets for each client. A control data packet including a transfer port number is transmitted to the client, and each of the clients, upon receiving the control data packet from the server,
A plurality of audio data packet transfer port numbers different for each client are set as audio data packet reception port numbers of the own client, and audio data packets received for each audio data reception port number are converted into analog audio data. A plurality of decompression routines are started, the processing load state of the own client is measured, and only when the input sound is higher than a certain volume, the input sound is transmitted to the server as a sound data packet, and the own client is transmitted. Transmitting a control data packet including a processing load state value indicating the processing load state to the server, the server receives a processing load state value for each client from the client, and records the processing load state value; Measures the amount of voice data packets currently being transferred for each client Then, the processing load state when the client receives and decompresses the next audio data packet to be transferred is predicted for each client. If the predicted processing state value is equal to or less than a certain value, the next transfer is performed. The voice data packet is transferred as it is, and if it is equal to or greater than a certain value, of the voice data packet to be transferred next, a part of the voice data packet is not transferred, and the remainder is transferred. A method of constructing a multipoint connection conference system, characterized in that a plurality of analog audio data output by the decompression routine for a data packet are added to one analog audio data and reproduced. 2. The server measures the number of clients currently transmitting voice data packets, and transmits a control data packet including the measured number of clients currently transmitting voice data packets to clients participating in all conferences. The client receives the control data packet including the number of clients transmitting the voice data packet from the server;
2. The multipoint connection conference system configuration method according to claim 1, wherein the decompression routine is activated, and the activated decompression routine is allocated to each audio data receiving port number that is receiving an audio data packet from the server. 3. The server transmits a test packet to the client, the client receives the test packet, and transmits a response packet corresponding to the reception to the server, wherein the server Receiving a response packet from the client, calculating a response time for the client to respond from the test packet transmission time and the reception time of the response packet, and determining from the response time that a voice data packet to be transferred next is the The delay time required to reach the client is measured. If the delay time is smaller than a predetermined value, the voice data packet to be transferred next is transferred as it is. 2. The multipoint connection conference system structure according to claim 1, wherein a part of the voice data packets to be transferred is not transferred, but the rest is transferred. Method. 4. A multi-point connection conference system for performing multi-point voice communication on a network in which a plurality of clients and a server are connected, the conference having an IP network interface and being transmitted from a data communication terminal. Means for receiving a control data packet of a request or a conference participation request, means for registering the data communication terminal that has transmitted the conference holding request or the conference participation request as a client participating in the conference, and a data communication terminal for operating the conference. Server
Means for transmitting a control data packet for the conference holding request or the conference participation request to the server, having an IP network interface, converting analog voice data into digital voice data, and converting the digital voice data into voice data packets And transmitting the data to the IP network, converting the received voice data packet into digital voice data, and using the data communication terminal having means for converting the digital voice data into analog voice data as a client. A port number management means for assigning a different voice data packet transfer port number to each client participating in a conference; and a control data packet sending means for transmitting a control data packet including a different voice data packet transfer port for each client. Voice packet receiving means for receiving the voice data packet transmitted by the client; and transmitting the received voice data packet to all participating clients other than the source client by the port number management means. Voice data packet transfer means for transferring data with the assigned voice data packet transfer port number; and control data packet reception for receiving a control data packet including a processing load state value transmitted from the client and indicating a processing load state of the own client. Means, a transfer amount measuring means for measuring the current transfer amount of each client, and a processing load when the client receives and decompresses the next audio data packet to be transferred based on the measurement result of the transfer amount measuring means. Load state value predicting means for predicting a state value; If the processing load state value predicted by the state value predicting means is equal to or less than a predetermined value, the audio data packet to be transferred next is transferred as it is. Voice packet transfer control means for controlling not to transfer a part of the data packet but to transfer the rest, wherein the client measures the volume of the input voice and determines the input voice based on the measured value. If the volume is higher than or equal to, the voice measurement / control means for converting the input voice into voice data packets; voice data packet transmitting means for transmitting the converted voice data packets to the server; Processing load state measuring means for measuring a processing load state value, and a control data packet including a processing load state value measured by the processing load state measuring means to the server. Load state value transmitting means; control packet receiving means for receiving the control data packet including a different voice data packet transfer port number for each client transferred from the server; different voice data packet transfer for each client Port number setting means for setting a plurality of port numbers for use as voice data packet reception port numbers of the own client; a decompression routine for converting received voice data packets into analog voice data; and for each voice data reception port number. A multi-point connection, comprising: a decompression routine activation means for activating a plurality of the decompression routines; and a reproduction means for adding the analog audio data output from the decompression routine to one analog audio data and reproducing the same. Conference system. 5. The server according to claim 1, wherein the server counts the number of clients currently transmitting the voice data packet, and a control data packet including the number of clients transmitting the voice data packet as a measurement result of the client number measurement means. To the client participating in all conferences, the client receiving the control data packet including the number of clients transmitting the voice data packet from the server, and transmitting the voice data packet. Only the number of clients inside,
5. The multipoint connection conference system according to claim 4, further comprising: means for activating the decompression routine; and means for distributing the activated decompression routine for each voice data reception port number during reception of voice data packets from the server. . 6. The server, means for transmitting an inspection packet to the client, means for receiving a response packet from the client for the inspection packet, transmission time of the search packet, and the response packet Means for calculating a response time required by the client for a response from the reception time of the client; means for measuring a delay time required for the next audio data packet to be transmitted to reach the client from the response time; and the delay time If is smaller than a predetermined value, the next audio data packet to be transmitted is transferred as it is, and if larger than the predetermined value, some of the next audio data packets to be transmitted are not transferred and the rest are not transferred. Means for transferring, the client means for receiving the test packet transmitted from the server; Multipoint conferencing system according to claim 4, further comprising a means for transmitting a response packet corresponding to the reception of the test packet to the server. 7. A multipoint connection conference system for performing multipoint voice communication on a network in which a plurality of clients and a server are connected, having a network for an IP network, and holding a conference transmitted from a data communication terminal. Means for receiving a request or a control data packet of a conference participation request, means for registering the data communication terminal that has transmitted the conference holding request or the conference participation request as a client participating in the conference, and a data communication terminal for operating the conference. A server device, a port number management means for assigning a different voice data packet transfer port number for each client participating in a conference; and a control for transmitting a control data packet including a different voice data packet transfer port for each client Data packet transmitting means, and the sound transmitted by the client Voice packet receiving means for receiving a voice data packet, and transferring the received voice data packet to the client who is participating in all the conferences except for the source client by the port number management means. A voice data packet transfer means for transferring the data by a port number for use; a control data packet receiving means for receiving a control data packet transmitted from the client and including a processing load state value indicating a processing load state of the own client; A transfer amount measuring unit for measuring a transfer amount of the client, and a load for predicting a processing load state value when the client receives and decompresses the next audio data packet to be transferred based on the measurement result of the transfer amount measuring unit. State value prediction means; and the processing predicted by the load state value prediction means. If the load state value is equal to or less than a predetermined value, the next audio data packet to be transmitted is directly transmitted. If the load state value is equal to or more than the predetermined value, a part of the next audio data packet to be transmitted is transmitted. And a voice packet transfer control means for controlling the transfer of the rest. 8. A client number measuring means for measuring the number of clients currently transmitting voice data packets, and a control data packet including the number of clients transmitting voice data packets as a result of measurement by the client number measuring means, which is transmitted to all conferences. The server device according to claim 7, further comprising means for transmitting to a participating client. 9. A means for transmitting a test packet to the client, a means for receiving a response packet from the client for the test packet, a transmission time of the search packet, and a reception time of the response packet. A means for calculating a response time required for the client to respond; a means for measuring a delay time required for an audio data packet to be transmitted next to reach the client from the response time; and a predetermined value for the delay time. If the value is smaller than the predetermined value, the voice data packet to be transferred next is transferred as it is. The server device according to claim 7, comprising: 10. A multipoint conferencing system for performing multipoint voice communication on a network in which a plurality of clients and a server are connected, the multipoint connection conference system having an IP network interface, and controlling the conference holding request and the conference participation request. Means for transmitting data packets to the server; converting analog voice data into digital voice data; converting the digital voice data into voice data packets;
A client device which is a data communication terminal having means for transmitting to a P network, converting received voice data packets into digital voice data, and converting the digital voice data into analog voice data. A voice measurement / control means for converting the input voice into a voice data packet if the input voice is higher than a predetermined volume by measuring and measuring the voice data; and voice data for transmitting the converted voice data packet to the server. A packet transmitting unit; a processing load state measuring unit that measures a processing load state of the own client; and a processing load state value that transmits a control data packet including the processing load state value measured by the processing load state measuring unit to the server. Transmitting means, and different audio data for each of the clients transferred from the server. Control packet receiving means for receiving the control data packet including a data packet transfer port number; and a port number for setting a plurality of different voice data packet transfer port numbers for each of the clients as a voice data packet reception port number of the own client. Setting means, a decompression routine for converting received voice data packets into analog voice data, decompression routine activation means for activating a plurality of decompression routines for each of the voice data reception port numbers, and an output from the decompression routine. A client device comprising: reproducing means for adding analog audio data to one analog audio data and reproducing the same. 11. A means for receiving, from the server, the control data packet including the number of clients transmitting the voice data packet;
11. The client apparatus according to claim 10, further comprising: means for activating the decompression routine; and means for distributing the activated decompression routine for each audio data reception port number during reception of an audio data packet from the server. 12. The client device according to claim 10, further comprising: means for receiving the inspection packet transmitted from the server; and means for transmitting a response packet corresponding to the reception of the inspection packet to the server. 13. A multipoint connection conference system for performing multipoint voice communication on a network in which a plurality of clients and a server are connected, a conference having an IP network interface and being transmitted from a data communication terminal. Means for receiving a request or a control data packet of a conference participation request, means for registering the data communication terminal that has transmitted the conference holding request or the conference participation request as a client participating in the conference, and a data communication terminal for operating the conference. A storage medium mounted on a server and storing a multipoint connection conference system configuration program, a port number management process for assigning a different voice data packet transfer port number to each client participating in the conference, Control data packets including different voice data packet transfer ports A control data packet transmission process for receiving the voice data packet transmitted by the client; a voice packet reception process for receiving the voice data packet transmitted to the client; A voice data packet transfer process of transferring the assigned voice data packet transfer port number of the source client in the number management process, and a control including a processing load status value transmitted from the client and indicating a processing load status of the own client. A control data packet receiving process for receiving a data packet, a transfer amount measuring process for measuring the current transfer amount of each client, and a client for transmitting a voice data packet to be transferred next based on a measurement result of the transfer amount measuring process. Receive and expand A load state value prediction process for predicting a processing load state value in the case where the processing load state value predicted in the load state value prediction process is equal to or less than a predetermined value; A voice packet transfer control process that controls to transfer the voice data packet to be transferred as it is and, if the value is equal to or more than a predetermined value, to transfer the remaining portion without transferring a part of the voice data packet to be transferred next. Storage medium storing a multipoint connection conference system configuration program to be executed. 14. A client number measurement process for measuring the number of clients currently transmitting voice data packets, and a control data packet including the number of clients currently transmitting voice data packets as a result of the measurement of the client number measurement process are transmitted to all conferences. The storage medium storing the multipoint connection conference system configuration program according to claim 13, further comprising a process of transmitting to the participating client. 15. A process for transmitting a test packet to the client, a process for receiving a response packet from the client for the test packet, a transmission time of the search packet, and a reception time of the response packet. A process of calculating a response time required for the client to respond; a process of measuring a delay time required for the next transmitted voice data packet to reach the client from the response time; a predetermined value of the delay time If the value is smaller than the predetermined value, the next transmitted voice data packet is transferred as it is. If the value is larger than the predetermined value, a part of the next transmitted voice data packet is not transferred, and the rest is transferred. 14. A storage medium storing the multipoint connection conference system configuration program according to claim 13. 16. A multi-point conferencing system for performing multi-point voice communication on a network in which a plurality of clients and a server are connected, the multi-point conferencing system having an IP network interface, and controlling the conference holding request and the conference participation request. Means for transmitting data packets to the server; converting analog voice data into digital voice data; converting the digital voice data into voice data packets;
A multipoint connection conference system mounted on a client which is a data communication terminal having means for transmitting to a P network, converting received voice data packets into digital voice data, and converting the digital voice data into analog voice data. A storage medium storing a program, wherein a sound measurement / control process for measuring the volume of the input voice and converting the input voice into a voice data packet when the input voice is equal to or higher than a predetermined volume based on the measured value; A voice data packet transmission process of transmitting the converted voice data packet to the server; a processing load status measurement process of measuring a processing load status of the client; and a processing load status value measured by the processing load status measurement process Processing load for transmitting a control data packet containing A status value transmitting process, a control packet receiving process for receiving the control data packet including a different voice data packet transfer port number for each client transferred from the server, and a different voice data packet transfer for each client A port number setting process for setting a plurality of port numbers as port numbers for receiving voice data packets of the client; and a plurality of decompression routines for converting received voice data packets into analog voice data for each of the voice data receiving port numbers. A multipoint connection conference system configuration program, comprising: a decompression routine activation process to be activated; and a reproduction process for adding and reproducing the analog audio data output from the decompression routine to one analog audio data. Storage medium body. 17. A process for receiving, from the server, the control data packet including the number of clients transmitting the voice data packet;
17. The multipoint connection conference system according to claim 16, comprising: a process of activating the decompression routine; and a process of distributing the activated decompression routine for each voice data reception port number during reception of a voice data packet from the server. A storage medium that stores a configuration program. 18. The multipoint connection according to claim 16, comprising: a process of receiving the test packet transmitted from the server; and a process of transmitting a response packet corresponding to the reception of the test packet to the server. A storage medium storing a conference system configuration program.