TWI259723B - Multi-location conference system and method - Google Patents

Abstract

The present invention relates to a multi-location conference system without the need of servers. The multi-location conference system, in which audio data can be exchanged between the terminal B201 and the terminal C202, comprises an audio data inputting part 104, through which audio data can be inputted, and an audio mixing part capable of synthesizing the inputted audio data and audio data received from other terminals. When the terminal B201 is connected to establish a conversation, the audio data received from the terminal A200 and the audio data inputted via the audio data inputting part 104 thereof can be mixed via the audio mixing part 103, and the mixed audio data are sent to the terminal C202.

Description

1259723 IX. Description of the Invention: [Technical Field] The present invention relates to a multi-site conference system and a multi-site conference method in a majority of locations by means of a communication network, in particular, (Internet P r 〇t 〇c ο 1) The network has a multi-site meeting system discussion method that can be held in multiple locations between multiple users. [Prior Art] In recent years, due to the advancement of personal computer technology and the Internet, the method of transmitting the user's voice in a long-distance field, the servo device is connected to a plurality of user terminal devices, and the sound data from the device is used. The voice packet (packet) communication is implemented by the servo device, and the multi-site multi-site conference system is implemented among a plurality of users. Further, in recent years, direct communication is required between the terminal devices of the user, and a conference system between the terminal devices that does not have to be provided by the servo device is proposed. However, it is necessary to have a mesh between all the participating devices. The communication function of the voice packet communication device or the use of the network may be widened (the number of terminal devices that can participate in the conference is limited, so the method for communicating the voice packet communication by the servo device is used. The technical literature of the conference system is as follows: (Patent Document 1) Japanese Patent Laid-Open No. 2 0 0 4 - 1 7 9 7 7 6 312XP / Invention Manual (Supplement) / 9 (07/941 (W91 The call can be made by IP without having to rely on multiple locations. The environment can be borrowed from the user terminal (voice; conference, so voice ring can be used to hold multiple conference terminals, and due to terminal width), In general, for example, a publication 5 1259723 [invention] (Problems to be Solved by the Invention) The prior art multi-site conference system is once received by a servo device. In order to transmit the received voice packet transmission data to the terminal device configured in other multi-sites, the voice packet transmission data sent by the terminal device must increase the number of network devices of the servo device to the number of terminal devices of the servo device. The terminal device that is large and becomes a multi-site conference is limited by the inappropriateness of the network bandwidth allowed by the servo device.

Moreover, in the previous multi-site conference system, the number of terminal devices connected to the servo device is added to the load of the servo device, for example, the processing capacity or the memory amount of the processor is increased, and the terminal becomes a multi-site conference. The number of devices is limited by the processing power of the servo device or the unsuitable amount of memory. SUMMARY OF THE INVENTION An object of the present invention is to provide a multi-site conference system and a multi-site conference method which can eliminate the inconvenience of the prior art without performing a multi-site conference by means of a servo device. (Means for Solving the Problem) In order to achieve the above object, the present invention is a multi-site conference system in which voice data is exchanged between a plurality of terminal devices, and the first feature is that the terminal device is provided with a sound capable of inputting sound data. a data input unit; and a sound mixing unit that synthesizes the sound data input by the sound input unit and the sound data received by the other terminal device; and the plurality of terminal devices establish a dialogue with a terminal device Then, the sound mixing unit mixes the sound data received from the other terminal devices other than the aforementioned terminal device and the voice data input by the voice data input unit used by the user. 6 312XP/Invention Manual (supplement)/94-07/94107491 1259723, the action of sending the mixed sound data to the other terminal device. Furthermore, the present invention is a multi-site conference system in which a conference room area including a plurality of terminal apparatuses and a conference room area including a plurality of terminal apparatuses on the other side are interchangeable, and the second feature is that At least one of the terminal devices in the one side and the other of the conference room areas includes: a voice data input unit that can input voice data; and a sound data input by the voice input unit and other terminal devices a sound mixing unit for the received sound data; a terminal device including the sound mixing unit in the one and the other conference room areas, and when a dialogue is established with another terminal device in the own conference room area, The sound mixing unit mixes the sound data received by the other terminal devices in the own conference room and the sound data input by the voice data input unit, and transmits the mixed sound data to the conference room on the other side. The operation of the terminal device including the sound mixing unit in the area.

Furthermore, the present invention is characterized in that, in the multi-site conference system of the first or second aspect of the above-mentioned patent application, the third feature is that the terminal device is utilized for implementing the solution of the voice code and the notification of the IP address and the 埠 number. The dialogue begins with the agreement to establish the interlocutor. Furthermore, the present invention provides a multi-site conference method for exchanging voice data between a plurality of terminal devices, wherein the terminal device includes a voice data input unit that can input voice data; and a sound mixing unit for the sound data input by the sound input unit and the sound data received by the other terminal device; wherein the plurality of terminal devices are executable: 7 312XP/invention specification (supplement)/94-07/94107491 1259723 a step of a terminal device conversation; and a step of mixing the voice data received by the terminal device other than the terminal device and the voice data input by the voice data input unit by the voice mixing unit; and, for the other terminal The step of the device transmitting the mixed sound data.

Further, the present invention is a multi-site conference method in which a conference room area including a plurality of terminal apparatuses and a conference room area including a plurality of terminal apparatuses on the other side are interchangeable, and a fifth feature is that At least one of the terminal devices in the one side and the other side of the conference room is provided with a voice data input unit that can input voice data; and, the sound data input by the voice input unit and the sound received by the other terminal device can be synthesized. a sound mixing unit of the data; the terminal device including the sound mixing unit in the one and the other conference room areas, when a dialogue is established with another terminal device in the own conference room area, the sound mixing unit may Mixing the sound data received by the other terminal devices in the own meeting room and the sound data input by the own voice data input unit, and then transmitting the mixed sound data to the other party room area containing the sound The operation of the terminal device of the mixing unit. Further, according to the present invention, in the multi-site conference method according to the fourth or fifth aspect, the sixth aspect is characterized in that the terminal device is configured to perform voice code resolution and notification of an IP address and a UI number. The dialogue begins with the agreement to establish the interlocutor. Furthermore, the present invention is characterized in that, in a multi-site conference in which a plurality of terminal devices can exchange audio data, the seventh feature is that the terminal device has: 8 8 ] 2XP / invention manual (supplement) / 94-07 /9410749 ]

1259723 a sound data input unit for sound data; and a sound data input unit that is input by the sound input unit and a sound data sound unit that is received by another terminal device; the plurality of terminal devices are executable: establishing and ending the device a step of conversing; and a step of mixing the sound data received by the terminal device other than the terminal device and the sound data input by the user using the audio data input unit by the sound mixing unit; and transmitting the sound data input by the terminal device The steps of the mixed sound data. According to the present invention, when the terminal device establishes a dialogue with a certain terminal device, the sound mixing unit inputs the sound data received by the other terminal device other than the aforementioned terminal device and the sound input by the own voice data input unit. The data is mixed, and the mixed sound data is sent to the other terminal devices, so that the server can be installed only in the terminal location without the servo device. [Embodiment] Hereinafter, a multi-site conference system and a multi-site conference method according to an embodiment of the present invention will be described in detail with reference to the drawings. Fig. 1 is a view showing a configuration of a terminal device according to the present embodiment, Fig. 2 is a view showing a first example of transmission of sound data between terminal devices according to the present embodiment, and Fig. 3 is a view showing a mixture example of sound data of each terminal in the embodiment. FIG. 4 is a view showing an example of establishing a dialogue of a multi-site conference having a minimum configuration of the multipoint conference system according to the present embodiment. FIG. 5 is a diagram showing an example of establishing a multi-site conference conversation composed of three terminal apparatuses according to the present embodiment. Fig. 6 is a view showing an example of establishing a dialogue of a multi-station conference in which six terminals are formed in the embodiment, and Fig. 7 shows an end of the present embodiment 3] 2XP/invention specification (supplement)/94-07/94107491 The sound is the sound of the sound of the ground state of the configuration 9 1259723 using the terminal device combined with the two conference dialogue establishment example.

The present embodiment is applied to the terminal device 1000 of the multi-site conference system. As shown in FIG. 1, the terminal device 100 is provided with a dialog control unit that can control the establishment of a dialogue with another terminal device, and can be input to the user. The voice input unit of the voice 1 0 4 ; and the sound output unit 1 0 5 that can receive the sound received by the other terminal device; and the transmission and reception can be performed between the terminal devices and other terminal devices that establish the dialogue The sound transmission unit 1 0 2 of the sound data; and the sound mixing unit 10 that mixes the sound data input by the sound input unit 104 of the present embodiment with the sound data received by another terminal device. 3; and through the IP network 1 0 6 and other terminal devices continue. Next, the operation of the multi-site conference system in which the terminal device thus constructed is connected to three terminals will be described with reference to FIG. 2 shows that the multi-site conference system is composed of the terminal device A 200 and the terminal device B 021 and the terminal device C 2 0 2, and the voice data input by the terminal device A 200 and the terminal device B 201 is transmitted to the terminal. The device C 2 0 2 performs sound output at the terminal device C 2 0 2, as an example. In the multi-site conference system, first, the terminal device B 2 0 1 establishes a dialogue between the terminal device A 2 0 0 and the terminal device C 2 0 2 . This session uses a general call control protocol such as the Session Initiation Protocol (SIP) to implement the resolution of the voice code necessary for transmitting and receiving voice data or the IP address or 埠 (ρ 〇rt ) number of the transmission location. Notifications, etc. Next, in the present system, the terminal device A 2 0 0 is connected to the terminal sound by the voice transmitting unit 1 0 2 10 312XP/invention specification (supplement)/94-07/94107491 1259723. 1 0 5 interface,

The action of transferring the sound device is actually daisy-chained into the sound of the chrysanthemum and then transferred from the other to the sound of the re-spinning. The local multi-device B 2 0 1 transmits its own material input by the voice input unit 104, and the terminal device B 2 0 1 that receives the data receives the received sound information of the machine A and uses its own voice. The input unit 1 0 4 transmits the terminal B sound data. The sound is mixed by the sound mixing unit 1 0 3 , and the mixed "terminal A + B sound data" C 2 0 2 is transmitted to the terminal, and the terminal receiving the data is received. The device C 2 0 2 then uses the sound output to appropriately output the received "terminal A + B sound data" to perform such output operations. In this example, the example of the audio data from the terminal device A 2 0 0 to the terminal device C 2 0 2 is described. However, the voice data is transferred from the terminal C 2 0 2 to the terminal device A 2 0 0 in the same manner as in the above embodiment. At the same time, the multi-site conference system for the same configuration is to establish a dialogue by connecting a plurality of terminal devices daisy-chai η (the rosary link), and the terminal device located at the middle of the chain can be from the terminal at the same time. The sound data received by the device and the sound data input by the terminal device are mixed with other terminal devices, and the sound data received by the device and the sound data input by the device are combined to other devices by the terminal device located in the middle. The terminal device can output the portion sent by each terminal device to another terminal device, and as a result, it is not necessary to use a servo device to implement a multi-site conference. Referring to FIG. 3, a multi-site multi-site conference system according to another embodiment of the present invention is described. As shown in FIG. 3, a conference is started by five terminal mechanisms, and the terminal device A 200 and the terminal device D 2 0 3 are connected. , 3] 2XP / invention manual (supplement) /94-07/94107491 11 1259723 terminal device B 2 01 and terminal device E 2 Ο 4 phase connection, further, terminal device A 2 0 0 and terminal device Β 2 0 1 and The terminal device Ε 2 0 4 is connected.

In the multi-site conference system thus constituted, the terminal device A 200 mixes (synthesizes) the "terminal A sound data" input by itself and the "terminal D sound data" received by the terminal device D 203. "Terminal A + D sound data" is sent to the terminal device B 2 01, and the terminal device B 2 0 1 that has received the data again inputs the "terminal B sound data" input by itself and the aforementioned "terminal A + "D sound data" and "terminal A + B + D + E sound data" mixed by "terminal E sound data" received by the terminal device E 2 0 4 are transmitted to the terminal device C 2 0 2, and at the same time, The terminal device E 2 0 4 transmits the "terminal A + D sound data" and the "terminal C sound data" received by the terminal device A 200 and the terminal device B 0 0 1 and the "terminal" input by itself. "By sound data" is mixed with "Terminal A + B + C + D sound data". In other words, when the terminal device of the present embodiment establishes a dialogue with the "some terminal device", the voice data received by the other terminal device can be mixed with the voice data input by the terminal device in addition to the "some terminal device". By transmitting the mixed audio data to the other terminal device, the multi-site conference can be performed by using the server to transmit all the sounds generated by the respective terminal devices to the other terminal devices. Next, another operation of the connection configuration of the terminal device of the present embodiment will be described with reference to Fig. 4 and subsequent drawings. First, FIG. 4 is a block diagram showing a terminal structure of a multi-site conference having the smallest configuration in the present embodiment. In the case of the present example, the terminal device A 200 and the terminal device B 2 01 respectively transmit their own voices. Two terminals constitute a multi-site conference, which is not sent to the terminal device on the receiving side. 12 312XP/Invention Manual (supplement)/94-07/94107491

1259723 The mixed sound data is sent, so the voice action is not implemented. Fig. 5 shows the configuration of the multi-site conference in which the terminal device B 021 establishes a conversation in the state of Fig. 4. When C 2 0 2 establishes a dialogue with the terminal device A 2 0 0, or the Β terminal device 0 2 0 1 establishes the dialogue device 终端 2 0 1 to the terminal device C 2 0 2 from other terminal devices A 2 0 0 The received voice data and the voice input by itself® are transmitted to the terminal device A 200 to perform a multi-site conference. Fig. 6 shows a state in which the terminal device • E 2 0 4 re-establishes the dialogue with the terminal device A 2 0 0 in the state of Fig. 5, and re-establishes the dialogue with the terminal device C 2 0 2 to participate in the state. In the case of the present embodiment, the terminal device E 2 0 4 /terminal device F 2 0 5 corresponds to the other terminal device other than the terminal device A 200 and the terminal device "a certain terminal device" in the above-mentioned "one session". It is mixed with the voice data input by itself, and is transmitted by the action of sending the material to the other terminal devices. When the multi-site conference system and the terminal device of the present embodiment establish a dialogue with the "a certain terminal device", the audio data input from the other terminal devices other than the "Bell 1 terminal device" is mixed, and the mixed 312XP/ BRIEF DESCRIPTION OF THE INVENTION (SUPPLEMENT) /94-07/94107491 A multi-location of sound mixing will be a C 2 0 2 pair of terminal devices. In this example, the terminal device winter end device A 2 0 0 or at the end, as described above, the terminal or terminal device When the C 2 0 2 data is mixed, and the C 2 0 2 or the terminal is equipped with the D 2 0 3 and the terminal device], the terminal device F 2 0 5 has the existing multi-site conference D 2 0 3 / terminal device terminal device. In addition, it is true that the C202 will be able to implement a multi-site method in addition to the sound data received as described above, and each of the final Js may send the sound data of the sent voice and the self-contained sound data. 13

1259723 When the operation is sent to the other terminal device, it is not necessary to use the servo device to transmit all the sounds transmitted from the respective terminal devices to the other terminal device. Fig. 7 shows a composition diagram in which a conference A 2 1 0 and a conference B 2 1 1 are combined. In the case of the present embodiment, the terminal device B 2 0 1 to which the conference A 2 1 0 belongs is established by the terminal D 2 0 3 to which the conference B 2 1 1 belongs, the terminal device B 2 0 1 and the terminal device D 2 0 3 corresponds to "a certain terminal device". After the dialogue between the two conferences, the terminal device B 2 0 1 transmits the voice data from the terminal device and the terminal device C 2 0 2 to the voice information input by the terminal device. The terminal device D 2 0 3 of the conference B 2 1 1 , at the same time, the terminal D 2 0 3 mixes the sound data from the terminal device E 2 0 4 with the input audio data and transmits it to the terminal device of the conference A 2 1 0 B 2 0 1, if a multi-site meeting can be implemented. As described above, in the multi-site conference system and method of the present embodiment, there is no limitation on the topology of the conversation (t ο ρ ο 1 〇 gy ), and the dialogue can be established in any of the conference systems, and the terminal device participating in the conference will be established. The terminal device of the conversation transmits each voice material, and the terminal device receives the voice data. When there are two or more conversations, the voice data is mixed and transmitted to the terminal device that establishes the conversation, so that all the terminal devices can receive the voice device. The sound data is received by all terminal devices, so that multiple locations can be called. BRIEF DESCRIPTION OF THE DRAWINGS Fig. 1 is a block diagram showing a configuration of a terminal according to an embodiment of the present invention. Fig. 2 shows the first setting of the sound data between the terminal devices of the present embodiment, and the final end of the device is finally confirmed to be the sound of the A20 0 14 mixing device, and the special configuration is the other end mounting, and the 312XP/ Invention specification (supplement) /94-07/94107491 14

(Fig. 3 is a view showing an example of the mixing between the terminal devices of the embodiment. Fig. 4 is a view showing an example of establishing a dialogue for a multi-site meeting with a minimum configuration. Fig. 5 shows a plurality of locations by three terminals. Fig. 6 is a diagram showing an example of establishing a dialog for a multi-site conference by six terminals. Fig. 7 is a diagram showing an example of establishing a dialog for combining two conferences. Φ [Description of main component symbols] 1 00 terminal Device 10 1 dialog control unit - 10 2 voice transmitting unit 10 3 sound mixing unit 1 04 voice input unit 1 05 sound output unit 10 6 network

2 0 0~2 0 5 terminal device 210 Conference A

2 1 1 Conference B 15 312XP / Invention Manual (supplement) /94-07/94107491

Claims (1)

1259723 X. The scope of application for patents: 1. A multi-site conference system, in a multi-site conference system in which a plurality of terminal devices can exchange sound data, wherein the terminal device includes: a voice data input unit that can input voice data; and can synthesize and use the voice a sound mixing unit for inputting sound data and a sound data received by another terminal device; wherein the plurality of terminal devices are implemented, and when a dialogue with a certain terminal device is established, the sound mixing unit removes the The sound Φ data received from another terminal device other than the terminal device is mixed with the voice data input by the voice data input unit, and the mixed sound data is transmitted to the other terminal device. a multi-site conference system in a conference room area containing one of a plurality of terminal devices; and a multi-site conference system in which sound data is exchanged between conference room areas on the other side of a plurality of terminal devices, The at least one terminal device in the conference room area on the one side and the other side is provided with: a voice data input unit that can input voice data; and the voice data input by using the voice input unit and other a sound mixing unit that synthesizes the sound data received by the terminal device; and when the terminal device including the sound mixing unit in the one and the other meeting room areas establishes a dialogue with another terminal device in the own conference room area, And the sound mixing unit mixes the sound data received by the other terminal devices in the own conference room area with the sound data input by the input unit of the voice data, and then sends the mixed sound data to the foregoing The mobile device with the sound mixing unit on the side of the conference room area 16 312XP / hair Description (up member) / 94-07 / 94107491 1259723. 3. In the multi-site conference system of claim 1 or 2, the terminal device uses a dialogue start agreement to establish a dialogue for performing the resolution of the voice code and the notification of the IP address code. 4. A multi-site conference method, in a multi-site conference method for vocal data between a plurality of terminal devices, characterized in that: the terminal is provided with: a voice data input unit capable of inputting voice data; and a sound data portion a sound mixing unit that is combined with sound data synthesized by other terminal devices; and the plurality of terminals: a step of establishing a dialogue with a terminal device; and a sound mixing of the terminal device The step of receiving the data by the terminal device and the voice resource input by the input unit of the voice data; and transmitting the mixed material to the other terminal device. a multi-site conference method in a conference room area including a plurality of terminal devices; and a multi-site conference method in which voice data is exchanged between another conference room area including a plurality of terminal devices, At least one of the meeting room areas on one side and the other side is provided with: a sound data input unit that can input sound data; and a sound data that can be synthesized by the sound input unit and sound data that is received by other terminals. a mixing unit; in the terminal device including the sound mixing unit in the one side and the other meeting room area, when the other terminal device in the conference room area has a dialogue established, the mixing unit will be the other terminal in the own conference room area. The device and the nickname interchangeable sound device use the receiving device to integrate the sound material with one of the sound components, and the terminal of the sound device is installed, and the terminal is installed and connected with the sound by itself. 312XP/ Invention manual (supplement) /94-07/94107491 17 (S 1259723 received sound data and self-use voice data input department The incoming sound data is mixed, and the mixed sound data is sent to the terminal device including the sound mixing unit in the conference room area on the other side. 6. If the patent application is in the 4th or 5th place meeting The method, wherein the terminal device uses a dialog start agreement to establish a dialogue for performing voice code resolution and notification of an IP address and a 埠 number. 18 312XP/Invention Manual (supplement)/94-07/94107491