CN105847096B

CN105847096B - A kind of communication means comprising audio data, apparatus and system

Info

Publication number: CN105847096B
Application number: CN201610321348.XA
Authority: CN
Inventors: 梁俊斌
Original assignee: Tencent Technology Shenzhen Co Ltd
Current assignee: Tencent Technology Shenzhen Co Ltd
Priority date: 2016-05-12
Filing date: 2016-05-12
Publication date: 2018-10-30
Anticipated expiration: 2036-05-12
Also published as: CN105847096A

Abstract

The embodiment of the invention discloses the communication means comprising audio data, apparatus and systems, are applied to field of communication technology.Main body machine in the sub- meeting-place of first audio is established and the first communication link of other clients in the sub- meeting-place of the first audio respectively, the first audio signal of reception is sent to other clients in the sub- meeting-place of the first audio by the first communication link main body machine, other clients are synchronously received to the first audio signal, if main body machine plays first audio signal again after the fixed response time for receiving the first audio signal, so that the first audio signal of all clients broadcasting tends to be synchronous substantially in a sub- meeting-place of audio, and the audio signal for the audio signal that first audio signal is the sub- meeting-place of other audios, thus will not due to play the sound in the sub- meeting-place of this audio in a sub- meeting-place of audio and lead to the problem of acoustic feedback utter long and high-pitched sounds with it is nonsynchronous.So that the portable terminals such as mobile phone may be used in the client in each sub- meeting-place of audio.

Description

A kind of communication means comprising audio data, apparatus and system

Technical field

The present invention relates to field of communication technology, more particularly to a kind of communication means comprising audio data, apparatus and system.

Background technology

Audio conferencing has a very wide range of applications demand in office and life, in this way the user of different geographical can be with It is added in same audio conferencing and is conversed using respective conference terminal, the multi-person speech exchange for solving different geographical is asked Topic is that more people respectively can using a conference terminal with a distant place at same meeting-place (such as in a meeting room) than more typical scene Field carries out speech exchange, and the scene proposes two requirements to conference terminal：The broadcast sound volume of conference terminal is sufficiently large, can allow meeting Listener in can hear, while conference terminal pickup effect wants especially good, because spokesman may defection view in meeting-place It is even farther that the air line distance of terminal reaches 5m.

The scheme of existing comparative maturity is dedicated conference terminal, such as the conference terminal of polycom, the conference terminal Use larger-size loud speaker, it is ensured that sound is sufficiently large, while using multiple microphones (3 or more), conventional pickup distance Within 5m, in order to reach better pickup effect, conference terminal provides external microphone expansion module, which is logical Wired connection separate microphone pickup module and host are crossed, independent microphone module can be placed on close to the position of spokesman, To improve pickup effect closer to apart from pickup.But existing conference terminal equipment cost is higher and inconvenient to carry.

Invention content

The embodiment of the present invention provides a kind of communication means comprising audio data, apparatus and system so that the first audio Other clients that first audio signal of reception is uniformly sent to the sub- meeting-place of the first audio by first client in meeting-place carry out It plays.

The first aspect of the embodiment of the present invention provides a kind of communication means including audio data, is applied to include audio number According to communication system in the first client, first client belongs to the sub- meeting-place of the first audio, the method includes：

Establish respectively and the sub- meeting-place of the first audio in the first communication link between other clients；

The first audio signal is received, first audio signal is other audios except the sub- meeting-place of the first audio The audio signal of the audio signal in meeting-place；

First audio signal other clients are sent respectively to by first communication link to broadcast It puts；

First audio signal is played after the preset time delay after receiving first audio signal, it is described predetermined Time delay is the network delay mean value to other clients.

The second aspect of the embodiment of the present invention provides a kind of communication means including audio data, is applied to include audio number According to communication system in the second client, second client belongs to the sub- meeting-place of the first audio, the method includes：

The first communication link between main body machine in foundation and the sub- meeting-place of the first audio；

The first audio signal is received by first communication link, first audio signal is first audio The audio signal of the audio signal in the sub- meeting-place of other audios except meeting-place；

Play first audio signal.

The third aspect of the embodiment of the present invention provides a kind of communication means including audio data, and the method is applied to packet Audio mixing equipment in communication system containing audio data, including：

The main body machine in multiple sub- meeting-place of audio is determined respectively；

The audio signal in the sub- meeting-place of the multiple audio and the identification information in the sub- meeting-place of corresponding audio are received respectively；

According to the identification information in the sub- meeting-place of the audio, will in the sub- meeting-place of the multiple audio except the sub- meeting-place of the first audio it The audio signal in the outer sub- meeting-place of other audios carries out audio mixing and obtains the first audio signal；

First audio signal is sent to the main body machine in the sub- meeting-place of the first audio, so that the main body machine is by institute Other clients that the first audio signal is sent in the sub- meeting-place of the first audio are stated to play out.

The fourth aspect of the embodiment of the present invention provides a kind of communication device including audio data, and described includes audio data Communication device belong to the sub- meeting-place of the first audio, including：

First link establishment unit, for establish respectively and the sub- meeting-place of the first audio between other clients the One communication link；

Signal receiving unit, for receiving the first audio signal, first audio signal is the first audio son meeting The audio signal of the audio signal in the sub- meeting-place of other audios except；

First signal transmitting unit, for being sent respectively to first audio signal by first communication link Other clients play out；

Broadcast unit, for playing first audio mixing after the preset time delay after receiving first audio signal Signal, the preset time delay are the network delay mean value to other clients.

5th aspect of the embodiment of the present invention provides a kind of communication device including audio data, and described includes audio data Communication device belong to the sub- meeting-place of the first audio, including：

Link establishment unit, for establish and the sub- meeting-place of the first audio in main body machine between the first communication chain Road；

Audio mixing receiving unit, for receiving the first audio signal, the first audio mixing letter by first communication link Number for the sub- meeting-place of other audios except the sub- meeting-place of the first audio audio signal audio signal；

Signal broadcast unit, for playing first audio signal.

6th aspect of the embodiment of the present invention provides a kind of communication device including audio data, including：

Determination unit, the main body machine for determining the sub- meeting-place of multiple audios respectively；

Receiving unit, the mark of audio signal and the sub- meeting-place of corresponding audio for receiving the sub- meeting-place of the multiple audio respectively Know information；

Mixing operation unit will be in the sub- meeting-place of the multiple audio for the identification information according to the sub- meeting-place of the audio The audio signal in the sub- meeting-place of other audios in addition to the sub- meeting-place of the first audio carries out audio mixing and obtains the first audio signal；

Audio signal transmission unit, the main body for first audio signal to be sent to the sub- meeting-place of the first audio Machine carries out so that first audio signal is sent to other clients in the sub- meeting-place of the first audio by the main body machine It plays.

7th aspect of the embodiment of the present invention provides a kind of communication system include audio data, including audio mixing equipment with it is more A sub- meeting-place of audio, each sub- meeting-place of audio includes multiple client in the multiple sub- meeting-place of audio, the multiple client Include the first client and multiple second clients；

The audio mixing equipment be such as the embodiment of the present invention the 6th in terms of as described in the communication device for including audio data；

First client is the communication device for including audio data as described in fourth aspect of the embodiment of the present invention；

Second client be such as the embodiment of the present invention the 5th in terms of as described in the communication device for including audio data.

Eighth aspect of the embodiment of the present invention provides a kind of system including audio data, including two sub- meeting-place of audio, institute It states each sub- meeting-place of audio in two sub- meeting-place of audio and includes the first client and multiple second clients, wherein：

As it can be seen that in the method for the present embodiment, the master in the communication system comprising audio data in any sub- meeting-place of audio Body machine (such as first client in the sub- meeting-place of the first audio) establishes the with other clients in the sub- meeting-place of the first audio respectively One communication link, the in this way standard deviation due to the network delay of other clients in the sub- meeting-place of the first client to the first audio It is smaller so that other clients can be synchronously received to the first audio signal substantially, if the first client is receiving First audio signal is played after one fixed response time of one audio signal again, so that all clients in the sub- meeting-place of the first audio It plays the first audio signal and tends to be synchronous substantially, and the audio mixing for the audio signal that first audio signal is the sub- meeting-place of other audios Signal thus will not generate acoustic feedback and utter long and high-pitched sounds and not due to playing the sound in the sub- meeting-place of this audio in a sub- meeting-place of audio It is synchronous.In this way since the method for the embodiment of the present invention can effectively inhibit the problem of uttering long and high-pitched sounds so that the visitor in each sub- meeting-place of audio The portable terminals such as mobile phone may be used in family end, and without the terminal of dedicated voice communication, reduce the cost of voice communication.

Description of the drawings

In order to more clearly explain the embodiment of the invention or the technical proposal in the existing technology, to embodiment or will show below There is attached drawing needed in technology description to be briefly described, it should be apparent that, the accompanying drawings in the following description is only this Some embodiments of invention without having to pay creative labor, may be used also for those of ordinary skill in the art With obtain other attached drawings according to these attached drawings.

Fig. 1 a are a kind of structural schematic diagrams of the communication system comprising audio data in the embodiment of the present invention；

Fig. 1 b are the structural schematic diagrams of another communication system comprising audio data in the embodiment of the present invention；

Fig. 2 is a kind of flow chart for communication means comprising audio data that the method for the present invention embodiment one provides；

Fig. 3 a are the one of the main body machine that first client is determined as the sub- meeting-place of the first audio in the method for the present invention embodiment one Kind method flow diagram；

Fig. 3 b are the another of the main body machine that first client is determined as the sub- meeting-place of the first audio in the method for the present invention embodiment one A kind of method flow diagram；

Fig. 4 is a kind of flow chart for communication means comprising audio data that the method for the present invention embodiment two provides；

Fig. 5 is a kind of flow chart for communication means comprising audio data that the method for the present invention embodiment three provides；

Fig. 6 is a kind of flow chart for communication means comprising audio data that the method for the present invention example IV provides；

Fig. 7 is a kind of flow chart for communication means comprising audio data that the method for the present invention embodiment five provides；

Fig. 8 is a kind of structural schematic diagram for communication device comprising audio data that present device embodiment one provides；

Fig. 9 is the structural representation for communication device of the another kind comprising audio data that present device embodiment one provides Figure；

Figure 10 is a kind of structural schematic diagram for communication device comprising audio data that present device embodiment two provides；

Figure 11 is the structural representation for communication device of the another kind comprising audio data that present device embodiment two provides Figure；

Figure 12 is a kind of structural schematic diagram for communication device comprising audio data that present device embodiment three provides；

Figure 13 is a kind of structural schematic diagram for communication device comprising audio data that present device embodiment three provides；

Figure 14 is a kind of structural schematic diagram for communication device comprising audio data that present device example IV provides.

Specific implementation mode

Following will be combined with the drawings in the embodiments of the present invention, and technical solution in the embodiment of the present invention carries out clear, complete Site preparation describes, it is clear that described embodiments are only a part of the embodiments of the present invention, instead of all the embodiments.It is based on Embodiment in the present invention, those of ordinary skill in the art are obtained every other without creative efforts Embodiment shall fall within the protection scope of the present invention.

Term " first ", " second ", " third " " in description and claims of this specification and above-mentioned attached drawing The (if present)s such as four " are for distinguishing similar object, without being used to describe specific sequence or precedence.It should manage The data that solution uses in this way can be interchanged in the appropriate case, so that the embodiment of the present invention described herein for example can be to remove Sequence other than those of illustrating or describe herein is implemented.In addition, term " comprising " and " having " and theirs is any Deformation, it is intended that cover not exclusively include, for example, containing the process of series of steps or unit, method, system, production Product or equipment those of are not necessarily limited to clearly to list step or unit, but may include not listing clearly or for this The intrinsic other steps of processes, method, product or equipment or unit a bit.

The method of the present invention embodiment one

A kind of communication means including audio data is provided, mainly can be applied to include as seen in figure la and lb audio The communication system of data, system as shown in Figure 1a includes the sub- meeting-place of multiple audios and audio mixing equipment, in each audio meeting Field includes multiple client, some client (such as first client) can be used as main body machine in this multiple client, main Body machine is communicatively coupled with other clients in the sub- meeting-place of the audio respectively, and audio mixing equipment is carried out with this multiple client respectively It communicates to connect (communication connection between audio mixing equipment and nonbody machine is not shown in Fig. 1 a).Wherein：

The sub- meeting-place of a certain audio can be added in client, and the communication meeting for including audio data is established between other clients The communication of audio data is talked about and with other clients include, wherein the communication comprising audio data can be pure audio data Communication or video data communication etc..Client is mainly used for a certain range of sound progress of the client of adjusting the distance Pickup, and pickup signal is sent to audio mixing equipment and carries out audio mixing；Client as main body machine is additionally operable to receive audio mixing equipment The audio signal of transmission, and by the audio signal of reception be sent to belonging to other clients in the sub- meeting-place of audio play out.This Client in inventive embodiments can be the client of the voice communication loaded in portable terminal (such as mobile phone or pad etc.) End.

Audio mixing equipment is connect with the sub- meeting-place of each audio respectively, is mainly used for receiving the audio letter in the sub- meeting-place of each audio Number, and the main body machine to re-sending to the sub- meeting-place of each audio after the audio signal of reception progress audio mixing, it will be received by main body machine Audio signal be sent to belonging to other clients in the sub- meeting-place of audio play out.

System as shown in Figure 1 b includes two sub- meeting-place of audio (the i.e. sub- meeting-place of the first audio and the second audio son meeting ), each sub- meeting-place of audio includes multiple client, some client (such as first client) can be made in multiple client Based on machine, be communicatively coupled between the main body machine in the sub- meeting-place of two of which audio.Any body machine can be to the main body machine The main body machine in the sub- meeting-place of another audio is sent to after the audio signal progress audio mixing in the sub- meeting-place of affiliated audio.

The method of the present embodiment is by being used as main body in the sub- meeting-place of a certain audio in system (such as the sub- meeting-place of the first audio) Method performed by first client of machine, flow chart is as shown in Fig. 2, include：

Step 101, establish respectively and the sub- meeting-place of the first audio in the first communication link between other clients.

It is appreciated that user can operate the first client so that first client is added to the sub- meeting-place of a certain audio In (such as the sub- meeting-place of the first audio), for example, can by " shaking ", or " building group face-to-face " user operation instruction so that The client of other voice communications in first client-side search to a certain range of space, and with the visitor of other voice communications Family end is added to together in the sub- meeting-place of the first audio.In the present embodiment, the multiple client in the sub- meeting-place of the same audio is added Client in the client in space mainly in a certain range, such as a room or the covering of a certain wireless network Client in range.

After multiple client is added to the sub- meeting-place of the first audio, need to determine a client in this multiple client (such as first client) is used as main body machine, then other clients are nonbody machine.In practical applications, a certain audio is being determined When the main body machine in sub- meeting-place, it can be distinguished according to each client in a sub- meeting-place of audio by audio mixing equipment or third party device It is determined to the network delay mean value of other clients.It is specific to determine that the process of main body machine have following two ways：

(1) in the case of as shown in Figure 1a, after multiple client is added to the first audio sub- meeting-place, multiple client It is just communicatively coupled between audio mixing equipment, a main body machine can be selected by audio mixing equipment.

With reference to shown in figure 3a, in this case, for the first client, perform following steps A1 to A3 it Afterwards, the first client can be triggered to start to execute the flow of step 101 to 104：

Step A1 obtains the network delay mean value of other clients in the sub- meeting-place of the first client to the first audio.

The network delay value of first client to another client can be completed by PING modes, i.e. the first client to Another client sends network-control message protocol (Internet Control Messages Protocol, ICMP) loopback and asks Message is sought, meeting auto-returned ICMP return response message, will send after another client receives ICMP echo requests ICMP request bags and when receiving network of the time interval as first client to another client between ICMP response bags Prolong value, the network delay mean value of first client is the first client respectively to other clients in the sub- meeting-place of the first audio The average value of network delay value.

Step A2, the audio mixing network delay mean value of the first client being sent in the communication system comprising audio data Equipment after the corresponding network delay mean value of such audio mixing equipment other clients in obtaining the sub- meeting-place of the first audio, is chosen Wherein the minimum corresponding client of network delay mean value (such as first client) is used as main body machine, the i.e. net of the first client The network delay mean value of other clients is all small in the sub- meeting-place of network time delay the first audio of average ratio, then audio mixing equipment can send notice Information gives the first client.

Step A3, receives the notification information that audio mixing equipment is sent, which includes the first client as the first sound Frequently the information of the main body machine in sub- meeting-place.

(2) in the case of as shown in Figure 1 b, after multiple client is added to the first audio sub- meeting-place, can by point The third party device all not connect with multiple client selectes a main body machine.The third party device can be in system for The management equipment etc. of multiple client.

With reference to shown in figure 3b, in this case, for the first client, perform following steps B1 to B3 it Afterwards, the first client can be triggered to start to execute the flow of step 101 to 104：

Step B1 obtains the network delay mean value of other clients in the sub- meeting-place of the first client to the first audio.

The network delay mean value of first client is sent to third party device by step B2, and such third party device is obtaining It has taken in the sub- meeting-place of the first audio after the corresponding network delay mean value of other clients, has chosen wherein minimum network delay mean value Corresponding client (such as first client) is used as main body machine, and sends notification information to the first client.

Step B3, receives the notification information that third party device is sent, which includes the first client as first The information of the main body machine in the sub- meeting-place of audio.

In this way, after determining main body machine by the above method, main body machine in any sub- meeting-place of audio to the sub- meeting-place of the audio Other clients network delay standard deviation it is minimum.

Step 102, the first audio signal is received, which is other audios except the sub- meeting-place of the first audio The audio signal of the audio signal in sub- meeting-place.

In one kind of such as Fig. 1 a, audio mixing is carried out to the audio signal in the sub- meeting-place of each audio by audio mixing equipment, the One client is the first audio signal for receiving audio mixing equipment and sending.In one kind as shown in Figure 1 b, by each audio Main body machine in sub- meeting-place carries out audio mixing to the audio signal in the sub- meeting-place of affiliated audio, and the first client is to receive the second audio The first audio signal that the main body machine in meeting-place is sent.

Step 103, the first audio signal is sent respectively to by the first audio by the first communication link that step 101 is established Other clients in sub- meeting-place play out.

Step 104, the first audio signal, preset time delay are played after the preset time delay after receiving the first audio signal For to the network delay mean value of other clients.

Since the first client is to need certain network delay when sending the first audio signal to other clients, Then the first client after receiving the first audio signal when playing the first audio signal again after a certain period of time, be likely to so that First audio signal is played simultaneously in all clients in the sub- meeting-place of first audio.Wherein certain time is network delay mean value, Specially the first client transmits a signal to the mean value of time used in other clients in the sub- meeting-place of the first audio, i.e. network respectively Time delay mean value.

It should be noted that there is no absolute ordinal relations between above-mentioned steps 103 and 104, may be performed simultaneously, It can sequentially execute, only one of which concrete implementation mode shown in Fig. 2.

As it can be seen that in the method for the present embodiment, the master in the communication system comprising audio data in any sub- meeting-place of audio Body machine (such as first client in the sub- meeting-place of the first audio) establishes the with other clients in the sub- meeting-place of the first audio respectively One communication link, the in this way network delay due to other clients in main body machine (i.e. the first client) to the sub- meeting-place of the first audio Standard deviation it is smaller so that other clients can be synchronously received to the first audio signal substantially, if main body machine is connecing First audio signal is played again after receiving a fixed response time of the first audio signal, so that owning in a sub- meeting-place of audio The first audio signal of client terminal playing tends to be synchronous substantially；And played due to all clients in the sub- meeting-place of some audio Audio signal is all identical, and the audio signal of the audio signal for the sub- meeting-place of other audios, and there is no broadcast in the sub- meeting-place of the audio It puts the sound in the sub- meeting-place of this audio and generates acoustic feedback and utter long and high-pitched sounds.In this way since the method for the embodiment of the present invention can effectively inhibit howl It is problem so that the portable terminals such as mobile phone may be used in the client in each sub- meeting-place of audio, and do not have to dedicated audio The terminal of communication reduces the cost of voice communication.

It should be noted that the method for above-mentioned steps 101 to 104 is the first client in the first audio signal of downlink reception Process, for the first client uplink send signal process mainly have the following two kinds situation：

(1) in system as shown in Figure 1a, the first client can obtain pickup signal, by the pickup signal and the first audio The identification information in sub- meeting-place, or will be to the mark of the pickup signal signal that carries out that treated at least once and the sub- meeting-place of the first audio Information is sent to audio mixing equipment, and such audio mixing equipment can be by pickup signal or treated at least once pickup signal and the first sound Frequently after the audio signal at least one sub- meeting-place of second audio except sub- meeting-place carries out audio mixing, it is sent to the sub- meeting-place of third audio In client.Wherein, the identification information that the first client sends the sub- meeting-place of the first audio is to allow audio mixing equipment to know this Which signal that audio mixing equipment receives belongs to the sub- meeting-place of the same audio.

In one case, the first client is when obtaining pickup signal, can obtain the first the ten of first client Sound signal.It is to carry out stereo echo to the first pickup signal of acquisition to carry out treated at least once signal to pickup signal Signal after Processing for removing.

In another case, the first client is mainly obtained when obtaining pickup signal in the sub- meeting-place of the first audio First pickup signal of the first client of the second pickup signal and acquisition that other clients (i.e. nonbody machine) send.To pickup It is to the first pickup signal and the second pickup signal obtain after audio mixing that signal, which carries out treated at least once signal, The audio signal in the sub- meeting-place of one audio, or the signal after stereo echo Processing for removing is carried out to the first pickup signal, with second Pickup signal carries out the audio signal in the sub- meeting-place of the first audio obtained after audio mixing.

In other cases, the first client mainly obtains its in the sub- meeting-place of the first audio when obtaining pickup signal Third pickup signal after the carry out stereo echo Processing for removing that its client (i.e. nonbody machine) is sent, and obtain the first visitor First pickup signal at family end.It is to third pickup signal and the second ten to carry out treated at least once signal to pickup signal Sound signal carries out the audio signal in the sub- meeting-place of the first audio obtained after audio mixing, or carries out stereo echo to the first pickup signal Signal after Processing for removing carries out the audio signal in the sub- meeting-place of the first audio obtained after audio mixing with third pickup signal.

It should be noted that above-mentioned two kinds of situations below are, by the main body machine in the sub- meeting-place of each audio by the audio son meeting Audio signal carry out audio mixing after be then forwarded to audio mixing equipment audio mixing again, it is mixed that a part in this way can be shared by main body machine Sound operates, and alleviates the burden of audio mixing equipment.

(2) in system as shown in Figure 1 b, when the first client is when being determined as the main body machine in the sub- meeting-place of the first audio, First client not only needs and establishes the first communication link between other clients in the sub- meeting-place of the first audio, it is also necessary to establish With the second communication link between the main body machine in the sub- meeting-place of the second audio.When such first client executing above-mentioned steps 102, It is the first audio signal for receiving the main body machine in the sub- meeting-place of the second audio by second communication link and sending.And the first client End is when uplink sends signal：

First client can be by each client in the sub- meeting-place of the first audio (including the first client and other clients) Audio signal carry out audio mixing and obtain the second audio signal, the second audio signal is then sent to the by the second communication link The main body machine in the sub- meeting-place of two audios, so that the second audio signal is sent to the nonbody in the sub- meeting-place of the second audio by the main body machine Machine.The audio signal of wherein each client can be the pickup signal of each client, or be the pickup to each client Signal carries out the signal after stereo echo Processing for removing.

The method of the present invention embodiment two

A kind of communication means including audio data is provided, mainly can be applied to include as illustrated in figs. 1A and ib sound In the communication system of frequency evidence, the method for the present embodiment is by the sub- meeting-place of a certain audio in system (such as the sub- meeting-place of the first audio) Method performed by middle the second client as nonbody machine, flow chart is as shown in figure 4, include：

Step 201, the first communication link between the main body machine in foundation and the sub- meeting-place of the first audio.

It is appreciated that user can operate the second client so that second client is added to the sub- meeting-place of a certain audio In (such as the sub- meeting-place of the first audio), for example, can by " shaking ", or " building group face-to-face " user operation instruction so that It is added in the sub- meeting-place of the first audio together with second client and the client of other voice communications.In the present embodiment, it is added same Multiple client in one sub- meeting-place of audio is mainly the client in space in a certain range.

It, can be by audio mixing equipment or third party device according to one after multiple client is added to the sub- meeting-place of the first audio Each client determines the main body in the sub- meeting-place of the audio to the network delay mean value of other clients respectively in the sub- meeting-place of audio Machine and nonbody machine.Specifically determining process can have following two ways：

(1) in the case of as shown in Figure 1a, after multiple client is added to the first audio sub- meeting-place, multiple client It is just communicatively coupled between audio mixing equipment, can determine main body machine and nonbody machine by audio mixing equipment.

In this case, for the second client, after performing following steps, the second client can be triggered End starts to execute the flow of step 201 to 203：Obtain the network of other clients in the sub- meeting-place of the second client to the first audio Time delay mean value；The audio mixing equipment network delay mean value of second client being sent in the communication system comprising audio data； If other clients in the sub- meeting-place of the first audio of network delay average ratio of the first client in addition to the first client Network delay mean value is small, receives the notification information that audio mixing equipment is sent, which includes the first client as the first sound Frequently the information of the main body machine in sub- meeting-place.

Wherein, the method for obtaining the second client to the network delay mean value of other clients can be such as above-mentioned first client The method that end obtains corresponding network delay mean value, herein without repeating.

(2) in the case of as shown in Figure 1 b, after multiple client is added to the first audio sub- meeting-place, can by point The third party device all not connect with multiple client determines main body machine and nonbody machine.The third party device can be system In for multiple client management equipment etc..

In this case, for the second client, after performing following steps, the second client can be triggered End starts to execute the flow of step 201 to 203：Obtain the network of other clients in the sub- meeting-place of the second client to the first audio Time delay mean value；The network delay mean value of second client is sent to third party device；If the network delay of the first client The network delay mean value of other clients in the sub- meeting-place of the first audio of average ratio in addition to the first client is small, receives third party The notification information that equipment is sent, which includes information of first client as the main body machine in the sub- meeting-place of the first audio.

Step 202, the first audio signal is received by the first communication link, which is the first audio son meeting The audio signal of the audio signal in the sub- meeting-place of other audios except.

Step 203, the first audio signal is played.

As it can be seen that in the method for the present embodiment, due to other in main body machine to the sub- meeting-place of the audio in a sub- meeting-place of audio The standard deviation of the network delay of client, that is, nonbody machine is smaller, and the first audio signal of such downlink reception can pass through one The main body machine in a sub- meeting-place of audio is sent to other clients so that other clients can be synchronously received mixed to first substantially Sound signal, so that nonbody machine sowing puts audio signal and tends to be synchronous substantially in a sub- meeting-place of audio.And first audio son First audio signal of each client terminal playing in meeting-place is identical, and is the audio mixing of the audio signal in the sub- meeting-place of other audios letter Number, it generates acoustic feedback there is no the sound in the sub- meeting-place of this audio is played in the sub- meeting-place of the first audio and utters long and high-pitched sounds.Therefore due to this The method of inventive embodiments can effectively inhibit the problem of uttering long and high-pitched sounds so that mobile phone may be used in the client in each sub- meeting-place of audio Equal portable terminals, and without the terminal of dedicated voice communication, reduce the cost of voice communication.

It should be noted that the method for above-mentioned steps 201 to 203 is the second client in the first audio signal of downlink reception Process, for the second client uplink send signal process mainly have the following two kinds situation：

(1) in system as shown in Figure 1a, the second client can be by the second pickup signal of the second client and first The identification information in the sub- meeting-place of audio is sent to the audio mixing equipment in the communication system comprising audio data, or will believe the second pickup It number carries out treated at least once signal and the identification information in the sub- meeting-place of the first audio is sent to audio mixing equipment, in this way by audio mixing The signal that equipment sends the client in the sub- meeting-place of each audio carries out audio mixing.Wherein, the second client sends the first audio The identification information in meeting-place is to allow which signal that audio mixing equipment knows that the audio mixing equipment receives to be to belong to same audio Meeting-place.

(2) in system as shown in Figure 1 b, the second client can be by the second pickup signal of the second client, or to Two pickup signals carry out that treated at least once that signal is sent to main body machine, and main body machine will be each non-in the sub- meeting-place of the first audio After the signal that main body machine is sent carries out audio mixing, it is sent to the main body machine in the sub- meeting-place of the second audio.

Wherein, processing at least once is carried out to the second pickup signal to carry out stereo echo elimination to the second pickup signal Treated signal.

Further, in a specific embodiment, if the main body machine in the sub- meeting-place of the first audio exits the first sound Frequently sub- meeting-place, for example, main body machine a certain range of sky left using user in the sub- meeting-place of the first audio where other clients Between, in order to maintain the communication of current audio data, second client (i.e. nonbody machine) of the present embodiment can be made For new main body machine, establish respectively and the sub- meeting-place of the first audio in third communication link between other remaining clients；If By another client (client in addition to the second client) as new main body machine, then second client of the present embodiment Can establish and the sub- meeting-place of the first audio in fourth communication link between new main body machine.

Wherein, which can be determined as new main body machine by audio mixing equipment or third party device, when After audio mixing equipment or third party device determine new main body machine (such as second client), can send notification information to this Two clients, the notification information include the information that the second client is new main body machine.In this way when the second client receives notice After information, the third communication link between other remaining clients is just established.

The method of the present invention embodiment three

A kind of communication means including audio data is provided, mainly can be applied to as shown in Figure 1a include audio data Communication system in, the method for the present embodiment is the method performed by the audio mixing equipment in system, and flow chart is as shown in figure 5, packet It includes：

Step 301, the main body machine in multiple sub- meeting-place of audio is determined respectively.

Specifically, audio mixing equipment, can when determining the main body machine in a sub- meeting-place of audio (such as the sub- meeting-place of the first audio) To determine that specifically, audio mixing is set to the network delay mean value of other clients according to each client in the sub- meeting-place of the audio It is standby can obtain respectively each client in the sub- meeting-place of the first audio to other clients network delay mean value, if the first sound Frequently the network delay mean value of the first client to the other clients of network delay average ratio of other clients is small in sub- meeting-place, will First client is determined as the main body machine in the sub- meeting-place of the first audio；Notification information is sent to the first client, notification information includes Information of first client as the main body machine in the sub- meeting-place of the first audio.

If the first client exits the sub- meeting-place of the first audio, for example the use user of the first client leaves the first audio A certain range of space in sub- meeting-place where other clients, then the sub- meeting-place of the first audio includes multiple remaining clients, Audio mixing equipment also needs to redefine the main body machine in the sub- meeting-place of the first audio in this multiple remaining client.

Step 302, the audio signal in the sub- meeting-place of multiple audios and the identification information in the sub- meeting-place of corresponding audio are received respectively.

In one case, the client in the sub- meeting-place of each audio can all adjust the distance a certain range of sound of the client Sound is picked up, and obtained pickup signal can be transmitted directly to audio mixing equipment, and mixing operation is carried out by audio mixing equipment.? In this case, the audio signal in any sub- meeting-place of audio is any audio in the sub- meeting-place of multiple audios that audio mixing equipment receives The audio signal that each client is sent in sub- meeting-place.

In another case, the client in the sub- meeting-place of each audio can adjust the distance a certain range of sound of the client Sound is picked up, and for the client in the sub- meeting-place of any audio, obtained pickup signal can be sent to the sub- meeting-place of the audio In main body machine, audio signal sent out after carrying out audio mixing to the pickup signal of each client in the sub- meeting-place of the audio by main body machine Audio mixing equipment is given, the audio signal sent to the main body machine in the sub- meeting-place of each audio by audio mixing equipment carries out audio mixing behaviour again Make.In this case, the audio signal in any sub- meeting-place of audio is pair in the sub- meeting-place of multiple audios that audio mixing equipment receives The audio signal of each client carries out the signal after audio mixing in any sub- meeting-place of audio.A part of mixing operation is placed in this way It is operated to client, alleviates the burden of the audio mixing equipment of the present embodiment.

Further, each client in the sub- meeting-place of each audio can first believe pickup after obtaining pickup signal Number stereo echo Processing for removing is carried out, it then again will treated that signal is sent to audio mixing equipment.Due in the sub- meeting-place of audio Echo be eliminated, so that it may be effectively prevented from audio mixing equipment by echo be mixed into client pickup effective audio signal in shape It utters long and high-pitched sounds in turn at recycling.In this case, any sub- meeting-place of audio in the sub- meeting-place of multiple audios that audio mixing equipment receives Audio signal is the signal carried out to the pickup signal of the client in the sub- meeting-place of any audio after stereo echo Processing for removing.

Step 303, according to the identification information in the sub- meeting-place of audio, will in the sub- meeting-place of multiple audios except the sub- meeting-place of the first audio it The audio signal in the outer sub- meeting-place of other audios carries out audio mixing and obtains the first audio signal.Wherein, the mark letter in the sub- meeting-place of audio Breath is primarily to determine which audio signal belongs to the sub- meeting-place of the same audio.

In one case, audio mixing equipment first mixes the audio signal that the client in the sub- meeting-place of same audio is sent Sound obtains the corresponding audio signal in the sub- meeting-place of each audio, then again carries out the corresponding audio signal in the sub- meeting-place of different audios again Secondary audio mixing.

In another case, if audio mixing equipment receives each audio that the main body machine in the sub- meeting-place of each audio is sent The corresponding audio signal in meeting-place, audio mixing equipment carry out audio mixing again to the corresponding audio signal in the sub- meeting-place of each audio again.

Step 304, the first audio signal is sent to the main body machine in the sub- meeting-place of the first audio, so that main body machine is mixed first Other clients that sound signal is sent in the sub- meeting-place of the first audio play out, each in so sub- meeting-place of first audio The audio signal of client terminal playing is all identical, as the first audio signal, is (i.e. the second audio son meeting of the sub- meeting-place of other audios ) audio signal, be mixed into there is no the pickup signal of other clients in the sub- meeting-place of the first audio and generate and utter long and high-pitched sounds.

As it can be seen that in the method for the present embodiment, audio mixing equipment can will remove such as the first audio son meeting of the sub- meeting-place of a certain audio The audio signal in the sub- meeting-place of other audios except carries out audio mixing and obtains the first audio signal, and the first audio signal is sent To the main body machine in the sub- meeting-place of the first audio, other clients are then sent to by main body machine and are played out.Due to some sound Frequently the audio signal of the client terminal playing in sub- meeting-place is identical, and the audio signal of the audio signal for the sub- meeting-place of other audios, It generates acoustic feedback there is no the sound in the sub- meeting-place of this audio is played in the sub- meeting-place of the audio and utters long and high-pitched sounds.Further, due to main body The standard deviation of the network delay of other clients is smaller in machine to the sub- meeting-place of audio so that other clients can synchronize substantially Ground receives the first audio signal, if main body machine is after receiving a fixed response time of the first audio signal for audio mixing equipment transmission First audio signal is played again, so that the first audio signal of all clients broadcasting becomes substantially in a sub- meeting-place of audio In synchronization.

The method of the present invention example IV

A kind of communication means including audio data is provided, the communication system for including audio data as shown in Figure 1a is applied to In system, the method flow diagram of the present embodiment is as shown in fig. 6, include：

Step 401, the sub- meeting-place of audio is added in client, forms the sub- meeting-place of more than two audios, audio each in this way Each client in meeting-place is connect with audio mixing communication between devices respectively.

User is added to some audio by the client loaded in mobile phone in a manner of certain agreement in the present embodiment Meeting-place.Due to having pickup microphone and loud speaker on mobile phone, in this way by the mobile phone of oneself in relatively short distance pickup, pickup Effect is guaranteed, and same mobile phone closely plays sound and can ensure that user can effectively listen to.

Step 402, if there is multiple client in a sub- meeting-place of audio, the one of client of audio mixing selection of equipment is made Based on machine, the standard deviation of the network delay of other clients is minimum in main body machine to the sub- meeting-place of audio.

Step 403, the main body machine in the sub- meeting-place of each audio is respectively between other clients in the sub- meeting-place of affiliated audio Establish the first communication link.

Step 404, judge whether the main body machine in a sub- meeting-place of audio exits the affiliated sub- meeting-place of audio, if do not had It exits, thens follow the steps 405；If exited, 402 are returned to step, the main body machine in the sub- meeting-place of switching audio is chosen another One main body machine, and re-establish connection.

Step 405, for any one client in the sub- meeting-place of some audio, the client is to the audio son meeting Sound in is picked up to obtain pickup signal, then carries out stereo echo Processing for removing to pickup signal.

In one case, the client in the sub- meeting-place of each audio believes the pickup after carrying out stereo echo Processing for removing Number and the identification information in the corresponding sub- meeting-place of audio be transmitted directly to audio mixing equipment, step 406 is executed by audio mixing equipment.

In another case, in order to mitigate the burden of audio mixing equipment, a part of mixing operation can be placed into main body machine On, then after the pickup signal of main body machine is carried out stereo echo Processing for removing by main body chance, sent out with other clients of reception Pickup signal after the stereo Processing for removing of progress sent carries out stereo process and obtains the corresponding audio signal in the sub- meeting-place of the audio, And the identification information in the sub- meeting-place of audio belonging to obtained audio signal and the main body machine is sent to audio mixing equipment, it is set by audio mixing It is standby to execute step 407.

Step 406, after audio mixing equipment receives the audio signal in the sub- meeting-place of each audio, according to the sub- meeting-place of corresponding audio Identification information, first by the sub- meeting-place of same audio client send audio signal carry out audio mixing obtain each audio meeting The corresponding audio signal in field；Then the corresponding audio signal in the sub- meeting-place of different audios is subjected to audio mixing again again.

Step 407, audio mixing equipment receive the sub- meeting-place of each audio main body machine send audio signal after, by each sound Frequently the audio signal in sub- meeting-place carries out audio mixing again.

Wherein, the principle of audio mixing equipment audio mixing again is by the sub- meeting-place of a certain audio (such as first in step 406 and 407 The sub- meeting-place of audio) except the corresponding audio signal in the sub- meeting-place of other audios audio mixing obtains a final audio signal ratio again Such as the first audio signal.

Step 408, the first audio signal is sent to the main body machine in the sub- meeting-place of the first audio by audio mixing equipment, by main body machine First audio signal is sent to other clients in the sub- meeting-place of the first audio.

Step 409, other clients directly play first audio signal after receiving the first audio signal, and main body machine is then First audio signal is just played after certain network delay after receiving the first audio signal.

In the present embodiment, due to other clients in main body machine to the sub- meeting-place of the audio in a sub- meeting-place of audio, that is, non-master The standard deviation of the network delay of body machine is minimum so that and other clients can be synchronously received audio signal substantially, if Main body machine plays the audio signal again after receiving a fixed response time of audio signal for audio mixing equipment transmission, so that one All clients broadcasting audio signal tends to be synchronous substantially in the sub- meeting-place of audio.

The method of the present invention embodiment five

A kind of communication means including audio data is provided, the communication system for including audio data as shown in Figure 1 b is applied to In system, the method flow diagram of the present embodiment as shown in fig. 7, comprises：

Step 501, audio sub- meeting-place is added in client, forms two sub- meeting-place of audio, i.e. the sub- meeting-place of the first audio and the The sub- meeting-place of two audios.

User is added to some audio by the client loaded in mobile phone in a manner of certain agreement in the present embodiment Meeting-place.Wherein, the multiple client in the sub- meeting-place of the same audio refers to that the mobile phone in a certain range of space loads respectively Client.Due to having pickup microphone and loud speaker on mobile phone, in this way by the mobile phone of oneself in relatively short distance pickup, Pickup effect is guaranteed, and same mobile phone closely plays sound and can ensure that user can effectively listen to.

Step 502, each audio is determined with client all communicates to connect in two sub- meeting-place of audio third party device The main body machine in meeting-place, the standard deviation of the network delay of other clients is minimum in main body machine to the sub- meeting-place of affiliated audio.

Step 503, the second communication link, the master in each sub- meeting-place of audio are established between the main body machine in two sub- meeting-place of audio Body machine establishes the first communication link between other clients in the sub- meeting-place of affiliated audio respectively.

Step 504, for the nonbody machine in the sub- meeting-place of some audio, mainly to the sound in the sub- meeting-place of the audio Sound is picked up to obtain pickup signal, then carries out stereo echo Processing for removing to pickup signal, and by treated, pickup is believed Number by the first communication link be sent to belonging to the sub- meeting-place of audio main body machine.

It is due to the audio signal all same that all clients play in the sub- meeting-place of each audio, then each in the present embodiment Client can be using identical signal as echo reference signal when doing stereo echo Processing for removing, in this way can be to audio Echo in sub- meeting-place is effectively eliminated.

Step 505, it for the main body machine in the sub- meeting-place of some audio, mainly obtains pickup signal and pickup is believed Number stereo echo Processing for removing is carried out, the signal that other clients in the sub- meeting-place of audio belonging to receive are sent will receive Each signal and the main body machine carry out the signal after stereo echo Processing for removing and carry out audio mixing obtaining audio signal.

Step 506,503 the second communication links established are sent audio signal step 505 obtained through the above steps To the main body machine in the sub- meeting-place of another audio, the audio signal of reception is then forwarded in the affiliated sub- meeting-place of audio by main body machine Other clients.

Step 507, directly play the audio signal of reception as the client of nonbody machine, main body machine then receive it is mixed The audio signal of reception is played after certain network delay after sound signal.

In the method for the present embodiment, the audio signal of each client terminal playing in the same sub- meeting-place of audio is identical, and For the audio signal of the audio signal in the sub- meeting-place of another audio, there is no the sound that the sub- meeting-place of this audio is played in the sub- meeting-place of the audio Sound and generate acoustic feedback and utter long and high-pitched sounds.And be that mixing operation is carried out by main body machine in the present embodiment, without individual audio mixing equipment Mixing operation is carried out, the resource of the network equipment is saved.

Present device embodiment one

A kind of communication device including audio data is also provided, the communication device that should include audio data is the first audio The main body machine in meeting-place, such as the first above-mentioned client, structural schematic diagram is as shown in figure 8, can specifically include：

First link establishment unit 10, between other clients in foundation respectively and the sub- meeting-place of the first audio First communication link.

Signal receiving unit 11, for receiving the first audio signal, first audio signal is first audio The audio signal of the audio signal in the sub- meeting-place of other audios except meeting-place.Signal receiving unit 11 can be received comprising audio number According to communication system in audio mixing equipment or the sub- meeting-place of the second audio main body machine send the first audio signal.

First signal transmitting unit 12, the first communication link for being established by the first link establishment unit 10 will The first audio signal that the signal receiving unit 11 receives is sent respectively to other clients and plays out.

Broadcast unit 13, for the pre- timing after receiving first audio signal in the signal receiving unit 11 It delays and plays first audio signal, the preset time delay is the network delay mean value to other clients, specially First client transmits a signal to the mean value of time used in other clients in the sub- meeting-place of the first audio respectively, i.e. network delay is equal Value.

In the device of the present embodiment, the first link establishment unit 10 is established and other clients in the sub- meeting-place of the first audio respectively First communication link at end, the in this way network delay due to other clients in the device of the present embodiment to the sub- meeting-place of the first audio Standard deviation it is smaller so that other clients can be synchronously received to the first audio signal substantially, if signal receive it is single Member 11 plays first audio signal by broadcast unit 13 again after the fixed response time for receiving the first audio signal, so that The first audio signal of all clients broadcasting tends to be synchronous substantially in one sub- meeting-place of audio；And due to the sub- meeting-place of some audio The audio signal that interior all clients play is all identical, and the audio signal of the audio signal for the sub- meeting-place of other audios, no It generates acoustic feedback there are the sound in the sub- meeting-place of this audio is played in the sub- meeting-place of the audio and utters long and high-pitched sounds.In this way due to that can effectively inhibit It utters long and high-pitched sounds problem so that the portable terminals such as mobile phone may be used in the device of client, that is, the present embodiment in each sub- meeting-place of audio End, and without the terminal of dedicated voice communication, reduce the cost of voice communication.

Refering to what is shown in Fig. 9, in a specific embodiment, including the communication device of audio data in addition to may include as Can also include second signal transmission unit 14, the second link establishment unit 15, the transmission of third signal outside structure shown in Fig. 8 Unit 17, the first mean value transmission unit 18 and first information receiving unit 19 is added in unit 16, wherein：

Second signal transmission unit 14, for obtaining pickup signal, by the pickup signal and the first audio son meeting Identification information, or treated at least once signal and the sub- meeting-place of the first audio will be carried out to the pickup signal Identification information is sent to the audio mixing equipment.

The second signal transmission unit 14 is specifically used for obtaining the first pickup signal of first client；It is described It is to carry out stereo echo elimination to first pickup signal to carry out treated at least once signal to the pickup signal Treated signal；

Or, the second signal transmission unit 14, is specifically used for obtaining the second pickup letter that other clients are sent Number and obtain the first pickup signal of first client；It is described to the pickup signal carry out at least once treated letter Number for the sub- meeting-place of the first audio that second pickup signal and first pickup signal obtain after audio mixing Audio signal, or the signal after stereo echo Processing for removing is carried out to first pickup signal, believe with second pickup Number carry out the audio signal in the sub- meeting-place of the first audio obtained after audio mixing；

Or, the second signal transmission unit 14, the carry out for being specifically used for obtaining other client transmissions is stereo Third pickup signal after echo cancellation process, and obtain the first pickup signal of first client；It is described to be picked up to described It is to carry out audio mixing to the third pickup signal and first pickup signal that sound signal, which carries out treated at least once signal, The audio signal in the sub- meeting-place of the first audio obtained afterwards, or first pickup signal is carried out at stereo echo elimination Signal after reason carries out the audio signal in the sub- meeting-place of the first audio obtained after audio mixing with the third pickup signal.

Second link establishment list 15, for establishing the second communication link between the main body machine in the sub- meeting-place of the second audio.

Third signal transmitting unit 16, for carrying out the audio signal of each client in the sub- meeting-place of the first audio Audio mixing obtains the second audio signal；The second communication link established by the second link establishment unit 15 is mixed described second Sound signal is sent to the main body machine in the sub- meeting-place of the second audio, so that second audio signal is sent to by the main body machine The nonbody machine in the sub- meeting-place of the second audio.

Unit 17 is added, for the sub- meeting-place of the first audio to be added.

First mean value transmission unit 18, for obtaining the communication device comprising audio data to first audio The network delay mean value of other clients in meeting-place sends the network delay mean value of the communication device comprising audio data To the audio mixing equipment or third party device in the communication system comprising audio data；

First information receiving unit 19, if be used for the first mean value transmission unit 18 transmission includes audio data The network delay mean value of other clients described in the network delay average ratio of communication device is small, receives the audio mixing equipment or third The notification information that method, apparatus is sent, the notification information include the communication device comprising audio data as first sound Frequently the information of the main body machine in sub- meeting-place.

In one case, if the device in the present embodiment is the master in any sub- meeting-place of audio in system as shown in Figure 1a Body machine, then after unit 17 is added being added to the first audio sub- meeting-place, so that it may to be attached between audio mixing equipment, then the The network delay mean value of the device of the present embodiment can be sent to audio mixing equipment by one mean value transmission unit 18.Work as the first information After receiving unit 19 receives the notification information that audio mixing equipment is sent, the first link establishment unit 10 can be triggered and establish the first communication Link, after signal receiving unit 11 receives the first audio signal of audio mixing equipment transmission, by the first signal transmitting unit 12 The first audio signal is sent to other clients by first communication link.

In another case, as the device in the present embodiment is any sub- meeting-place of audio in system as shown in Figure 1 b Main body machine, then after unit 17 is added being added to the first audio sub- meeting-place, the first mean value transmission unit 18 can be implemented this The network delay mean value of the device of example is sent to third party device.It is sent when first information receiving unit 19 receives third party device Notification information after, the first link establishment unit 10 can be triggered and establish the first communication link, the second link establishment unit 15 is built Vertical second communication link, in this case, the first signal transmitting unit 12 can be built by the second link establishment unit 15 The second vertical communication link receives the first audio signal signal of the transmission of the main body machine in the sub- meeting-place of the second audio；It can be with Second audio signal is sent by the second communication link by third signal transmitting unit 16.

Present device embodiment two

A kind of communication device including audio data is also provided, the first audio should be belonged to comprising the communication device of audio data The nonbody machine in sub- meeting-place, such as the second above-mentioned client, structural schematic diagram is as shown in Figure 10, can specifically include：

Link establishment unit 20, for establish and the sub- meeting-place of the first audio in main body machine between the first communication chain Road；

Audio mixing receiving unit 21, it is mixed that the first communication link for being established by the link establishment unit 20 receives first Sound signal, first audio signal are the mixed of the audio signal in the sub- meeting-place of other audios except the sub- meeting-place of the first audio Sound signal；

Signal broadcast unit 22, the first audio signal received for playing the audio mixing receiving unit 21.

With reference to shown in figure 11, in a specific embodiment, including the communication device of audio data is in addition to may include Can also include signal transmitting unit 23, reconstruction unit 24, meeting-place addition unit 25, second outside structure as shown in Figure 10 It is worth transmission unit 26 and the second information receiving unit 27, wherein：

Signal transmitting unit 23, for believing by the second pickup signal of second client, or to second pickup Number carry out that treated at least once that signal is sent to the main body machine；Or,

The signal transmitting unit 23, for the second pickup signal of second client and first audio is sub The identification information in meeting-place is sent to the audio mixing equipment in the communication system comprising audio data, or by described to described second Pickup signal carries out treated at least once signal and the identification information in the sub- meeting-place of the first audio is sent to the audio mixing Equipment；

Wherein, it is stereo to second pickup signal progress to carry out processing at least once to second pickup signal Signal after echo cancellation process.

Reconstruction unit 24, if exiting the first audio son meeting for the main body machine in the sub- meeting-place of the first audio , using second client as new main body machine, establish respectively and other remaining clients in the sub- meeting-place of the first audio Third communication link between end.Or, if the main body machine in the sub- meeting-place of the first audio exits the first audio son meeting , the fourth communication link in foundation and the sub- meeting-place of the first audio between new main body machine.

Unit 25 is added in meeting-place, for the sub- meeting-place of the first audio to be added.

Second mean value transmission unit 26, for obtaining the communication device comprising audio data to first audio The network delay mean value of other clients in meeting-place；The network delay mean value of the communication device comprising audio data is sent To the audio mixing equipment or third party device in the communication system comprising audio data；

Second information receiving unit 27, if being used for the first audio described in the network delay average ratio of first client The network delay mean value of other clients in sub- meeting-place in addition to the first client is small, receives the audio mixing equipment or third party The notification information that equipment is sent, the notification information includes main body machine of first client as the sub- meeting-place of the first audio Information.

In one case, if the device in the present embodiment is the non-of any sub- meeting-place of audio in system as shown in Figure 1a Main body machine, then after unit 24, which is added, in meeting-place is added to the first audio sub- meeting-place, so that it may to be attached between audio mixing equipment, Then the network delay mean value of the device of the present embodiment can be sent to audio mixing equipment by the second mean value transmission unit 25.When After two information receiving units 26 receive the notification information that audio mixing equipment is sent, unit 20 can be established with trigger link, and to establish first logical Believe link, after audio mixing receiving unit 21 receives the first audio signal of main body machine transmission, is played by signal broadcast unit 22 First audio signal.

In another case, as the device in the present embodiment is any sub- meeting-place of audio in system as shown in Figure 1 b Nonbody machine, then after unit 24, which is added, in meeting-place is added to the first audio sub- meeting-place, the second mean value transmission unit 25 can will The network delay mean value of the device of the present embodiment is sent to third party device.It is set when the second information receiving unit 26 receives third party After the notification information that preparation is sent, unit 20 can be established with trigger link and establishes the first communication link.When the sub- meeting-place of the first audio After main body machine exits the sub- meeting-place of the first audio, new main body machine is determined by audio mixing equipment or third party device, if selecting this reality Machine based on the device of example is applied, reconstruction unit 24 can re-establish the communication link between other clients, such audio mixing Receiving unit 21 can receive the first audio signal by the communication link that the reconstruction unit 24 re-establishes.

Present device embodiment three

A kind of communication device including audio data, such as above-mentioned audio mixing equipment are also provided, structural schematic diagram is as schemed Shown in 12, it can specifically include：

Determination unit 30, the main body machine for determining the sub- meeting-place of multiple audios respectively.

The determination unit 30, specifically for obtaining in the sub- meeting-place of the first audio each client respectively to other visitors The network delay mean value at family end；If the network delay of the first client to other clients is equal in the sub- meeting-place of the first audio Value is smaller than the network delay mean value of other clients, and first client is determined as to the main body in the sub- meeting-place of the first audio Machine；Notification information is sent to first client, the notification information includes first client as the first audio The information of the main body machine in meeting-place.

Receiving unit 31, audio signal for receiving the sub- meeting-place of the multiple audio respectively and the sub- meeting-place of corresponding audio Identification information.

Specifically, the audio signal in any sub- meeting-place of audio is in the sub- meeting-place of the multiple audio that receiving unit 31 receives The signal after stereo echo Processing for removing is carried out to the pickup signal of the client in any sub- meeting-place of audio.

Or, the audio signal in any sub- meeting-place of audio is described in the sub- meeting-place of the multiple audio that receiving unit 31 receives The audio signal that each client is sent in any sub- meeting-place of audio；Or,

Or, the audio signal in any sub- meeting-place of audio is to described in the sub- meeting-place of multiple audios that receiving unit 31 receives The audio signal of each client carries out the signal after audio mixing in the sub- meeting-place of one audio.

Mixing operation unit 32, the identification information in the sub- meeting-place of audio for being received according to the receiving unit 31, by institute The audio signal progress audio mixing for stating the sub- meeting-place of other audios in the sub- meeting-place of multiple audios in addition to the sub- meeting-place of the first audio obtains First audio signal.

Audio signal transmission unit 33, the first audio signal for obtaining the mixing operation unit 32 are sent to institute The main body machine for stating the sub- meeting-place of the first audio of the determination of determination unit 30, so that the main body machine sends first audio signal It is played out to other clients in the sub- meeting-place of the first audio.

With reference to shown in figure 13, in a specific embodiment, including the communication device of audio data is in addition to may include Outside structure as shown in figure 12, can also include：Unit 34 is redefined, if exiting described for first client The sub- meeting-place of one audio, then the sub- meeting-place of the first audio includes multiple remaining clients, in the multiple remaining client Redefine the main body machine in the sub- meeting-place of the first audio.Audio signal transmission unit 33 can be by the first audio signal later It is sent to and redefines the new main body machine of unit 34 again.

In the device of the present embodiment, mixing operation unit 32 can will remove such as the first audio son meeting of the sub- meeting-place of a certain audio The audio signal in the sub- meeting-place of other audios except carries out audio mixing and obtains the first audio signal, and by audio signal transmission unit 33 are sent to the first audio signal in the main body machine in the sub- meeting-place of the first audio, then by main body machine be sent to other clients into Row plays.Since the audio signal of the client terminal playing in the sub- meeting-place of some audio is identical, and it is the sub- meeting-place of other audios The audio signal of audio signal generates acoustic feedback and makes a whistling sound there is no the sound in the sub- meeting-place of this audio is played in the sub- meeting-place of the audio It cries.Further, since the standard deviation of the network delay of other clients in main body machine to the sub- meeting-place of audio is smaller so that its Its client can be synchronously received to the first audio signal substantially, if main body machine is receiving the first of the transmission of audio mixing equipment First audio signal is played after one fixed response time of audio signal again, so that all clients are broadcast in a sub- meeting-place of audio It puts the first audio signal and tends to be synchronous substantially.

Present device example IV

A kind of communication device including audio data is also provided, structural schematic diagram is as shown in figure 14, should include audio number According to communication device can generate bigger difference because configuration or performance are different, may include one or more centres Reason device (central processing units, CPU) 40 (for example, one or more processors) and memory 41, one (such as one or more mass memories are set a or storage medium 42 of more than one storage application program 421 or data 422 It is standby).Wherein, memory 41 and storage medium 42 can be of short duration storage or persistent storage.It is stored in the program of storage medium 42 May include one or more modules (diagram does not mark), each module may include to the communication dress comprising audio data Series of instructions operation in setting.Further, central processing unit 40 could be provided as communicating with storage medium 42, comprising The series of instructions operation in storage medium 42 is executed on the communication device of audio data.

Including the communication device of audio data can also include one or more power supplys 43, one or more have Line or radio network interface 44, one or more input/output interfaces 45, and/or, one or more operating systems 423, such as Windows ServerTM, Mac OS XTM, UnixTM, LinuxTM, FreeBSDTM etc..

Described in above method embodiment by the step performed by audio mixing equipment, the step performed by the first client, And the second step performed by client can be based on the structure for the communication device for shown in the Figure 14 including audio data.

The embodiment of the present invention also provides a kind of communication system including audio data, and structural schematic diagram is as shown in Figure 1a, Including audio mixing equipment and the sub- meeting-place of multiple audios, each sub- meeting-place of audio includes multiple client in multiple sub- meeting-place of audio, this Multiple client includes the first client and multiple second clients, wherein：

The structure of audio mixing equipment can be as described in above-mentioned apparatus embodiments three or apparatus embodiments four include audio number According to communication device structure, the structure of the first client can be as described in above-mentioned apparatus embodiments one or apparatus embodiments four The communication device comprising audio data structure, the structure of the second client can be as real such as above-mentioned apparatus embodiments two or equipment The structure for applying the communication device comprising audio data described in example four, herein without repeating.

The embodiment of the present invention also provides another audio communication system, and structural schematic diagram is as shown in Figure 1 b, including two The sub- meeting-place of audio, each sub- meeting-place of audio includes the first client and multiple second clients in the sub- meeting-place of the two audios, Wherein：

The structure of first client can be as described in above-mentioned apparatus embodiments one or apparatus embodiments four include audio The structure of the structure of the communication device of data, the second client can be such as institute in above-mentioned apparatus embodiments two or apparatus embodiments four The structure for the communication device comprising audio data stated, herein without repeating.

One of ordinary skill in the art will appreciate that all or part of step in the various methods of above-described embodiment is can It is completed with instructing relevant hardware by program, which can be stored in a computer readable storage medium, storage Medium may include：Read-only memory (ROM), random access memory ram), disk or CD etc..

It is provided for the embodiments of the invention the communication means comprising audio data above, apparatus and system has carried out in detail It introduces, principle and implementation of the present invention are described for specific case used herein, the explanation of above example It is merely used to help understand the method and its core concept of the present invention；Meanwhile for those of ordinary skill in the art, according to this The thought of invention, there will be changes in the specific implementation manner and application range, in conclusion the content of the present specification is not answered It is interpreted as limitation of the present invention.

Claims

1. a kind of communication means including audio data, which is characterized in that be applied in the communication system comprising audio data First client, first client belong to the sub- meeting-place of the first audio, the method includes：

The first audio signal is received, first audio signal is the sub- meeting-place of other audios except the sub- meeting-place of the first audio Audio signal audio signal；

First audio signal other clients are sent respectively to by first communication link to play out；

First audio signal, the preset time delay are played after the preset time delay after receiving first audio signal For to the network delay mean value of other clients.

2. the method as described in claim 1, which is characterized in that the first audio signal of the reception specifically includes：Described in reception Including the first audio signal that the audio mixing equipment in the communication system of audio data is sent；

The method further includes：

Pickup signal is obtained, by the pickup signal and the identification information in the sub- meeting-place of the first audio, or will be to the pickup Signal carries out treated at least once signal and the identification information in the sub- meeting-place of the first audio is sent to the audio mixing equipment.

3. method as claimed in claim 2, which is characterized in that

The acquisition pickup signal specifically includes：Obtain the first pickup signal of first client；It is described to the pickup It is the letter carried out to first pickup signal after stereo echo Processing for removing that signal, which carries out treated at least once signal, Number；

Or,

The acquisition pickup signal specifically includes：It obtains the second pickup signal that the other clients are sent and obtains described the First pickup signal of one client；It is described that carry out treated at least once signal to the pickup signal be to described second Pickup signal carries out the audio signal in the sub- meeting-place of the first audio obtained after audio mixing with first pickup signal, or to institute It states the first pickup signal and carries out the signal after stereo echo Processing for removing, obtained after carrying out audio mixing with second pickup signal The sub- meeting-place of the first audio audio signal；

Or,

The acquisition pickup signal specifically includes：After obtaining the carry out stereo echo Processing for removing that other clients are sent Third pickup signal, and obtain the first pickup signal of first client；It is described that the pickup signal is carried out at least Signal after single treatment is to the third pickup signal and first pickup signal obtain after audio mixing described the The audio signal in the sub- meeting-place of one audio, or the signal after stereo echo Processing for removing is carried out to first pickup signal, with The third pickup signal carries out the audio signal in the sub- meeting-place of the first audio obtained after audio mixing.

4. the method as described in claim 1, which is characterized in that before the first audio signal of the reception, further include：Establish with The second communication link between the main body machine in the sub- meeting-place of the second audio；

The first audio signal of the reception, specifically includes：The sub- meeting-place of the second audio is received by second communication link In main body machine send the first audio signal；

The method further includes：

The audio signal of each client in the sub- meeting-place of first audio is subjected to audio mixing and obtains the second audio signal；

Second audio signal is sent to the main body machine in the sub- meeting-place of the second audio by second communication link, with Toilet states the nonbody machine that second audio signal is sent to the sub- meeting-place of the second audio by main body machine.

5. such as Claims 1-4 any one of them method, which is characterized in that described to establish respectively and first audio Before the first communication link in meeting-place between other clients, the method further includes：

The sub- meeting-place of the first audio is added.

6. such as Claims 1-4 any one of them method, which is characterized in that described to establish respectively and first audio Before the first communication link in meeting-place between other clients, the method further includes：

Obtain the network delay mean value of other clients in first client to the sub- meeting-place of the first audio；

The audio mixing that the network delay mean value of first client is sent in the communication system comprising audio data is set Standby or third party device；

If the network delay mean value of other clients described in the network delay average ratio of first client is small, described in reception The notification information that audio mixing equipment or third party device are sent, the notification information includes first client as described first The information of the main body machine in the sub- meeting-place of audio.

7. a kind of communication means including audio data, which is characterized in that be applied in the communication system comprising audio data Second client, second client belong to the sub- meeting-place of the first audio, the method includes：

The first audio signal is received by first communication link, first audio signal is the sub- meeting-place of the first audio Except the sub- meeting-place of other audios audio signal audio signal；

Play first audio signal.

8. the method for claim 7, which is characterized in that the method further includes：

By the second pickup signal of second client, or to second pickup signal carry out at least once treated letter Number it is sent to the main body machine；Or,

The identification information of second pickup signal of second client and the sub- meeting-place of the first audio is sent to the packet Audio mixing equipment in communication system containing audio data, or second pickup signal is carried out after handling at least once by described Signal and the identification information in the sub- meeting-place of the first audio be sent to the audio mixing equipment；

Wherein, processing at least once is carried out to second pickup signal to carry out stereo echo to second pickup signal Signal after Processing for removing.

9. the method for claim 7, which is characterized in that the method further includes：

If the main body machine in the sub- meeting-place of the first audio exits the sub- meeting-place of the first audio, second client is made For new main body machine, establish respectively and the sub- meeting-place of the first audio in third communication link between other remaining clients；

Or, if the main body machine in the sub- meeting-place of the first audio exits the sub- meeting-place of the first audio, establish and described first Fourth communication link in the sub- meeting-place of audio between new main body machine.

10. such as claim 7 to 9 any one of them method, which is characterized in that the foundation and the sub- meeting-place of the first audio Before the first communication link between middle main body machine, the method further includes：

The sub- meeting-place of the first audio is added.

11. method as claimed in claim 10, which is characterized in that the foundation and main body machine in the sub- meeting-place of the first audio Between the first communication link before, the method further includes：

Obtain the network delay mean value of other clients in second client to the sub- meeting-place of the first audio；

The audio mixing that the network delay mean value of second client is sent in the communication system comprising audio data is set Standby or third party device；

If other in addition to the first client in the sub- meeting-place of the first audio described in the network delay average ratio of the first client The network delay mean value of client is small, receives the notification information of the audio mixing equipment or third party device transmission, the notice letter Breath includes information of first client as the main body machine in the sub- meeting-place of the first audio.

12. a kind of communication means including audio data, which is characterized in that the method is applied to the communication comprising audio data Audio mixing equipment in system, including：

According to the identification information in the sub- meeting-place of the audio, by the sub- meeting-place of the multiple audio in addition to the sub- meeting-place of the first audio The audio signal in other sub- meeting-place of audio carries out audio mixing and obtains the first audio signal；

First audio signal is sent to the main body machine in the sub- meeting-place of the first audio, so that the main body machine is by described Other clients that one audio signal is sent in the sub- meeting-place of the first audio play out.

13. method as claimed in claim 12, which is characterized in that determine the first audio son meeting in the sub- meeting-place of the multiple audio The main body machine of field, specifically includes：

Each client is obtained in the sub- meeting-place of the first audio respectively to the network delay mean value of other clients；

If network delay average ratio other clients of first client to other clients in the sub- meeting-place of the first audio Network delay mean value it is small, first client is determined as to the main body machine in the sub- meeting-place of the first audio；

Notification information is sent to first client, the notification information includes first client as the first audio The information of the main body machine in meeting-place.

14. method as claimed in claim 13, which is characterized in that the method further includes：

If first client exits the sub- meeting-place of the first audio, the sub- meeting-place of the first audio includes multiple surplus Remaining client redefines the main body machine in the sub- meeting-place of the first audio in the multiple remaining client.

15. such as claim 12 to 14 any one of them method, which is characterized in that any sound in the multiple sub- meeting-place of audio Frequently the audio signal in sub- meeting-place is to carry out stereo echo to the pickup signal of the client in any sub- meeting-place of audio to disappear Except treated signal.

16. such as claim 12 to 14 any one of them method, which is characterized in that any sound in the multiple sub- meeting-place of audio Frequently the audio signal in sub- meeting-place is the audio signal that each client is sent in any sub- meeting-place of audio；Or,

The audio signal in any sub- meeting-place of audio is to each in any sub- meeting-place of audio in the multiple sub- meeting-place of audio The audio signal of client carries out the signal after audio mixing.

17. a kind of communication device including audio data, which is characterized in that the communication device comprising audio data belongs to The sub- meeting-place of one audio, including：

First link establishment unit is logical for first between other clients in foundation respectively and the sub- meeting-place of the first audio Believe link；

Signal receiving unit, for receive the first audio signal, first audio signal be the sub- meeting-place of the first audio it The audio signal of the audio signal in the outer sub- meeting-place of other audios；

First signal transmitting unit, it is described for being sent respectively to first audio signal by first communication link Other clients play out；

Broadcast unit, for playing the first audio mixing letter after the preset time delay after receiving first audio signal Number, the preset time delay is the network delay mean value to other clients.

18. device as claimed in claim 17, which is characterized in that

The signal receiving unit is specifically used for receiving what the audio mixing equipment in the communication system comprising audio data was sent First audio signal；

Further include：Second signal transmission unit, for obtaining pickup signal, by the pickup signal and the first audio son meeting Identification information, or treated at least once signal and the sub- meeting-place of the first audio will be carried out to the pickup signal Identification information is sent to the audio mixing equipment.

19. device as claimed in claim 18, which is characterized in that

The second signal transmission unit is specifically used for obtaining the first pickup signal of the first client；It is described to the pickup It is the letter carried out to first pickup signal after stereo echo Processing for removing that signal, which carries out treated at least once signal, Number；

Or,

The second signal transmission unit is specifically used for obtaining the second pickup signal and obtain institute that other clients are sent State the first pickup signal of the first client；It is described that carry out treated at least once signal to the pickup signal be to described Second pickup signal carries out the audio signal in the sub- meeting-place of the first audio obtained after audio mixing with first pickup signal, or The signal after stereo echo Processing for removing is carried out to first pickup signal, after carrying out audio mixing with second pickup signal The audio signal in the obtained sub- meeting-place of the first audio；

Or,

The second signal transmission unit is specifically used for obtaining at the carry out stereo echo elimination that other clients are sent Third pickup signal after reason, and obtain the first pickup signal of first client；It is described that the pickup signal is carried out Treated at least once signal is carries out the institute obtained after audio mixing to the third pickup signal and first pickup signal The audio signal in the sub- meeting-place of the first audio is stated, or carries out the letter after stereo echo Processing for removing to first pickup signal Number, the audio signal in the sub- meeting-place of the first audio obtained after audio mixing is carried out with the third pickup signal.

20. device as claimed in claim 17, which is characterized in that further include：Second link establishment unit, for establishing and the The second communication link between the main body machine in the sub- meeting-place of two audios；

First signal transmitting unit is specifically used for receiving in the sub- meeting-place of the second audio by second communication link Main body machine send the first audio signal；

Described device further includes：

Third signal transmitting unit is obtained for the audio signal of each client in the sub- meeting-place of the first audio to be carried out audio mixing To the second audio signal；Second audio signal is sent to the sub- meeting-place of the second audio by second communication link Main body machine, so that second audio signal is sent to the nonbody machine in the sub- meeting-place of the second audio by the main body machine.

21. such as claim 17 to 20 any one of them device, which is characterized in that further include：

Unit is added, for the sub- meeting-place of the first audio to be added.

22. such as claim 17 to 20 any one of them device, which is characterized in that further include：

First mean value transmission unit, for obtaining in the communication device to the sub- meeting-place of the first audio comprising audio data The network delay mean value of the communication device comprising audio data is sent to described by the network delay mean value of other clients Including the audio mixing equipment in the communication system of audio data or third party device；

First information receiving unit, if for the communication device comprising audio data network delay average ratio described in its The network delay mean value of its client is small, receives the notification information of the audio mixing equipment or third party device transmission, the notice Information includes the information of main body machine of the communication device comprising audio data as the sub- meeting-place of the first audio.

23. a kind of communication device including audio data, which is characterized in that the communication device comprising audio data belongs to The sub- meeting-place of one audio, including：

Link establishment unit, for establish and the sub- meeting-place of the first audio in main body machine between the first communication link；

Audio mixing receiving unit, for receiving the first audio signal by first communication link, first audio signal is The audio signal of the audio signal in the sub- meeting-place of other audios except the sub- meeting-place of the first audio；

Signal broadcast unit, for playing first audio signal.

24. device as claimed in claim 23, which is characterized in that further include：

Signal transmitting unit, for being carried out at least by the second pickup signal of the second client, or to second pickup signal Signal after single treatment is sent to the main body machine；Or,

The signal transmitting unit, for by the second pickup signal of second client and the sub- meeting-place of the first audio Identification information is sent to the audio mixing equipment in the communication system comprising audio data, or believes described second pickup It number carries out treated at least once signal and the identification information in the sub- meeting-place of the first audio is sent to the audio mixing equipment；

25. device as claimed in claim 23, which is characterized in that further include：

Reconstruction unit, if exiting the sub- meeting-place of the first audio for the main body machine in the sub- meeting-place of the first audio, by Two clients as new main body machine, establish respectively and the sub- meeting-place of the first audio in third between other remaining clients Communication link；

26. such as claim 23 to 25 any one of them device, which is characterized in that further include：

Unit is added in meeting-place, for the sub- meeting-place of the first audio to be added.

27. device as claimed in claim 26, which is characterized in that further include：

Second mean value transmission unit, for obtaining in the communication device to the sub- meeting-place of the first audio comprising audio data The network delay mean value of other clients；The network delay mean value of the communication device comprising audio data is sent to described Including the audio mixing equipment in the communication system of audio data or third party device；

Second information receiving unit, if removed in the sub- meeting-place of the first audio described in network delay average ratio for the first client The network delay mean value of other clients except first client is small, receives what the audio mixing equipment or third party device were sent Notification information, the notification information include information of first client as the main body machine in the sub- meeting-place of the first audio.

28. a kind of communication device including audio data, which is characterized in that including：

Receiving unit, the mark letter of audio signal and the sub- meeting-place of corresponding audio for receiving the sub- meeting-place of the multiple audio respectively Breath；

Mixing operation unit will be in the sub- meeting-place of the multiple audio except for according to the identification information in the sub- meeting-place of the audio The audio signal in the sub- meeting-place of other audios except the sub- meeting-place of one audio carries out audio mixing and obtains the first audio signal；

Audio signal transmission unit, the main body machine for first audio signal to be sent to the sub- meeting-place of the first audio, So that the main body machine broadcasts other clients that first audio signal is sent in the sub- meeting-place of the first audio It puts.

29. device as claimed in claim 28, which is characterized in that

The determination unit, specifically for obtaining in the sub- meeting-place of the first audio each client respectively to other clients Network delay mean value；If in the sub- meeting-place of the first audio the first client to other clients network delay average ratio its The network delay mean value of its client is small, and first client is determined as to the main body machine in the sub- meeting-place of the first audio；Hair Send notification information to first client, the notification information includes first client as the sub- meeting-place of the first audio The information of main body machine.

30. device as claimed in claim 28, which is characterized in that further include：

Unit is redefined, if exiting the sub- meeting-place of the first audio, the first audio son meeting for the first client Field includes multiple remaining clients, and the main body in the sub- meeting-place of the first audio is redefined in the multiple remaining client Machine.

31. such as claim 28 to 30 any one of them device, which is characterized in that any sound in the multiple sub- meeting-place of audio Frequently the audio signal in sub- meeting-place is to carry out stereo echo to the pickup signal of the client in any sub- meeting-place of audio to disappear Except treated signal.

32. such as claim 28 to 30 any one of them device, which is characterized in that any sound in the multiple sub- meeting-place of audio Frequently the audio signal in sub- meeting-place is the audio signal that each client is sent in any sub- meeting-place of audio；Or,

33. a kind of communication system including audio data, which is characterized in that including audio mixing equipment and the sub- meeting-place of multiple audios, institute It includes multiple client to state each sub- meeting-place of audio in the sub- meeting-place of multiple audios, and the multiple client includes the first client With multiple second clients；

The audio mixing equipment is the communication device for including audio data such as described claim 28 to 32 any one of them；

First client is the communication dress comprising audio data described in any one of 21 and 22 such as claim 17 to 19 It sets；

Second client is that claim 23 to 27 any one of them such as includes the communication device of audio data.

34. a kind of system including audio data, which is characterized in that including two sub- meeting-place of audio, described two audio meetings Each sub- meeting-place of audio includes the first client and multiple second clients in, wherein：

First client is the communication device for including audio data described in any one of 20 to 22 such as claim 17；