CN105847096A - Audio frequency data communication method, device and system - Google Patents
Audio frequency data communication method, device and system Download PDFInfo
- Publication number
- CN105847096A CN105847096A CN201610321348.XA CN201610321348A CN105847096A CN 105847096 A CN105847096 A CN 105847096A CN 201610321348 A CN201610321348 A CN 201610321348A CN 105847096 A CN105847096 A CN 105847096A
- Authority
- CN
- China
- Prior art keywords
- meeting
- place
- sub
- audio frequency
- audio
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L12/00—Data switching networks
- H04L12/28—Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
- H04L12/2803—Home automation networks
- H04L12/2805—Home Audio Video Interoperability [HAVI] networks
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L12/00—Data switching networks
- H04L12/28—Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
- H04L12/2803—Home automation networks
- H04L12/2816—Controlling appliance services of a home automation network by calling their functionalities
- H04L12/2818—Controlling appliance services of a home automation network by calling their functionalities from a device located outside both the home and the home network
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L12/00—Data switching networks
- H04L12/28—Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
- H04L12/2803—Home automation networks
- H04L12/283—Processing of data at an internetworking point of a home automation network
- H04L12/2836—Protocol conversion between an external network and a home network
Landscapes
- Engineering & Computer Science (AREA)
- Automation & Control Theory (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Multimedia (AREA)
- Computing Systems (AREA)
- Telephonic Communication Services (AREA)
Abstract
An embodiment of the invention discloses an audio frequency data communication method, device and system and belongs to the technical field of communication. First communication links between a main device in a first audio frequency sub-meeting-place and other client ends in the first audio frequency sub-meeting-place are respectively established; via the first communication link, first sound mixing signals that are received are sent to the other client ends in the first audio frequency sub-meeting-place, and the other client ends are enabled to receive the first sound mixing signals synchronously; if the first sound mixing signals are played later than the time when the first sound mixing signals are received by the main device, then the first sound mixing signals tend to be played synchronously by all client ends in the first audio frequency sub-meeting-place, the first sound mixing signals are sound mixing signals of audio frequency signals of other audio frequency sub-meeting-places, a problem that audio feedback squeal and desynchrony are caused when sound of the audio frequency sub-meeting-place is played in the same audio frequency sub-meeting-place can be prevented, and mobile terminals such as mobile phones and the like can be used as client ends in each audio frequency sub-meeting-place.
Description
Technical field
The present invention relates to communication technical field, comprise the communication means of voice data, dress particularly to a kind of
Put and system.
Background technology
Demand is being handled official business and had a very wide range of applications in life to audio conferencing, so in different geographical
User can use respective conference terminal to join in same audio conferencing and converse, and solves difference
The multi-person speech communicating questions of region, is that many people are in (such as one meeting of same meeting-place than more typical scene
View indoor) use a conference terminal and each meeting-place, a distant place to carry out speech exchange, and this scene is to meeting eventually
End proposes two requirements: the broadcast sound volume of conference terminal is sufficiently large, and the listener in meeting-place can be allowed to listen
Seeing, conference terminal pickup effect is especially good simultaneously, because spokesman may be from conference terminal in meeting-place
It is the most farther that air line distance reaches 5m.
The scheme of existing comparative maturity is the conference terminal of special conference terminal, such as polycom, should
Conference terminal uses larger-size speaker, it is ensured that sound is sufficiently large, uses multiple mike (3 simultaneously
More than individual), conventional pickup distance is within 5m, and in order to reach more preferable pickup effect, conference terminal provides
External mike expansion module, this module is by wired connection separate microphone pickup module and master
Machine, independent microphone module can be placed on the position near spokesman, in order to improves closer to distance pickup
Pickup effect.But existing conference terminal equipment cost is higher, and carries inconvenience.
Summary of the invention
The embodiment of the present invention provides a kind of and comprises the communication means of voice data, Apparatus and system so that the
First client in the one sub-meeting-place of audio frequency is sent to the first audio frequency meeting by unified for the first audio signal received
Other client of field plays out.
The first aspect of the embodiment of the present invention provides a kind of communication means comprising voice data, is applied to bag
The first client in communication system containing voice data, described first client belongs to the first audio frequency meeting
, described method includes:
Set up respectively and the first communication link between other client in the described first sub-meeting-place of audio frequency;
Receiving the first audio signal, described first audio signal is its outside the described first sub-meeting-place of audio frequency
The audio signal of the audio signal in the sub-meeting-place of its audio frequency;
By described first communication link, described first audio signal is sent respectively to other client described
Play out;
Described first audio signal is play after preset time delay after receiving described first audio signal,
Described preset time delay is the network delay average to other client described.
The second aspect of the embodiment of the present invention provides a kind of communication means comprising voice data, is applied to bag
The second client in communication system containing voice data, described second client belongs to the first audio frequency meeting
, described method includes:
Set up the first communication link between the main body machine in the described first sub-meeting-place of audio frequency;
Receiving the first audio signal by described first communication link, described first audio signal is described
The audio signal of the audio signal in the sub-meeting-place of other audio frequency outside the one sub-meeting-place of audio frequency;
Play described first audio signal.
The third aspect of the embodiment of the present invention provides a kind of communication means comprising voice data, described method
The audio mixing equipment being applied in the communication system comprising voice data, including:
Determine the main body machine in the sub-meeting-place of multiple audio frequency respectively;
Receive audio signal and the identification information in the corresponding sub-meeting-place of audio frequency in the sub-meeting-place of the plurality of audio frequency respectively;
According to the identification information in the sub-meeting-place of described audio frequency, sub-for the plurality of audio frequency meeting-place will be removed the first audio frequency
The audio signal in the sub-meeting-place of other audio frequency outside sub-meeting-place carries out audio mixing and obtains the first audio signal;
Described first audio signal is sent to the main body machine in the described first sub-meeting-place of audio frequency, in order to described master
Other client that described first audio signal is sent in the described first sub-meeting-place of audio frequency by body machine is broadcast
Put.
The fourth aspect of the embodiment of the present invention provides a kind of communicator comprising voice data, described in comprise
The communicator of voice data belongs to the first sub-meeting-place of audio frequency, including:
First link establishment unit, for setting up respectively and other client in the described first sub-meeting-place of audio frequency
Between the first communication link;
Signal receiving unit, for receiving the first audio signal, described first audio signal is described first
The audio signal of the audio signal in the sub-meeting-place of other audio frequency outside the sub-meeting-place of audio frequency;
First signal transmitting unit, for dividing described first audio signal by described first communication link
It is not sent to other client described play out;
Broadcast unit, described for playing after receiving the preset time delay after described first audio signal
First audio signal, described preset time delay is the network delay average to other client described.
The embodiment of the present invention the 5th aspect provide a kind of communicator comprising voice data, described in comprise
The communicator of voice data belongs to the first sub-meeting-place of audio frequency, including:
Link establishment unit, for setting up first between the main body machine in the described first sub-meeting-place of audio frequency
Communication link;
Audio mixing receives unit, for receiving the first audio signal by described first communication link, and described the
One audio signal is the audio mixing of the audio signal in the sub-meeting-place of other audio frequency outside the described first sub-meeting-place of audio frequency
Signal;
Signal broadcast unit, is used for playing described first audio signal.
6th aspect of the embodiment of the present invention provides a kind of communicator comprising voice data, including:
Determine unit, for determining the main body machine in the sub-meeting-place of multiple audio frequency respectively;
Receive unit, for receiving the audio signal in the sub-meeting-place of the plurality of audio frequency and corresponding audio frequency respectively
The identification information in meeting-place;
Mixing operation unit, for the identification information according to the sub-meeting-place of described audio frequency, by the plurality of audio frequency
In sub-meeting-place, the audio signal in the sub-meeting-place of other audio frequency in addition to the first sub-meeting-place of audio frequency carries out audio mixing and obtains
First audio signal;
Audio signal transmitting element, for being sent to described first audio frequency meeting by described first audio signal
The main body machine of field, in order to described first audio signal is sent to described first audio frequency meeting by described main body machine
Other client in Chang plays out.
7th aspect of the embodiment of the present invention provides a kind of communication system comprising voice data, including audio mixing
Equipment and the sub-meeting-place of multiple audio frequency, in the sub-meeting-place of the plurality of audio frequency, the sub-meeting-place of each audio frequency includes multiple visitor
Family end, the plurality of client includes the first client and multiple second client;
Described audio mixing equipment is the communication the comprising voice data dress as described in terms of the embodiment of the present invention the 6th
Put;
Described first client is the communication comprising voice data as described in embodiment of the present invention fourth aspect
Device;
Described second client is the communication comprising voice data as described in terms of the embodiment of the present invention the 5th
Device.
Embodiment of the present invention eighth aspect provides a kind of system comprising voice data, including two audio frequency
Meeting-place, in the sub-meeting-place of said two audio frequency, the sub-meeting-place of each audio frequency includes the first client and multiple second
Client, wherein:
Described first client is the communication comprising voice data as described in embodiment of the present invention fourth aspect
Device;
Described second client is the communication comprising voice data as described in terms of the embodiment of the present invention the 5th
Device.
Visible, in the method for the present embodiment, arbitrary audio frequency meeting in the communication system comprise voice data
Main body machine (first client in the such as first sub-meeting-place of audio frequency) in Chang is set up and the first audio frequency respectively
First communication link of other client in meeting-place, so owing to the first client is to the first sub-meeting-place of audio frequency
In the standard deviation of network delay of other client less so that other client substantially can be synchronously
Receive the first audio signal, if the first client is after receiving a fixed response time of the first audio signal
Play this first audio signal again, so that all client terminal playing first are mixed in the first sub-meeting-place of audio frequency
Tone signal tends to synchronizing substantially, and the audio signal that this first audio signal is the sub-meeting-place of other audio frequency is mixed
Tone signal, thus will not produce owing to playing the sound in the sub-meeting-place of this audio frequency in a sub-meeting-place of audio frequency
Acoustic feedback is uttered long and high-pitched sounds and asynchronous.So can effectively suppress, due to the method for the embodiment of the present invention, the problem of uttering long and high-pitched sounds,
Make the client in the sub-meeting-place of each audio frequency can use the portable terminals such as mobile phone, and need not be special
The terminal of voice communication, reduces the cost of voice communication.
Accompanying drawing explanation
In order to be illustrated more clearly that the embodiment of the present invention or technical scheme of the prior art, below will be to reality
Execute the required accompanying drawing used in example or description of the prior art to be briefly described, it should be apparent that below,
Accompanying drawing in description is only some embodiments of the present invention, for those of ordinary skill in the art,
On the premise of not paying creative work, it is also possible to obtain other accompanying drawing according to these accompanying drawings.
Fig. 1 a is the structural representation of a kind of communication system comprising voice data in the embodiment of the present invention;
Fig. 1 b is the structural representation of the another kind of communication system comprising voice data in the embodiment of the present invention;
Fig. 2 is the flow process of a kind of communication means comprising voice data that the inventive method embodiment one provides
Figure;
Fig. 3 a is the main body that in the inventive method embodiment one, first client is defined as the first sub-meeting-place of audio frequency
A kind of method flow diagram of machine;
Fig. 3 b is the main body that in the inventive method embodiment one, first client is defined as the first sub-meeting-place of audio frequency
The another kind of method flow diagram of machine;
Fig. 4 is the flow process of a kind of communication means comprising voice data that the inventive method embodiment two provides
Figure;
Fig. 5 is the flow process of a kind of communication means comprising voice data that the inventive method embodiment three provides
Figure;
Fig. 6 is the flow process of a kind of communication means comprising voice data that the inventive method embodiment four provides
Figure;
Fig. 7 is the flow process of a kind of communication means comprising voice data that the inventive method embodiment five provides
Figure;
Fig. 8 is the structure of a kind of communicator comprising voice data that present device embodiment one provides
Schematic diagram;
Fig. 9 is the knot of the communicator that the another kind that present device embodiment one provides comprises voice data
Structure schematic diagram;
Figure 10 is the structure of a kind of communicator comprising voice data that present device embodiment two provides
Schematic diagram;
Figure 11 is the knot of the communicator that the another kind that present device embodiment two provides comprises voice data
Structure schematic diagram;
Figure 12 is the structure of a kind of communicator comprising voice data that present device embodiment three provides
Schematic diagram;
Figure 13 is the structure of a kind of communicator comprising voice data that present device embodiment three provides
Schematic diagram;
Figure 14 is the structure of a kind of communicator comprising voice data that present device embodiment four provides
Schematic diagram.
Detailed description of the invention
Below in conjunction with the accompanying drawing in the embodiment of the present invention, the technical scheme in the embodiment of the present invention is carried out
Clearly and completely describe, it is clear that described embodiment is only a part of embodiment of the present invention, and
It is not all, of embodiment.Based on the embodiment in the present invention, those of ordinary skill in the art are not making
Go out the every other embodiment obtained under creative work premise, broadly fall into the scope of protection of the invention.
Term " first " in description and claims of this specification and above-mentioned accompanying drawing, " second ", "
Three " (if present) such as " 4th " is for distinguishing similar object, the most suitable without being used for describing
Sequence or precedence.Should be appreciated that the data of so use can be exchanged in the appropriate case, in order to here
The embodiments of the invention described such as can be with the order in addition to those here illustrating or describing
Implement.Additionally, term " includes " and " having " and their any deformation, it is intended that cover not exclusively
Comprise, such as, contain series of steps or the process of unit, method, system, product or equipment
It is not necessarily limited to those steps or the unit clearly listed, but can include that the most clearly list or right
In intrinsic other step of these processes, method, product or equipment or unit.
The inventive method embodiment one
A kind of communication means comprising voice data is provided, mainly can apply to as seen in figure la and lb
Comprising the communication system of voice data, system as shown in Figure 1a includes the sub-meeting-place of multiple audio frequency and audio mixing
Equipment, includes multiple client in the sub-meeting-place of each audio frequency, some client in these multiple clients
(the such as first client) can be as main body machine, other client in main body machine meeting-place sub-with this audio frequency respectively
End is communicatively coupled, and audio mixing equipment is communicatively coupled with these multiple clients respectively and (does not shows in Fig. 1 a
Go out the communication connection between audio mixing equipment and nonbody machine).Wherein:
Client can add the sub-meeting-place of a certain audio frequency, and between other client, foundation comprises voice data
Communication session and carry out, with other client, the communication that comprises voice data, wherein comprise voice data
Communication can be the communication of pure audio data, or the communication etc. of video data.Client is mainly used in right
It is picked up apart from a range of sound of this client, and pickup signal is sent to audio mixing equipment enters
Row audio mixing;Client as main body machine is additionally operable to receive the audio signal that audio mixing equipment sends, and will connect
The audio signal received is sent to other client in the sub-meeting-place of affiliated audio frequency and plays out.The embodiment of the present invention
In client can be the visitor of the voice communication loaded in portable terminal (such as mobile phone or pad etc.)
Family end.
Audio mixing equipment meeting-place sub-with each audio frequency respectively is connected, and is mainly used in receiving the sub-meeting-place of each audio frequency
Audio signal, and re-send to the main body in the sub-meeting-place of each audio frequency after the audio signal received is carried out audio mixing
Machine, main body machine other client that the audio signal of reception is sent to the sub-meeting-place of affiliated audio frequency is broadcast
Put.
System as shown in Figure 1 b includes two sub-meeting-place of audio frequency (the i.e. first sub-meeting-place of audio frequency and the second sound
The most sub-meeting-place), the sub-meeting-place of each audio frequency includes multiple client, some client (ratio in multiple clients
Such as the first client) can communicate between the main body machine in the sub-meeting-place of two of which audio frequency as main body machine
Connect.After any body machine can carry out audio mixing to the audio signal in the sub-meeting-place of audio frequency belonging to this main body machine
It is sent to the main body machine in the sub-meeting-place of another audio frequency.
The method of the present embodiment is by the sub-meeting-place of audio frequency a certain in system (the such as first sub-meeting-place of audio frequency)
As the method performed by the first client of main body machine, flow chart is as in figure 2 it is shown, include:
Step 101, sets up and the first communication link between other client in the sub-meeting-place of the first audio frequency respectively.
It is appreciated that user can operate the first client so that this first client joins a certain sound
In the most sub-meeting-place (the such as first sub-meeting-place of audio frequency), such as can pass through " shaking ", or " face-to-face
Build group " user operation instruction so that other in the first client-side search to a range of space
The client of voice communication, and together join the first sub-meeting-place of audio frequency with the client of other voice communication
In.In the present embodiment, add the multiple clients in the sub-meeting-place of same audio frequency and be mainly in certain limit
The interior client in space, the client in such as one room, or a certain wireless network coverage
Interior client.
After multiple clients join the first sub-meeting-place of audio frequency, need to determine one in these multiple clients
Individual client (the such as first client) is as main body machine, then other client is nonbody machine.In reality
In the application of border, when determining the main body machine in the sub-meeting-place of a certain audio frequency, can be set by audio mixing equipment or third party
Come really for the network delay average arriving other client according to each client in a sub-meeting-place of audio frequency respectively
Fixed.Specifically determine that the process of main body machine can have a following two ways:
(1) in the case of as shown in Figure 1a, after multiple clients join the first sub-meeting-place of audio frequency,
Multiple clients just and are communicatively coupled between audio mixing equipment, can select one by audio mixing equipment
Main body machine.
With reference to shown in Fig. 3 a, in this case, for the first client, performing following step
After rapid A1 to A3, the first client can be triggered and start to perform the flow process of step 101 to 104:
Step A1, obtains the network delay of other client in the first client to the first sub-meeting-place of audio frequency equal
Value.
First client can be completed by PING mode to the network delay value of another client, and i.e. first
Client sends network Internet Control Message Protocol (Internet Control Messages to another client
Protocol, ICMP) echo request, meeting after another client receives ICMP echo request
Auto-returned ICMP return response message, will send ICMP request bag and receives between ICMP response bag
Time interval is as the networking time delay value of this first client to another client, the net of this first client
Network time delay average is that the first client is respectively to the network delay value of other client in the first sub-meeting-place of audio frequency
Meansigma methods.
Step A2, is sent to comprise the communication system of voice data by the network delay average of the first client
In audio mixing equipment, such audio mixing equipment other client in obtaining the first sub-meeting-place of audio frequency is corresponding
After network delay average, choose client corresponding to wherein minimum network delay average (the such as first visitor
Family end) as main body machine, in the sub-meeting-place of network delay average ratio the first audio frequency of the i.e. first client other
The network delay average of client is the least, then audio mixing equipment can send announcement information to the first client.
Step A3, receives the announcement information that audio mixing equipment sends, and this announcement information includes that the first client is made
It is the information of the main body machine in the first sub-meeting-place of audio frequency.
(2) in the case of as shown in Figure 1 b, after multiple clients join the first sub-meeting-place of audio frequency,
A main body machine can be selected by the third party device being all connected with multiple clients respectively.3rd
Method, apparatus can be the management equipment etc. in system for multiple clients.
With reference to shown in Fig. 3 b, in this case, for the first client, performing following step
After rapid B1 to B3, the first client can be triggered and start to perform the flow process of step 101 to 104:
Step B1, obtains the network delay of other client in the first client to the first sub-meeting-place of audio frequency equal
Value.
Step B2, is sent to third party device, such third party by the network delay average of the first client
After the equipment network delay average that other client is corresponding in obtaining the first sub-meeting-place of audio frequency, choose it
Client (the such as first client) corresponding to the network delay average of middle minimum is as main body machine, concurrently
Send announcement information to the first client.
Step B3, receives the announcement information that third party device sends, and this announcement information includes the first client
Information as the main body machine in the first sub-meeting-place of audio frequency.
So, after determining main body machine by said method, the main body machine in the sub-meeting-place of arbitrary audio frequency is to this sound
The standard deviation of the network delay of other client in the most sub-meeting-place is minimum.
Step 102, receives the first audio signal, and this first audio signal is outside the first sub-meeting-place of audio frequency
The audio signal of the audio signal in the sub-meeting-place of other audio frequency.
In the case of the one such as Fig. 1 a, the audio signal in audio mixing equipment meeting-place sub-to each audio frequency carry out
Audio mixing, the first client is to receive the first audio signal that audio mixing equipment sends.As shown in Figure 1 b
In the case of Zhong, the audio signal in the meeting-place sub-to affiliated audio frequency of the main body machine in the sub-meeting-place of each audio frequency carry out
Audio mixing, the first client is to receive the first audio signal that the main body machine in the second sub-meeting-place of audio frequency sends.
Step 103, the first audio signal is sent respectively to by the first communication link set up by step 101
Other client in the first sub-meeting-place of audio frequency plays out.
Step 104, plays the first audio signal after the preset time delay after receiving the first audio signal,
Preset time delay is the network delay average to other client.
Owing to the first client is to need certain network when sending the first audio signal to other client
Time delay, then the first client is play first after receiving the certain time after the first audio signal again and is mixed
During tone signal, it is only possible to so that in the first sub-meeting-place of audio frequency, all client synchronization play this first audio mixing letter
Number.Wherein certain time is network delay average, and the specially first client transmits a signal to first respectively
The average of time, i.e. network delay average used by other client in the sub-meeting-place of audio frequency.
It should be noted that ordering relation the most absolute between above-mentioned steps 103 and 104, Ke Yitong
Shi Zhihang, it is also possible to order performs, the simply one of which concrete implementation mode shown in Fig. 2.
Visible, in the method for the present embodiment, arbitrary audio frequency meeting in the communication system comprise voice data
Main body machine (first client in the such as first sub-meeting-place of audio frequency) in Chang is set up and the first audio frequency respectively
First communication link of other client in meeting-place, so due to main body machine (the i.e. first client) to
In the one sub-meeting-place of audio frequency, the standard deviation of the network delay of other client is less so that other client's end group
Originally the first audio signal can be synchronously received, if main body machine is receiving the one of the first audio signal
This first audio signal is play again, so that all clients are broadcast in a sub-meeting-place of audio frequency after fixed response time
Put the first audio signal substantially to tend to synchronizing;And owing to all clients in the sub-meeting-place of some audio frequency are broadcast
The audio signal put is the most identical, and is the audio signal of the audio signal in the sub-meeting-place of other audio frequency, does not exists
The sub-meeting-place of this audio frequency is play the sound in the sub-meeting-place of this audio frequency and produces acoustic feedback and utter long and high-pitched sounds.So due to this
The method of bright embodiment can suppress the problem of uttering long and high-pitched sounds effectively so that the client in the sub-meeting-place of each audio frequency can
To use the portable terminals such as mobile phone, and the terminal of voice communication that need not be special, reduce voice communication
Cost.
It should be noted that the method for above-mentioned steps 101 to 104 is that the first client is at downlink reception first
The process of audio signal, mainly has the following two kinds feelings for the first client in the process of up transmission signal
Condition:
(1) in system as shown in Figure 1a, the first client can obtain pickup signal, by this pickup signal
And first identification information in the sub-meeting-place of audio frequency, the signal after maybe pickup signal being processed at least one times
And first the identification information in the sub-meeting-place of audio frequency be sent to audio mixing equipment, such audio mixing equipment can be by pickup signal
Or at least one second audio frequency outside pickup signal and the first sub-meeting-place of audio frequency after processing at least one times
After the audio signal in meeting-place carries out audio mixing, it is sent to the client in the 3rd sub-meeting-place of audio frequency.Wherein,
It is to allow audio mixing equipment know this audio mixing equipment that one client sends the identification information in the first sub-meeting-place of audio frequency
Which signal received is belonging to the sub-meeting-place of same audio frequency.
In one case, the first client, when obtaining pickup signal, can obtain this first client
The first pickup signal.Signal after processing pickup signal at least one times is to the first ten obtained
Tone signal carries out the signal after stereo echo Processing for removing.
In another case, the first client, when obtaining pickup signal, mainly obtains the first audio frequency
The second pickup signal that in sub-meeting-place, other client (i.e. nonbody machine) sends and obtain the first client
The first pickup signal.Signal after processing pickup signal at least one times is for the first pickup signal
The audio signal in the first sub-meeting-place of audio frequency obtained after carrying out audio mixing with the second pickup signal, or to the first ten
Tone signal carries out the signal after stereo echo Processing for removing, obtains after carrying out audio mixing with the second pickup signal
The audio signal in the first sub-meeting-place of audio frequency.
In other cases, the first client, when obtaining pickup signal, mainly obtains the first audio frequency
After what in meeting-place, other client (i.e. nonbody machine) sent carried out stereo echo Processing for removing the 3rd
Pickup signal, and obtain the first pickup signal of the first client.Pickup signal is located at least one times
Signal after reason be the 3rd pickup signal and the second pickup signal are carried out audio mixing after the first audio frequency of obtaining
The audio signal in meeting-place, or the first pickup signal is carried out the signal after stereo echo Processing for removing, with
The audio signal in the first sub-meeting-place of audio frequency that the 3rd pickup signal obtains after carrying out audio mixing.
It should be noted that above-mentioned two kinds of situations below are that the main body machine by the sub-meeting-place of each audio frequency should
The audio signal in the sub-meeting-place of audio frequency is then forwarded to audio mixing equipment audio mixing again after carrying out audio mixing, the most permissible
Shared a part of mixing operation by main body machine, alleviate the burden of audio mixing equipment.
(2) in system as shown in Figure 1 b, when the first client is being defined as the first sub-meeting-place of audio frequency
During main body machine, the first client not only needs and sets up in the sub-meeting-place of the first audio frequency between other client
One communication link, in addition it is also necessary to set up the second communication link between the main body machine in the sub-meeting-place of the second audio frequency.
During such first client executing above-mentioned steps 102, it is to receive the second audio frequency by this second communication link
The first audio signal that main body machine in meeting-place sends.And the first client is when up transmission signal:
First client can by each client in the first sub-meeting-place of audio frequency (include the first client and other
Client) audio signal carry out audio mixing and obtain the second audio signal, then will by the second communication link
Second audio signal is sent to the main body machine in the second sub-meeting-place of audio frequency, in order to the second audio mixing is believed by this main body machine
Number it is sent to the nonbody machine in the second sub-meeting-place of audio frequency.Wherein the audio signal of each client can be each
The pickup signal of individual client, or for the pickup signal of each client is carried out at stereo echo elimination
Signal after reason.
The inventive method embodiment two
A kind of communication means comprising voice data is provided, mainly can apply to as illustrated in figs. ia and ib
The communication system comprising voice data in, the method for the present embodiment is by the sub-meeting-place of audio frequency a certain in system
As the method performed by the second client of nonbody machine, flow process in (the such as first sub-meeting-place of audio frequency)
Scheme as shown in Figure 4, including:
Step 201, sets up the first communication link between the main body machine in the sub-meeting-place of the first audio frequency.
It is appreciated that user can operate the second client so that this second client joins a certain sound
In the most sub-meeting-place (the such as first sub-meeting-place of audio frequency), such as can pass through " shaking ", or " face-to-face
Build group " user operation instruction so that the second client together adds with the client of other voice communication
In the first sub-meeting-place of audio frequency.In the present embodiment, add the multiple clients in the sub-meeting-place of same audio frequency
The client in space the most within the specific limits.
After multiple clients join the first sub-meeting-place of audio frequency, can be by audio mixing equipment or third party device
The network delay average arriving other client according to each client in a sub-meeting-place of audio frequency respectively determines
The main body machine in the sub-meeting-place of this audio frequency and nonbody machine.The process specifically determined can have a following two ways:
(1) in the case of as shown in Figure 1a, after multiple clients join the first sub-meeting-place of audio frequency,
Multiple clients just and are communicatively coupled between audio mixing equipment, can determine main body by audio mixing equipment
Machine and nonbody machine.
In this case, for the second client, after performing following steps, can touch
Send out the second client and start to perform the flow process of step 201 to 203: obtain the second client to the first audio frequency
The network delay average of other client in meeting-place;The network delay average of the second client is sent to bag
Audio mixing equipment in communication system containing voice data;If the network delay average ratio of the first client
In the one sub-meeting-place of audio frequency, the network delay average of other client in addition to the first client is little, receives mixed
The announcement information that sound equipment sends, this announcement information includes that the first client is as the first sub-meeting-place of audio frequency
The information of main body machine.
Wherein, obtaining the second client can be as above-mentioned to the method for the network delay average of other client
First client obtains the method for corresponding network delay average, does not repeats at this.
(2) in the case of as shown in Figure 1 b, after multiple clients join the first sub-meeting-place of audio frequency,
Main body machine and nonbody machine can be determined by the third party device being all connected with multiple clients respectively.
This third party device can be the management equipment etc. in system for multiple clients.
In this case, for the second client, after performing following steps, can touch
Send out the second client and start to perform the flow process of step 201 to 203: obtain the second client to the first audio frequency
The network delay average of other client in meeting-place;The network delay average of the second client is sent to
Three method, apparatus;If except the first client in the sub-meeting-place of network delay average ratio the first audio frequency of the first client
The network delay average of other client outside end is little, receives the announcement information that third party device sends,
This announcement information includes first client information as the main body machine in the first sub-meeting-place of audio frequency.
Step 202, receives the first audio signal by the first communication link, and this first audio signal is first
The audio signal of the audio signal in the sub-meeting-place of other audio frequency outside the sub-meeting-place of audio frequency.
Step 203, plays the first audio signal.
Visible, in the method for the present embodiment, due in a sub-meeting-place of audio frequency main body machine to this audio frequency meeting
In Chang, other client i.e. standard deviation of the network delay of nonbody machine is less, the of such downlink reception
One audio signal can be sent to other client by the main body machine in a sub-meeting-place of audio frequency so that other
Client can be synchronously received the first audio signal substantially, so that non-in a sub-meeting-place of audio frequency
Main body machine sowing is put audio signal and is substantially tended to synchronizing.And each client terminal playing that first in the sub-meeting-place of audio frequency
The first audio signal identical, and be the audio signal of the audio signal in the sub-meeting-place of other audio frequency, do not exist
The sound in the sub-meeting-place of this audio frequency is play in this sub-meeting-place of the first audio frequency and produces acoustic feedback and utter long and high-pitched sounds.Therefore due to
The method of the embodiment of the present invention can suppress the problem of uttering long and high-pitched sounds effectively so that the client in the sub-meeting-place of each audio frequency
End can use the portable terminals such as mobile phone, and the terminal of voice communication that need not be special, reduce audio frequency
The cost of communication.
It should be noted that the method for above-mentioned steps 201 to 203 is that the second client is at downlink reception first
The process of audio signal, mainly has the following two kinds feelings for the second client in the process of up transmission signal
Condition:
(1) in system as shown in Figure 1a, the second client can be by the second pickup letter of the second client
Number and the identification information in the sub-meeting-place of the first audio frequency audio mixing that is sent in the communication system comprising voice data set
Standby, the signal after maybe the second pickup signal being processed at least one times and the mark in the sub-meeting-place of the first audio frequency
Knowledge information is sent to audio mixing equipment, is so sent by the client in audio mixing equipment meeting-place sub-to each audio frequency
Signal carries out audio mixing.Wherein, the second client sends the identification information in the first sub-meeting-place of audio frequency is to allow
Audio mixing equipment knows which signal that this audio mixing equipment receives is belonging to the sub-meeting-place of same audio frequency.
(2) in system as shown in Figure 1 b, the second client can be by the second pickup letter of the second client
Number, or the signal after processing the second pickup signal at least one times is sent to main body machine, and main body machine will
After the signal that in the first sub-meeting-place of audio frequency, each nonbody machine sends carries out audio mixing, it is sent to the second audio frequency
The main body machine in meeting-place.
Wherein, it is processed as at least one times carrying out stereo to the second pickup signal to the second pickup signal
Signal after echo cancellation process.
Further, in a specific embodiment, if the main body machine in the first sub-meeting-place of audio frequency moves back
Going out the first sub-meeting-place of audio frequency, the use user of such as main body machine leaves other client in the first sub-meeting-place of audio frequency
The a range of space at end place, in order to maintain the communication of current voice data, can be by this enforcement
Second client (i.e. nonbody machine) of example can be set up and the first audio frequency respectively as new main body machine
In sub-meeting-place, other remains the third communication link between client;If by another client (except
Client outside two clients) as new main body machine, then second client of the present embodiment can be set up
And the fourth communication link between main body machine new in the first sub-meeting-place of audio frequency.
Wherein, this second client can be come by audio mixing equipment or third party device as new main body machine
Determine, after audio mixing equipment or third party device determine new main body machine (the such as second client),
Can send announcement information to this second client, this announcement information includes that the second client is new main body machine
Information.So after the second client receives announcement information, just set up with other residue client it
Between third communication link.
The inventive method embodiment three
A kind of communication means comprising voice data is provided, mainly can apply to comprising as shown in Figure 1a
In the communication system of voice data, the method for the present embodiment is the method performed by audio mixing equipment in system,
Flow chart is as it is shown in figure 5, include:
Step 301, determines the main body machine in the sub-meeting-place of multiple audio frequency respectively.
Specifically, audio mixing equipment is determining the master in a sub-meeting-place of audio frequency (the such as first sub-meeting-place of audio frequency)
During body machine, can be according to the network delay average of each client in the sub-meeting-place of this audio frequency to other client
Determining, specifically, audio mixing equipment can obtain each client in the first sub-meeting-place of audio frequency respectively and arrive it
The network delay average of its client, if the first client is to other client in the first sub-meeting-place of audio frequency
The network delay average of network delay other client of average ratio little, the first client is defined as first
The main body machine in the sub-meeting-place of audio frequency;Transmission announcement information is to the first client, and announcement information includes the first client
Hold the information of the main body machine as the first sub-meeting-place of audio frequency.
If the first client exits the first sub-meeting-place of audio frequency, the use user of the such as first client leaves
The a range of space at first other client place in the sub-meeting-place of audio frequency, then in the first sub-meeting-place of audio frequency
Including multiple residue clients, audio mixing equipment also needs to redefine first in these multiple residue clients
The main body machine in the sub-meeting-place of audio frequency.
Step 302, receives audio signal and the mark in the corresponding sub-meeting-place of audio frequency in the sub-meeting-place of multiple audio frequency respectively
Information.
In one case, the client in the sub-meeting-place of each audio frequency all can be adjusted the distance the certain model of this client
Enclose interior sound to be picked up, it is possible to the pickup signal obtained is transmitted directly to audio mixing equipment, by mixing
Sound equipment carries out mixing operation.In this case, in the sub-meeting-place of multiple audio frequency that audio mixing equipment receives
The audio signal in the sub-meeting-place of arbitrary audio frequency is the audio signal that in the sub-meeting-place of arbitrary audio frequency, each client sends.
In another case, the client in the sub-meeting-place of each audio frequency can be adjusted the distance the certain model of this client
Enclose interior sound to be picked up, the client in meeting-place sub-for arbitrary audio frequency, the pickup letter that can will obtain
Number it is sent to the main body machine in the sub-meeting-place of this audio frequency, by each client in main body machine meeting-place sub-to this audio frequency
Pickup signal carry out audio mixing after audio signal is sent to audio mixing equipment, by audio mixing equipment to each audio frequency
The audio signal that the main body machine in sub-meeting-place sends carries out mixing operation again.In this case, audio mixing sets
In the standby sub-meeting-place of multiple audio frequency received, the audio signal in the sub-meeting-place of arbitrary audio frequency is for arbitrary audio frequency meeting
Signal after the audio signal of each client carries out audio mixing in Chang.So a part of mixing operation is placed
Operate to client, alleviate the burden of the audio mixing equipment of the present embodiment.
Further, each client in the sub-meeting-place of each audio frequency after obtaining pickup signal, Ke Yixian
Pickup signal carries out stereo echo Processing for removing, and the signal after processing the most again is sent to audio mixing and sets
Standby.Owing to the echo in the sub-meeting-place of audio frequency is eliminated, it is possible to be effectively prevented from audio mixing equipment and echo is mixed
Enter to be formed circulation in effective audio signal of client pickup and then utter long and high-pitched sounds.In this case, audio mixing
In the sub-meeting-place of multiple audio frequency that equipment receives, the audio signal in the sub-meeting-place of arbitrary audio frequency is for arbitrary audio frequency
The pickup signal of the client in meeting-place carries out the signal after stereo echo Processing for removing.
Step 303, according to the identification information in the sub-meeting-place of audio frequency, will remove the first audio frequency in sub-for multiple audio frequency meeting-place
The audio signal in the sub-meeting-place of other audio frequency outside sub-meeting-place carries out audio mixing and obtains the first audio signal.Wherein,
The identification information in the sub-meeting-place of audio frequency is primarily to determine which audio signal belongs to the sub-meeting-place of same audio frequency
's.
In one case, the audio frequency letter that the client in sub-for same audio frequency meeting-place is first sent by audio mixing equipment
Number carrying out audio mixing obtains the audio signal that the sub-meeting-place of each audio frequency is corresponding, the most again by sub-for difference audio frequency meeting-place
Corresponding audio signal carries out audio mixing again.
In the case of another kind, if audio mixing equipment receives each of the main body machine transmission in the sub-meeting-place of each audio frequency
The audio signal that the sub-meeting-place of individual audio frequency is corresponding, the audio mixing equipment audio mixing that meeting-place sub-to each audio frequency is corresponding again is believed
Number carry out audio mixing again.
Step 304, is sent to the main body machine in the first sub-meeting-place of audio frequency, in order to main body machine by the first audio signal
Other client first audio signal being sent in the first sub-meeting-place of audio frequency plays out, and such first
The audio signal of each client terminal playing in the sub-meeting-place of audio frequency is identical, is the first audio signal,
It is the audio signal in the sub-meeting-place of other audio frequency (the i.e. second sub-meeting-place of audio frequency), there is not this first audio frequency
In meeting-place, the pickup signal of other client is mixed into and produces and utter long and high-pitched sounds.
Visible, in the method for the present embodiment, audio mixing equipment can be by except the sub-meeting-place of a certain audio frequency such as first
The audio signal in the sub-meeting-place of other audio frequency outside the sub-meeting-place of audio frequency carries out audio mixing and obtains the first audio signal,
And the first audio signal is sent to the main body machine in this sub-meeting-place of the first audio frequency, then it is sent to by main body machine
Other client plays out.Audio signal phase due to the client terminal playing in the sub-meeting-place of some audio frequency
With, and be the audio signal of the audio signal in the sub-meeting-place of other audio frequency, do not exist in the sub-meeting-place of this audio frequency and broadcast
Put the sound in the sub-meeting-place of this audio frequency and produce acoustic feedback and utter long and high-pitched sounds.Further, due to main body machine to audio frequency
In meeting-place, the standard deviation of the network delay of other client is less so that other client substantially can be same
Receive the first audio signal to step, if main body machine is receiving the first audio mixing letter that audio mixing equipment sends
Number a fixed response time after play this first audio signal again, so that all visitors in a sub-meeting-place of audio frequency
Family end is play the first audio signal and is substantially tended to synchronizing.
The inventive method embodiment four
A kind of communication means comprising voice data is provided, be applied to as shown in Figure 1a include voice data
Communication system in, the method flow diagram of the present embodiment as shown in Figure 6, including:
Step 401, client adds the sub-meeting-place of audio frequency, forms the sub-meeting-place of plural audio frequency, the most each
Each client in the sub-meeting-place of individual audio frequency is connected with audio mixing communication between devices respectively.
In the present embodiment, user is by the client loaded in mobile phone, joins certain in the way of certain is arranged
The sub-meeting-place of individual audio frequency.Owing to possessing pickup microphone and speaker on mobile phone, so by the mobile phone of oneself
Pickup in relatively short distance, pickup effect is guaranteed, and same mobile phone is closely play sound and be can ensure that use
Family can effectively be listened to.
Step 402, if there is multiple client in a sub-meeting-place of audio frequency, audio mixing selection of equipment one of them
Client as main body machine, the standard deviation of the network delay of other client in the sub-meeting-place of main body machine to audio frequency
Difference minimum.
Step 403, other client in the main body machine in the sub-meeting-place of each audio frequency meeting-place sub-with affiliated audio frequency respectively
The first communication link is set up between end.
Step 404, it is judged that whether the main body machine in a sub-meeting-place of audio frequency exits the sub-meeting-place of affiliated audio frequency,
Without exiting, then perform step 405;If exited, then return and perform step 402, switch audio frequency
Main body machine in sub-meeting-place, chooses another main body machine, and re-establishes connection.
Step 405, for any one client in meeting-place sub-for certain audio frequency, this client is to this
Sound in the sub-meeting-place of audio frequency is picked up obtaining pickup signal, then pickup signal is carried out stereo time
Sound Processing for removing.
In one case, after the client in the sub-meeting-place of each audio frequency will carry out stereo echo Processing for removing
Pickup signal and the identification information in the corresponding sub-meeting-place of audio frequency be transmitted directly to audio mixing equipment, by audio mixing equipment
Perform step 406.
In the case of another kind, in order to alleviate the burden of audio mixing equipment, a part of mixing operation can be placed
On main body machine, then after the pickup signal of main body machine is carried out stereo echo Processing for removing by main body chance,
With receive other client send carry out stereo Processing for removing after pickup signal carry out stereo process
Obtain the audio signal that the sub-meeting-place of this audio frequency is corresponding, and by belonging to the audio signal obtained and this main body machine
The identification information in the sub-meeting-place of audio frequency is sent to audio mixing equipment, audio mixing equipment perform step 407.
Step 406, after audio mixing equipment receives the audio signal in the sub-meeting-place of each audio frequency, according to corresponding sound
The identification information in the most sub-meeting-place, is first carried out the audio signal that the client in sub-for same audio frequency meeting-place sends
Audio mixing obtains the audio signal that the sub-meeting-place of each audio frequency is corresponding;The most again by corresponding for the different sub-meeting-place of audio frequency
Audio signal carries out audio mixing again.
Step 407, after audio mixing equipment receives the audio signal of main body machine transmission in the sub-meeting-place of each audio frequency,
The audio signal in sub-for each audio frequency meeting-place is carried out audio mixing again.
Wherein, in step 406 and 407, the principle of audio mixing equipment audio mixing again is by sub-for a certain audio frequency meeting-place (ratio
Such as the first sub-meeting-place of audio frequency) outside audio signal audio mixing again corresponding to the sub-meeting-place of other audio frequency obtain
A whole audio signal the such as first audio signal.
Step 408, the first audio signal is sent to the main body machine in the first sub-meeting-place of audio frequency by audio mixing equipment,
Other client this first audio signal being sent in the first sub-meeting-place of audio frequency by main body machine.
Step 409, other client is direct after receiving the first audio signal plays this first audio signal,
This first audio signal is just play after main body machine then certain network delay after receiving the first audio signal.
In the present embodiment, due in a sub-meeting-place of audio frequency main body machine to other client in the sub-meeting-place of this audio frequency
The standard deviation of the i.e. network delay of nonbody machine of end is minimum so that other client substantially can be synchronously
Receive audio signal, if main body machine is at the fixed response time receiving the audio signal that audio mixing equipment sends
After play this audio signal again, so that all client terminal playing audio signal in a sub-meeting-place of audio frequency
Substantially tend to synchronizing.
The inventive method embodiment five
A kind of communication means comprising voice data is provided, be applied to as shown in Figure 1 b comprise voice data
Communication system in, the method flow diagram of the present embodiment as it is shown in fig. 7, comprises:
Step 501, client adds the sub-meeting-place of audio frequency, forms two sub-meeting-place of audio frequency, the i.e. first audio frequency
Meeting-place and the sub-meeting-place of the second audio frequency.
In the present embodiment, user is by the client loaded in mobile phone, joins certain in the way of certain is arranged
The sub-meeting-place of individual audio frequency.Wherein, the multiple clients in the sub-meeting-place of same audio frequency refer to a range of
The client that mobile phone in space loads respectively.Owing to possessing pickup microphone and speaker on mobile phone, this
Sample mobile phone pickup in relatively short distance by oneself, pickup effect is guaranteed, and same mobile phone is closely
Play sound and can ensure that user can effectively listen to.
The third party device that in step 502, with two sub-meeting-place of audio frequency, client all communicates to connect determines each
The main body machine in the sub-meeting-place of audio frequency, the network delay of other client in main body machine to the sub-meeting-place of affiliated audio frequency
Standard deviation is minimum.
Step 503, sets up the second communication link between the main body machine in two sub-meeting-place of audio frequency, each audio frequency
The main body machine in meeting-place respectively and sets up the first communication link between other client in the sub-meeting-place of affiliated audio frequency.
Step 504, for the nonbody machine in meeting-place sub-for certain audio frequency, mainly to this audio frequency meeting
Sound in Chang is picked up obtaining pickup signal, then carries out pickup signal at stereo echo elimination
Reason, the pickup signal after processing is sent to the main body machine in the sub-meeting-place of affiliated audio frequency by the first communication link.
In the present embodiment, owing in the sub-meeting-place of each audio frequency, the audio signal of all client terminal playing is the most identical,
Then each client all can utilize identical signal as echo reference when doing stereo echo Processing for removing
Signal, so can the echo in meeting-place sub-to audio frequency effectively eliminate.
Step 505, for the main body machine in meeting-place sub-for certain audio frequency, mainly obtains pickup signal also
Pickup signal is carried out stereo echo Processing for removing, as other client receiving the sub-meeting-place of affiliated audio frequency
The signal that end sends, after carrying out stereo echo Processing for removing by each signal received and this main body machine
Signal carries out audio mixing and obtains audio signal.
Step 506, the second communication chain that audio signal step 505 obtained is set up by above-mentioned steps 503
Road is sent to the main body machine in the sub-meeting-place of another audio frequency, and the audio signal of reception is then forwarded to by main body machine
Other client in the affiliated sub-meeting-place of audio frequency.
Step 507, directly plays the audio signal of reception as the client of nonbody machine, and main body machine then exists
The audio signal of reception is play after receiving the certain network delay after audio signal.
In the method for the present embodiment, the audio signal of each client terminal playing in the sub-meeting-place of same audio frequency
Identical, and be the audio signal of the audio signal in the sub-meeting-place of another audio frequency, do not exist in the sub-meeting-place of this audio frequency
Play the sound in the sub-meeting-place of this audio frequency and produce acoustic feedback and utter long and high-pitched sounds.And the present embodiment is carried out by main body machine
Mixing operation, carries out mixing operation without single audio mixing equipment, saves the resource of the network equipment.
Present device embodiment one
Also providing for a kind of communicator comprising voice data, this communicator comprising voice data is
The main body machine in the one sub-meeting-place of audio frequency, ratio the first client described above, its structural representation as shown in Figure 8,
Specifically may include that
First link establishment unit 10, for setting up respectively and other client in the described first sub-meeting-place of audio frequency
The first communication link between end.
Signal receiving unit 11, for receiving the first audio signal, described first audio signal is described the
The audio signal of the audio signal in the sub-meeting-place of other audio frequency outside the one sub-meeting-place of audio frequency.Signal receiving unit
11 can receive the audio mixing equipment in the communication system comprising voice data or the main body in the sub-meeting-place of the second audio frequency
The first audio signal that machine sends.
First signal transmitting unit 12, first for being set up by described first link establishment unit 10 is led to
The first audio signal that described signal receiving unit 11 receives is sent respectively to other client described by letter link
End plays out.
Broadcast unit 13, for after described signal receiving unit 11 receives described first audio signal
Preset time delay after play described first audio signal, described preset time delay is to other client described
Network delay average, the specially first client transmits a signal to other visitor in the first sub-meeting-place of audio frequency respectively
The average of time used by the end of family, i.e. network delay average.
In the device of the present embodiment, the first link establishment unit 10 is set up and the first sub-meeting-place of audio frequency respectively
First communication link of other client, so owing to the device of the present embodiment is in the first sub-meeting-place of audio frequency
The standard deviation of the network delay of other client is less so that other client can synchronously connect substantially
Receive the first audio signal, if signal receiving unit 11 is receiving a fixed response time of the first audio signal
After play this first audio signal by broadcast unit 13 again, so that all visitors in a sub-meeting-place of audio frequency
Family end is play the first audio signal and is substantially tended to synchronizing;And due to all visitors in the sub-meeting-place of some audio frequency
The audio signal that family end is play is the most identical, and is the audio signal of the audio signal in the sub-meeting-place of other audio frequency,
Do not exist and the sub-meeting-place of this audio frequency is play the sound in the sub-meeting-place of this audio frequency and produces acoustic feedback and utter long and high-pitched sounds.So by
In can effectively suppress the problem of uttering long and high-pitched sounds so that the client i.e. dress of the present embodiment in the sub-meeting-place of each audio frequency
Put and can use the portable terminals such as mobile phone, and the terminal of voice communication that need not be special, reduce audio frequency
The cost of communication.
With reference to shown in Fig. 9, in a specific embodiment, comprise the communicator of voice data except can
To include outside structure as shown in Figure 8, it is also possible to include secondary signal transmitting element 14, the second link establishment
Unit 15, the 3rd signal transmitting unit 16, add unit 17, the first average transmitting element 18 and the first letter
Breath receives unit 19, wherein:
Secondary signal transmitting element 14, is used for obtaining pickup signal, by described pickup signal and described first
The identification information in the sub-meeting-place of audio frequency, signal after maybe described pickup signal being processed at least one times and
The identification information in the described first sub-meeting-place of audio frequency is sent to described audio mixing equipment.
Described secondary signal transmitting element 14, specifically for obtaining the first pickup letter of described first client
Number;Described described pickup signal is processed at least one times after signal for described first pickup signal
Carry out the signal after stereo echo Processing for removing;
Or, described secondary signal transmitting element 14, specifically for obtain that other client described sends the
Two pickup signal and obtain the first pickup signal of described first client;Described described pickup signal is entered
Walk to the signal after few single treatment for described second pickup signal to be mixed with described first pickup signal
The audio signal in the described first sub-meeting-place of audio frequency obtained after sound, or described first pickup signal is stood
Signal after body acoustic echo Processing for removing, described obtained after carrying out audio mixing with described second pickup signal
The audio signal in the one sub-meeting-place of audio frequency;
Or, described secondary signal transmitting element 14, specifically for obtaining entering of described other client transmission
The 3rd pickup signal after row stereo echo Processing for removing, and obtain the first the ten of described first client
Tone signal;Described described pickup signal is processed at least one times after signal for described 3rd pickup
The audio signal in the described first sub-meeting-place of audio frequency that signal and described first pickup signal obtain after carrying out audio mixing,
Or described first pickup signal is carried out the signal after stereo echo Processing for removing, with described 3rd pickup
The audio signal in the described first sub-meeting-place of audio frequency that signal obtains after carrying out audio mixing.
Second link establishment list 15, leads to for setting up between the main body machine in the sub-meeting-place of the second audio frequency second
Letter link.
3rd signal transmitting unit 16, for by the audio frequency of each client in the described first sub-meeting-place of audio frequency
Signal carries out audio mixing and obtains the second audio signal;Second set up by described second link establishment unit 15
Described second audio signal is sent to the main body machine in the described second sub-meeting-place of audio frequency by communication link, in order to institute
State main body machine and described second audio signal is sent to the nonbody machine in the described second sub-meeting-place of audio frequency.
Add unit 17, be used for adding the described first sub-meeting-place of audio frequency.
First average transmitting element 18, the communicator comprising voice data described in obtain to described the
The network delay average of other client in the one sub-meeting-place of audio frequency, by the described communication dress comprising voice data
The network delay average put be sent to described in comprise voice data communication system in audio mixing equipment or the 3rd
Method, apparatus;
The first information receives unit 19, if comprising sound for what described first average transmitting element 18 sent
Described in the network delay average ratio of the communicator of frequency evidence, the network delay average of other client is little, connects
Receive the announcement information that described audio mixing equipment or third party device send, described announcement information include described in comprise
The communicator of voice data is as the information of the main body machine in the described first sub-meeting-place of audio frequency.
In one case, as the device in the present embodiment be in system as shown in Figure 1a arbitrary audio frequency
The main body machine in meeting-place, then after addition unit 17 joins the first sub-meeting-place of audio frequency, it is possible to set with audio mixing
Being attached between Bei, then the first average transmitting element 18 just can be by the network of the device of the present embodiment
Time delay average is sent to audio mixing equipment.The notice that audio mixing equipment sends is received when the first information receives unit 19
After information, the first link establishment unit 10 can be triggered and set up the first communication link, work as signal receiving unit
After 11 receive the first audio signal that audio mixing equipment sends, by the first signal transmitting unit 12 by this
First audio signal is sent to other client by one communication link.
In another case, it is arbitrary audio frequency in system as shown in Figure 1 b such as the device in the present embodiment
The main body machine in sub-meeting-place, then, after addition unit 17 joins the first sub-meeting-place of audio frequency, the first average sends
The network delay average of the device of the present embodiment just can be sent to third party device by unit 18.When first
After information receiving unit 19 receives the announcement information that third party device sends, the first link establishment can be triggered
Unit 10 sets up the first communication link, and the second link establishment unit 15 sets up the second communication link, this feelings
Under condition, the first signal transmitting unit 12 can lead to by the second of described second link establishment unit 15 foundation
Letter link receives the first audio signal signal that the main body machine in the described second sub-meeting-place of audio frequency sends;Also may be used
To be sent the second audio signal by the 3rd signal transmitting unit 16 by the second communication link.
Present device embodiment two
Also providing for a kind of communicator comprising voice data, this communicator comprising voice data belongs to
The nonbody machine in the first sub-meeting-place of audio frequency, ratio the second client described above, its structural representation such as Figure 10
Shown in, specifically may include that
Link establishment unit 20, for setting up the between the main body machine in the described first sub-meeting-place of audio frequency
One communication link;
Audio mixing receives unit 21, connects for the first communication link set up by described link establishment unit 20
Receiving the first audio signal, described first audio signal is other audio frequency outside the described first sub-meeting-place of audio frequency
The audio signal of the audio signal in sub-meeting-place;
Signal broadcast unit 22, receives, for playing described audio mixing, the first audio signal that unit 21 receives.
With reference to shown in Figure 11, in a specific embodiment, comprise the communicator of voice data except
Can include outside structure as shown in Figure 10, it is also possible to include signal transmitting unit 23, reconstruction unit 24,
Meeting-place addition unit 25, the second average transmitting element 26 and the second information receiving unit 27, wherein:
Signal transmitting unit 23, for by the second pickup signal of described second client, or to described the
Signal after two pickup signal process at least one times is sent to described main body machine;Or,
Described signal transmitting unit 23, for by the second pickup signal of described second client and described the
The identification information in the one sub-meeting-place of audio frequency be sent to described in comprise voice data communication system in audio mixing equipment,
Or by described described second pickup signal is processed at least one times after signal and described first audio frequency
The identification information in meeting-place is sent to described audio mixing equipment;
Wherein, it is processed as at least one times described second pickup signal is entered to described second pickup signal
Signal after row stereo echo Processing for removing.
Reconstruction unit 24, if the main body machine in the described first sub-meeting-place of audio frequency exits described first sound
The most sub-meeting-place, using described second client as new main body machine, sets up and described first audio frequency respectively
In meeting-place, other remains the third communication link between client.Or, if the described first sub-meeting-place of audio frequency
In main body machine exit the described first sub-meeting-place of audio frequency, set up the master new with the described first sub-meeting-place of audio frequency
Fourth communication link between body machine.
Meeting-place adds unit 25, is used for adding the described first sub-meeting-place of audio frequency.
Second average transmitting element 26, the communicator comprising voice data described in obtain to described the
The network delay average of other client in the one sub-meeting-place of audio frequency;By the described communication dress comprising voice data
The network delay average put be sent to described in comprise voice data communication system in audio mixing equipment or the 3rd
Method, apparatus;
Second information receiving unit 27, if for described in the network delay average ratio of described first client
In the first sub-meeting-place of audio frequency, the network delay average of other client in addition to the first client is little, receives
The announcement information that described audio mixing equipment or third party device send, described announcement information includes the first client
Information as the main body machine in the described first sub-meeting-place of audio frequency.
In one case, as the device in the present embodiment be in system as shown in Figure 1a arbitrary audio frequency
The nonbody machine in meeting-place, then after meeting-place addition unit 24 joins the first sub-meeting-place of audio frequency, it is possible to
Being attached between audio mixing equipment, then the second average transmitting element 25 just can be by the device of the present embodiment
Network delay average be sent to audio mixing equipment.Send when the second information receiving unit 26 receives audio mixing equipment
Announcement information after, unit 20 can be set up with trigger link and set up the first communication link, when audio mixing receives single
After unit 21 receives the first audio signal that main body machine sends, signal broadcast unit 22 play this and first mix
Tone signal.
In another case, it is arbitrary audio frequency in system as shown in Figure 1 b such as the device in the present embodiment
The nonbody machine in sub-meeting-place, then, after meeting-place addition unit 24 joins the first sub-meeting-place of audio frequency, second is equal
The network delay average of the device of the present embodiment just can be sent to third party device by value transmitting element 25.
After the second information receiving unit 26 receives the announcement information that third party device sends, can build with trigger link
Vertical unit 20 sets up the first communication link.When the main body machine in the first sub-meeting-place of audio frequency exits the first audio frequency meeting
After Chang, audio mixing equipment or third party device determine new main body machine, if the device of selected the present embodiment
For main body machine, reconstruction unit 24 can re-establish the communication link between other client, the most mixed
Sound receives unit 21 just can receive the first audio mixing letter by the communication link that this reconstruction unit 24 re-establishes
Number.
Present device embodiment three
Also providing for a kind of communicator comprising voice data, ratio audio mixing equipment described above, its structure is shown
It is intended to as shown in figure 12, specifically may include that
Determine unit 30, for determining the main body machine in the sub-meeting-place of multiple audio frequency respectively.
Described determine unit 30, specifically for obtaining each client in the described first sub-meeting-place of audio frequency respectively
Network delay average to other client;If the first client arrives it in the described first sub-meeting-place of audio frequency
The network delay average of network delay other client of average ratio of its client is little, by described first client
End is defined as the main body machine in the described first sub-meeting-place of audio frequency;Send announcement information to described first client,
Described announcement information includes described first client information as the main body machine in the first sub-meeting-place of audio frequency.
Receive unit 31, for receiving the audio signal in the sub-meeting-place of the plurality of audio frequency and corresponding audio frequency respectively
The identification information in sub-meeting-place.
Specifically, the sound in the sub-meeting-place of arbitrary audio frequency in the sub-meeting-place of the plurality of audio frequency that unit 31 receives is received
Frequently signal is that the pickup signal to the client in the described sub-meeting-place of arbitrary audio frequency carries out stereo echo elimination
Signal after process.
Or, receive the audio frequency letter in the sub-meeting-place of arbitrary audio frequency in the sub-meeting-place of the plurality of audio frequency that unit 31 receives
It number it is the audio signal that in the described sub-meeting-place of arbitrary audio frequency, each client sends;Or,
Or, receiving the audio signal in the sub-meeting-place of arbitrary audio frequency in the sub-meeting-place of multiple audio frequency that unit 31 receives is
To the signal after the audio signal of each client carries out audio mixing in the described sub-meeting-place of arbitrary audio frequency.
Mixing operation unit 32, the mark letter in the sub-meeting-place of audio frequency for receiving according to described reception unit 31
Breath, by the sound in the sub-meeting-place of other audio frequency in addition to the first sub-meeting-place of audio frequency in sub-for the plurality of audio frequency meeting-place
Frequently signal carries out audio mixing and obtains the first audio signal.
Audio signal transmitting element 33, for the first audio signal obtained by described mixing operation unit 32
It is sent to the described main body machine determining the first sub-meeting-place of audio frequency that unit 30 determines, in order to described main body machine will
Other client that described first audio signal is sent in the described first sub-meeting-place of audio frequency plays out.
With reference to shown in Figure 13, in a specific embodiment, comprise the communicator of voice data except
Can include outside structure as shown in figure 12, it is also possible to including: redefine unit 34, if for institute
Stating the first client and exit the described first sub-meeting-place of audio frequency, the most described first sub-meeting-place of audio frequency includes multiple
Residue client, redefines the main body in the described first sub-meeting-place of audio frequency in the plurality of residue client
Machine.First audio signal just can be sent to redefine unit 34 by audio signal transmitting element 33 afterwards
Again new main body machine.
In the device of the present embodiment, mixing operation unit 32 meeting will be except the sub-meeting-place of a certain audio frequency such as first
The audio signal in the sub-meeting-place of other audio frequency outside the sub-meeting-place of audio frequency carries out audio mixing and obtains the first audio signal,
And by audio signal transmitting element 33, first audio signal is sent to the main body machine in this sub-meeting-place of the first audio frequency,
Then it is sent to other client by main body machine play out.Due to the client in the sub-meeting-place of some audio frequency
The audio signal that end is play is identical, and is the audio signal of the audio signal in the sub-meeting-place of other audio frequency, does not deposits
In the sub-meeting-place of this audio frequency, play the sound in the sub-meeting-place of this audio frequency and produce acoustic feedback and utter long and high-pitched sounds.Further,
Owing in the sub-meeting-place of main body machine to audio frequency, the standard deviation of the network delay of other client is less so that its
Its client can be synchronously received the first audio signal substantially, if main body machine sets receiving audio mixing
This first audio signal is play again after one fixed response time of the first audio signal that preparation is sent, so that one
In the sub-meeting-place of audio frequency, all client terminal playing the first audio signal tend to synchronizing substantially.
Present device embodiment four
Also provide for a kind of communicator comprising voice data, its structural representation as shown in figure 14, this bag
Communicator containing voice data can produce bigger difference because of configuration or performance difference, can include
One or more central processing units (central processing units, CPU) 40 (such as, one
Or more than one processor) and memorizer 41, one or more storage application program 421 or data 422
Storage medium 42 (such as one or more mass memory units).Wherein, memorizer 41 and storage
Medium 42 can be of short duration storage or persistently store.The program being stored in storage medium 42 can include one
Or more than one module (diagram does not marks), each module can include the communication dress comprising voice data
A series of command operatings in putting.Further, central processing unit 40 could be arranged to and storage medium
42 communications, perform a series of command operatings in storage medium 42 on the communicator comprise voice data.
The communicator comprising voice data can also include one or more power supplys 43, one or one
Individual above wired or wireless network interface 44, one or more input/output interfaces 45, and/or, one
Individual or more than one operating system 423, such as Windows ServerTM, Mac OS XTM, UnixTM,
LinuxTM, FreeBSDTM etc..
Described in said method embodiment by the step performed by audio mixing equipment, performed by the first client
Step, and the step performed by the second client can be based on comprising voice data shown in this Figure 14
The structure of communicator.
The embodiment of the present invention also provides for a kind of communication system comprising voice data, its structural representation such as figure
Shown in 1a, including audio mixing equipment and the sub-meeting-place of multiple audio frequency, each audio frequency meeting in the sub-meeting-place of multiple audio frequency
Field includes multiple client, and these multiple clients include the first client and multiple second client, its
In:
The structure of audio mixing equipment can comprising as described in above-mentioned apparatus embodiments three or apparatus embodiments four
The structure of the communicator of voice data, the structure of the first client can such as above-mentioned apparatus embodiments one or
The structure of the communicator comprising voice data described in apparatus embodiments four, the structure of the second client
Can the communicator comprising voice data as described in above-mentioned apparatus embodiments two or apparatus embodiments four
Structure, do not repeat at this.
The embodiment of the present invention also provides for another kind of audio communication system, its structural representation as shown in Figure 1 b,
Including two sub-meeting-place of audio frequency, in the sub-meeting-place of the two audio frequency, the sub-meeting-place of each audio frequency includes the first client
End and multiple second clients, wherein:
The structure of the first client can bag as described in above-mentioned apparatus embodiments one or apparatus embodiments four
The structure of the communicator containing voice data, the structure of the second client can be such as above-mentioned apparatus embodiments two
Or the structure of the communicator comprising voice data described in apparatus embodiments four, do not repeat at this.
One of ordinary skill in the art will appreciate that all or part of step in the various methods of above-described embodiment
Suddenly the program that can be by completes to instruct relevant hardware, and this program can be stored in a computer can
Reading in storage medium, storage medium may include that read only memory (ROM), random access memory
RAM), disk or CD etc..
The communication means comprising voice data, the Apparatus and system that are thered is provided the embodiment of the present invention above enter
Having gone and be discussed in detail, principle and the embodiment of the present invention are explained by specific case used herein
Stating, the explanation of above example is only intended to help to understand method and the core concept thereof of the present invention;Meanwhile,
For one of ordinary skill in the art, according to the thought of the present invention, at detailed description of the invention and application model
Placing and all will change, in sum, this specification content should not be construed as limitation of the present invention.
Claims (34)
1. the communication means comprising voice data, it is characterised in that be applied to comprise voice data
The first client in communication system, described first client belongs to the first sub-meeting-place of audio frequency, described method
Including:
Set up respectively and the first communication link between other client in the described first sub-meeting-place of audio frequency;
Receiving the first audio signal, described first audio signal is its outside the described first sub-meeting-place of audio frequency
The audio signal of the audio signal in the sub-meeting-place of its audio frequency;
By described first communication link, described first audio signal is sent respectively to other client described
Play out;
Described first audio signal is play after preset time delay after receiving described first audio signal,
Described preset time delay is the network delay average to other client described.
2. the method for claim 1, it is characterised in that described reception the first audio signal, tool
Body includes: comprise the first audio mixing letter that the audio mixing equipment in the communication system of voice data sends described in reception
Number;
Described method also includes:
Obtain pickup signal, by described pickup signal and the identification information in the described first sub-meeting-place of audio frequency, or
Signal after described pickup signal being processed at least one times and the mark in the described first sub-meeting-place of audio frequency
Information is sent to described audio mixing equipment.
3. method as claimed in claim 2, it is characterised in that
Described acquisition pickup signal specifically includes: obtain the first pickup signal of described first client;Institute
State the signal after described pickup signal is processed at least one times for described first pickup signal to be stood
Signal after body acoustic echo Processing for removing;
Or,
Described acquisition pickup signal specifically includes: obtain the second pickup signal that other client described sends
And obtain the first pickup signal of described first client;Described described pickup signal is carried out at least one times
Signal after process be described second pickup signal and described first pickup signal are carried out audio mixing after obtain
The audio signal in the described first sub-meeting-place of audio frequency, or described first pickup signal is carried out stereo echo disappear
Except the signal after processing, the described first audio frequency meeting obtained after carrying out audio mixing with described second pickup signal
The audio signal of field;
Or,
Described acquisition pickup signal specifically includes: obtain described other client transmission carries out stereo time
The 3rd pickup signal after sound Processing for removing, and obtain the first pickup signal of described first client;Institute
Stating the signal after processing described pickup signal at least one times is with described to described 3rd pickup signal
The audio signal in the described first sub-meeting-place of audio frequency that the first pickup signal obtains after carrying out audio mixing, or to described
First pickup signal carries out the signal after stereo echo Processing for removing, carries out with described 3rd pickup signal
The audio signal in the described first sub-meeting-place of audio frequency obtained after audio mixing.
4. the method for claim 1, it is characterised in that before described reception the first audio signal,
Also include: set up the second communication link between the main body machine in the sub-meeting-place of the second audio frequency;
Described reception the first audio signal, specifically includes: receive described the by described second communication link
The first audio signal that main body machine in the two sub-meeting-place of audio frequency sends;
Described method also includes:
The audio signal of each client in the described first sub-meeting-place of audio frequency is carried out audio mixing and obtains the second audio mixing
Signal;
By described second communication link, described second audio signal is sent to the described second sub-meeting-place of audio frequency
Main body machine, in order to described second audio signal is sent to the described second sub-meeting-place of audio frequency by described main body machine
Nonbody machine.
5. the method as described in any one of Claims 1-4, it is characterised in that described foundation and institute respectively
Before stating in the first sub-meeting-place of audio frequency the first communication link between other client, described method also includes:
Add the described first sub-meeting-place of audio frequency.
6. the method as described in any one of Claims 1-4, it is characterised in that described foundation and institute respectively
Before stating in the first sub-meeting-place of audio frequency the first communication link between other client, described method also includes:
Obtain described first client equal to the network delay of other client in the described first sub-meeting-place of audio frequency
Value;
The communication system comprising voice data described in the network delay average of described first client being sent to
In audio mixing equipment or third party device;
If the network delay average of other client described in the network delay average ratio of described first client
Little, receive described audio mixing equipment or the announcement information of third party device transmission, described announcement information includes institute
State first client information as the main body machine in the described first sub-meeting-place of audio frequency.
7. the communication means comprising voice data, it is characterised in that be applied to comprise voice data
The second client in communication system, described second client belongs to the first sub-meeting-place of audio frequency, described method
Including:
Set up the first communication link between the main body machine in the described first sub-meeting-place of audio frequency;
Receiving the first audio signal by described first communication link, described first audio signal is described
The audio signal of the audio signal in the sub-meeting-place of other audio frequency outside the one sub-meeting-place of audio frequency;
Play described first audio signal.
8. method as claimed in claim 7, it is characterised in that described method also includes:
By the second pickup signal of described second client, or described second pickup signal is carried out at least one
Signal after secondary process is sent to described main body machine;Or,
Second pickup signal of described second client and the identification information in the described first sub-meeting-place of audio frequency are sent out
The audio mixing equipment in the communication system of voice data is comprised described in giving, or by described to described second pickup
Signal process at least one times after signal and the identification information in the described first sub-meeting-place of audio frequency be sent to institute
State audio mixing equipment;
Wherein, it is processed as at least one times described second pickup signal is entered to described second pickup signal
Signal after row stereo echo Processing for removing.
9. method as claimed in claim 7, it is characterised in that described method also includes:
If the main body machine in the described first sub-meeting-place of audio frequency exits the described first sub-meeting-place of audio frequency, by described
Second client, as new main body machine, is set up and other residue visitor in the described first sub-meeting-place of audio frequency respectively
Third communication link between the end of family;
Or, if the main body machine in the described first sub-meeting-place of audio frequency exits the described first sub-meeting-place of audio frequency, build
The fourth communication link between main body machine new in the vertical and described first sub-meeting-place of audio frequency.
10. the method as described in any one of claim 7 to 10, it is characterised in that described foundation is with described
In the first sub-meeting-place of audio frequency before the first communication link between main body machine, described method also includes:
Add the described first sub-meeting-place of audio frequency.
11. methods as claimed in claim 10, it is characterised in that described foundation and described first audio frequency
In sub-meeting-place before the first communication link between main body machine, described method also includes:
Obtain described second client equal to the network delay of other client in the described first sub-meeting-place of audio frequency
Value;
The communication system comprising voice data described in the network delay average of described second client being sent to
In audio mixing equipment or third party device;
If except the first visitor in the first sub-meeting-place of audio frequency described in the network delay average ratio of described first client
The network delay average of other client outside the end of family is little, receives described audio mixing equipment or third party device
The announcement information sent, described announcement information includes that the first client is as the described first sub-meeting-place of audio frequency
The information of main body machine.
12. 1 kinds of communication means comprising voice data, it is characterised in that described method is applied to comprise
Audio mixing equipment in the communication system of voice data, including:
Determine the main body machine in the sub-meeting-place of multiple audio frequency respectively;
Receive audio signal and the identification information in the corresponding sub-meeting-place of audio frequency in the sub-meeting-place of the plurality of audio frequency respectively;
According to the identification information in the sub-meeting-place of described audio frequency, sub-for the plurality of audio frequency meeting-place will be removed the first audio frequency
The audio signal in the sub-meeting-place of other audio frequency outside sub-meeting-place carries out audio mixing and obtains the first audio signal;
Described first audio signal is sent to the main body machine in the described first sub-meeting-place of audio frequency, in order to described master
Other client that described first audio signal is sent in the described first sub-meeting-place of audio frequency by body machine is broadcast
Put.
13. methods as claimed in claim 12, it is characterised in that determine the sub-meeting-place of the plurality of audio frequency
In the main body machine in the first sub-meeting-place of audio frequency, specifically include:
Obtain each client in the described first sub-meeting-place of audio frequency respectively equal to the network delay of other client
Value;
If the first client is to the network delay average ratio of other client in the described first sub-meeting-place of audio frequency
The network delay average of other client is little, and described first client is defined as described first audio frequency meeting
The main body machine of field;
Transmission announcement information is to described first client, and described announcement information includes that described first client is made
It is the information of the main body machine in the first sub-meeting-place of audio frequency.
14. methods as claimed in claim 13, it is characterised in that described method also includes:
If described first client exits the described first sub-meeting-place of audio frequency, the most described first sub-meeting-place of audio frequency
Include multiple residue client, the plurality of residue client redefines described first audio frequency
The main body machine in meeting-place.
15. methods as described in any one of claim 12 to 14, it is characterised in that the plurality of audio frequency
In sub-meeting-place, the audio signal in the sub-meeting-place of arbitrary audio frequency is to the client in the described sub-meeting-place of arbitrary audio frequency
Pickup signal carries out the signal after stereo echo Processing for removing.
16. methods as described in any one of claim 12 to 14, it is characterised in that the plurality of audio frequency
During in sub-meeting-place, the audio signal in the sub-meeting-place of arbitrary audio frequency is the described sub-meeting-place of arbitrary audio frequency, each client is sent out
The audio signal sent;Or,
In the sub-meeting-place of the plurality of audio frequency, the audio signal in the sub-meeting-place of arbitrary audio frequency is to described arbitrary audio frequency
Signal after the audio signal of each client carries out audio mixing in meeting-place.
17. 1 kinds of communicators comprising voice data, it is characterised in that described in comprise voice data
Communicator belongs to the first sub-meeting-place of audio frequency, including:
First link establishment unit, for setting up respectively and other client in the described first sub-meeting-place of audio frequency
Between the first communication link;
Signal receiving unit, for receiving the first audio signal, described first audio signal is described first
The audio signal of the audio signal in the sub-meeting-place of other audio frequency outside the sub-meeting-place of audio frequency;
First signal transmitting unit, for dividing described first audio signal by described first communication link
It is not sent to other client described play out;
Broadcast unit, described for playing after receiving the preset time delay after described first audio signal
First audio signal, described preset time delay is the network delay average to other client described.
18. devices as claimed in claim 17, it is characterised in that
Described signal receiving unit, mixed specifically for comprise described in receiving in the communication system of voice data
The first audio signal that sound equipment sends;
Also include: secondary signal transmitting element, be used for obtaining pickup signal, by described pickup signal and institute
State the identification information in the first sub-meeting-place of audio frequency, after maybe described pickup signal being processed at least one times
The identification information in signal and the described first sub-meeting-place of audio frequency is sent to described audio mixing equipment.
19. devices as claimed in claim 18, it is characterised in that
Described secondary signal transmitting element, specifically for obtaining the first pickup signal of described first client;
Described described pickup signal is processed at least one times after signal for described first pickup signal is carried out
Signal after stereo echo Processing for removing;
Or,
Described secondary signal transmitting element, specifically for obtaining the second pickup that other client described sends
Signal and obtain the first pickup signal of described first client;Described described pickup signal is carried out at least
Signal after single treatment is for obtaining after described second pickup signal and described first pickup signal are carried out audio mixing
The audio signal in the described first sub-meeting-place of audio frequency arrived, or described first pickup signal is carried out stereo time
Signal after sound Processing for removing, described first audio frequency obtained after carrying out audio mixing with described second pickup signal
The audio signal in sub-meeting-place;
Or,
Described secondary signal transmitting element, carries out solid specifically for what acquisition other client described sent
The 3rd pickup signal after acoustic echo Processing for removing, and obtain the first pickup signal of described first client;
Described described pickup signal is processed at least one times after signal for described 3rd pickup signal and institute
State the audio signal in the described first sub-meeting-place of audio frequency obtained after the first pickup signal carries out audio mixing, or to institute
State the signal after the first pickup signal carries out stereo echo Processing for removing, enter with described 3rd pickup signal
The audio signal in the described first sub-meeting-place of audio frequency obtained after row audio mixing.
20. devices as claimed in claim 17, it is characterised in that also include: the second link establishment list
Unit, for setting up the second communication link between the main body machine in the sub-meeting-place of the second audio frequency;
Described first signal transmitting unit, specifically for receiving described second by described second communication link
The first audio signal that main body machine in the sub-meeting-place of audio frequency sends;
Described device also includes:
3rd signal transmitting unit, for by the audio frequency letter of each client in the described first sub-meeting-place of audio frequency
Number carrying out audio mixing obtains the second audio signal;By described second communication link by described second audio signal
It is sent to the main body machine in the described second sub-meeting-place of audio frequency, in order to described main body machine is by described second audio signal
It is sent to the nonbody machine in the described second sub-meeting-place of audio frequency.
21. devices as described in any one of claim 17 to 20, it is characterised in that also include:
Add unit, be used for adding the described first sub-meeting-place of audio frequency.
22. devices as described in any one of claim 17 to 20, it is characterised in that also include:
First average transmitting element, the communicator being used for comprising voice data described in obtaining is to described first
The network delay average of other client in the sub-meeting-place of audio frequency, by the described communicator comprising voice data
Network delay average be sent to described in comprise voice data communication system in audio mixing equipment or third party
Equipment;
The first information receives unit, if comprising the network delay of the communicator of voice data described in Yong Yu
The network delay average of other client described in average ratio is little, receives described audio mixing equipment or third party device
Send announcement information, described announcement information include described in comprise voice data communicator as described
The information of the main body machine in the first sub-meeting-place of audio frequency.
23. 1 kinds of communicators comprising voice data, it is characterised in that described in comprise voice data
Communicator belongs to the first sub-meeting-place of audio frequency, including:
Link establishment unit, for setting up first between the main body machine in the described first sub-meeting-place of audio frequency
Communication link;
Audio mixing receives unit, for receiving the first audio signal by described first communication link, and described the
One audio signal is the audio mixing of the audio signal in the sub-meeting-place of other audio frequency outside the described first sub-meeting-place of audio frequency
Signal;
Signal broadcast unit, is used for playing described first audio signal.
24. devices as claimed in claim 23, it is characterised in that also include:
Signal transmitting unit, is used for the second pickup signal of described second client, or to described second
Signal after pickup signal processes at least one times is sent to described main body machine;Or,
Described signal transmitting unit, for by second pickup signal and described first of described second client
The identification information in the sub-meeting-place of audio frequency be sent to described in comprise voice data communication system in audio mixing equipment,
Or by described described second pickup signal is processed at least one times after signal and described first audio frequency
The identification information in meeting-place is sent to described audio mixing equipment;
Wherein, it is processed as at least one times described second pickup signal is entered to described second pickup signal
Signal after row stereo echo Processing for removing.
25. devices as claimed in claim 23, it is characterised in that also include:
Reconstruction unit, if the main body machine in the described first sub-meeting-place of audio frequency exits described first audio frequency
Sub-meeting-place, using described second client as new main body machine, sets up and described first audio frequency meeting respectively
In Chang, other remains the third communication link between client;
Or, if the main body machine in the described first sub-meeting-place of audio frequency exits the described first sub-meeting-place of audio frequency, build
The fourth communication link between main body machine new in the vertical and described first sub-meeting-place of audio frequency.
26. devices as described in any one of claim 23 to 25, it is characterised in that also include:
Meeting-place adds unit, is used for adding the described first sub-meeting-place of audio frequency.
27. devices as claimed in claim 26, it is characterised in that also include:
Second average transmitting element, the communicator being used for comprising voice data described in obtaining is to described first
The network delay average of other client in the sub-meeting-place of audio frequency;By the described communicator comprising voice data
Network delay average be sent to described in comprise voice data communication system in audio mixing equipment or third party
Equipment;
Second information receiving unit, if for described in the network delay average ratio of described first client the
In the one sub-meeting-place of audio frequency, the network delay average of other client in addition to the first client is little, receives institute
Stating audio mixing equipment or the announcement information of third party device transmission, described announcement information includes that the first client is made
Information for the main body machine in the described first sub-meeting-place of audio frequency.
28. 1 kinds of communicators comprising voice data, it is characterised in that including:
Determine unit, for determining the main body machine in the sub-meeting-place of multiple audio frequency respectively;
Receive unit, for receiving the audio signal in the sub-meeting-place of the plurality of audio frequency and corresponding audio frequency respectively
The identification information in meeting-place;
Mixing operation unit, for the identification information according to the sub-meeting-place of described audio frequency, by the plurality of audio frequency
In sub-meeting-place, the audio signal in the sub-meeting-place of other audio frequency in addition to the first sub-meeting-place of audio frequency carries out audio mixing and obtains
First audio signal;
Audio signal transmitting element, for being sent to described first audio frequency meeting by described first audio signal
The main body machine of field, in order to described first audio signal is sent to described first audio frequency meeting by described main body machine
Other client in Chang plays out.
29. devices as claimed in claim 28, it is characterised in that
Described determine unit, arrive specifically for obtaining each client in the described first sub-meeting-place of audio frequency respectively
The network delay average of other client;If the first client arrives other in the described first sub-meeting-place of audio frequency
The network delay average of network delay other client of average ratio of client is little, by described first client
It is defined as the main body machine in the described first sub-meeting-place of audio frequency;Send announcement information to described first client, institute
State announcement information and include described first client information as the main body machine in the first sub-meeting-place of audio frequency.
30. devices as claimed in claim 28, it is characterised in that also include:
Redefine unit, if exiting the described first sub-meeting-place of audio frequency, then for described first client
The described first sub-meeting-place of audio frequency includes multiple residue client, in the plurality of residue client again
Determine the main body machine in the described first sub-meeting-place of audio frequency.
31. devices as described in any one of claim 28 to 30, it is characterised in that the plurality of audio frequency
In sub-meeting-place, the audio signal in the sub-meeting-place of arbitrary audio frequency is to the client in the described sub-meeting-place of arbitrary audio frequency
Pickup signal carries out the signal after stereo echo Processing for removing.
32. devices as described in any one of claim 28 to 30, it is characterised in that the plurality of audio frequency
During in sub-meeting-place, the audio signal in the sub-meeting-place of arbitrary audio frequency is the described sub-meeting-place of arbitrary audio frequency, each client is sent out
The audio signal sent;Or,
In the sub-meeting-place of the plurality of audio frequency, the audio signal in the sub-meeting-place of arbitrary audio frequency is to described arbitrary audio frequency
Signal after the audio signal of each client carries out audio mixing in meeting-place.
33. 1 kinds of communication systems comprising voice data, it is characterised in that include audio mixing equipment and multiple
The sub-meeting-place of audio frequency, in the sub-meeting-place of the plurality of audio frequency, the sub-meeting-place of each audio frequency includes multiple client, described
Multiple clients include the first client and multiple second client;
Described audio mixing equipment is to comprise the logical of voice data as described in described any one of claim 28 to 32
T unit;
Described first client is such as claim 17 to 19, comprises audio frequency according to any one of 21 and 22
The communicator of data;
Described second client is the communication comprising voice data as described in any one of claim 23 to 27
Device.
34. 1 kinds of systems comprising voice data, it is characterised in that include two sub-meeting-place of audio frequency, institute
State the sub-meeting-place of each audio frequency in two sub-meeting-place of audio frequency and include the first client and multiple second client,
Wherein:
Described first client is such as claim 17, comprises voice data according to any one of 20 to 22
Communicator;
Described second client is the communication comprising voice data as described in any one of claim 23 to 27
Device.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201610321348.XA CN105847096B (en) | 2016-05-12 | 2016-05-12 | A kind of communication means comprising audio data, apparatus and system |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201610321348.XA CN105847096B (en) | 2016-05-12 | 2016-05-12 | A kind of communication means comprising audio data, apparatus and system |
Publications (2)
Publication Number | Publication Date |
---|---|
CN105847096A true CN105847096A (en) | 2016-08-10 |
CN105847096B CN105847096B (en) | 2018-10-30 |
Family
ID=56593657
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201610321348.XA Active CN105847096B (en) | 2016-05-12 | 2016-05-12 | A kind of communication means comprising audio data, apparatus and system |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN105847096B (en) |
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN107484075A (en) * | 2017-08-31 | 2017-12-15 | 深圳市豪恩声学股份有限公司 | Device sound mixing and sound processing system |
CN108712584A (en) * | 2018-05-16 | 2018-10-26 | 中国电子科技集团公司第二十八研究所 | A kind of distributed sound mixing method for videoconference |
CN111586527A (en) * | 2020-04-28 | 2020-08-25 | 重庆西原楼宇自动化工程有限公司 | Intelligent voice processing system |
CN111955018A (en) * | 2018-05-02 | 2020-11-17 | 谷歌有限责任公司 | Wireless solution for Bluetooth stereo audio playback |
Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101877643A (en) * | 2010-06-29 | 2010-11-03 | 中兴通讯股份有限公司 | Multipoint sound-mixing distant view presenting method, device and system |
CN102065265A (en) * | 2009-11-13 | 2011-05-18 | 华为终端有限公司 | Method, device and system for realizing sound mixing |
CN103152185A (en) * | 2013-02-27 | 2013-06-12 | 深圳大学 | Establishment method and system for conference site of voice conference |
CN103312912A (en) * | 2013-05-03 | 2013-09-18 | 华为软件技术有限公司 | Sound mixing system and method |
CN105374377A (en) * | 2015-10-20 | 2016-03-02 | 北京小鸟听听科技有限公司 | Control method, control system, and loudspeaker box of multiroom audio playing |
US20160065898A1 (en) * | 2014-08-28 | 2016-03-03 | Samsung Sds Co., Ltd. | Method for extending participants of multiparty video conference service |
CN105429831A (en) * | 2015-11-04 | 2016-03-23 | 广东欧珀移动通信有限公司 | Main play equipment selection method and play equipment |
-
2016
- 2016-05-12 CN CN201610321348.XA patent/CN105847096B/en active Active
Patent Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN102065265A (en) * | 2009-11-13 | 2011-05-18 | 华为终端有限公司 | Method, device and system for realizing sound mixing |
CN101877643A (en) * | 2010-06-29 | 2010-11-03 | 中兴通讯股份有限公司 | Multipoint sound-mixing distant view presenting method, device and system |
CN103152185A (en) * | 2013-02-27 | 2013-06-12 | 深圳大学 | Establishment method and system for conference site of voice conference |
CN103312912A (en) * | 2013-05-03 | 2013-09-18 | 华为软件技术有限公司 | Sound mixing system and method |
US20160065898A1 (en) * | 2014-08-28 | 2016-03-03 | Samsung Sds Co., Ltd. | Method for extending participants of multiparty video conference service |
CN105374377A (en) * | 2015-10-20 | 2016-03-02 | 北京小鸟听听科技有限公司 | Control method, control system, and loudspeaker box of multiroom audio playing |
CN105429831A (en) * | 2015-11-04 | 2016-03-23 | 广东欧珀移动通信有限公司 | Main play equipment selection method and play equipment |
Cited By (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN107484075A (en) * | 2017-08-31 | 2017-12-15 | 深圳市豪恩声学股份有限公司 | Device sound mixing and sound processing system |
CN111955018A (en) * | 2018-05-02 | 2020-11-17 | 谷歌有限责任公司 | Wireless solution for Bluetooth stereo audio playback |
US11071150B2 (en) | 2018-05-02 | 2021-07-20 | Google Llc | True wireless solution for BT stereo audio playback |
CN111955018B (en) * | 2018-05-02 | 2022-02-01 | 谷歌有限责任公司 | Method and system for connecting an audio accessory device with a client computing device |
US11690109B2 (en) | 2018-05-02 | 2023-06-27 | Google Llc | True wireless solution for BT stereo audio playback |
CN108712584A (en) * | 2018-05-16 | 2018-10-26 | 中国电子科技集团公司第二十八研究所 | A kind of distributed sound mixing method for videoconference |
CN111586527A (en) * | 2020-04-28 | 2020-08-25 | 重庆西原楼宇自动化工程有限公司 | Intelligent voice processing system |
Also Published As
Publication number | Publication date |
---|---|
CN105847096B (en) | 2018-10-30 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN104299632B (en) | Audio synchronization method, device and corresponding system | |
US20100048235A1 (en) | Method and Device for Data Capture for Push Over Cellular | |
CN106126168B (en) | A kind of sound effect treatment method and device | |
CN105847096A (en) | Audio frequency data communication method, device and system | |
US20160080433A1 (en) | Remote Conference Implementation Method and Apparatus | |
CN105210396B (en) | A kind of method and device of selection information push terminal | |
CN105430459B (en) | Audio data play method, device and intelligent TV set | |
JPWO2015068665A1 (en) | RELAY DEVICE, VOICE COMMUNICATION SYSTEM, PROGRAM, AND RELAY METHOD | |
CN107040848A (en) | Synchronization parameter transmission method, device and the equipment of AVDTP agreements | |
CN109743782A (en) | Communication means, device and equipment | |
CN111049709B (en) | Bluetooth-based interconnected loudspeaker box control method, equipment and storage medium | |
CN107277208A (en) | Call method, the first communicator and terminal | |
CN106488023A (en) | A kind of intercommunication call method, system and mobile terminal | |
CN107786965B (en) | Team game communication method and related product | |
EP2207311A1 (en) | Voice communication device | |
AU2015265881A1 (en) | Method and system for establishing real-time audio connections | |
CN109874179B (en) | Communication system, main controller, wireless processing unit and forwarding method | |
CN109672630A (en) | A kind of system information transmission method, terminal and the network equipment | |
CN102036125B (en) | Portable digital radio group navigation system | |
CN106254935A (en) | A kind of method of resource-sharing and terminal | |
CN107195308B (en) | Audio mixing method, device and system of audio and video conference system | |
CN106161044B (en) | A kind of information transferring method and device | |
CN105282856B (en) | A kind of method and user terminal of the transmission of control information | |
WO2017219546A1 (en) | Information processing method, terminal, and computer storage medium | |
CN209358787U (en) | Phone system, master controller and wireless processing unit |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
C06 | Publication | ||
PB01 | Publication | ||
C10 | Entry into substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |