CN105847096A - Audio frequency data communication method, device and system - Google Patents

Audio frequency data communication method, device and system Download PDF

Info

Publication number
CN105847096A
CN105847096A CN201610321348.XA CN201610321348A CN105847096A CN 105847096 A CN105847096 A CN 105847096A CN 201610321348 A CN201610321348 A CN 201610321348A CN 105847096 A CN105847096 A CN 105847096A
Authority
CN
China
Prior art keywords
meeting
place
sub
audio frequency
audio
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201610321348.XA
Other languages
Chinese (zh)
Other versions
CN105847096B (en
Inventor
梁俊斌
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Tencent Technology Shenzhen Co Ltd
Original Assignee
Tencent Technology Shenzhen Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Tencent Technology Shenzhen Co Ltd filed Critical Tencent Technology Shenzhen Co Ltd
Priority to CN201610321348.XA priority Critical patent/CN105847096B/en
Publication of CN105847096A publication Critical patent/CN105847096A/en
Application granted granted Critical
Publication of CN105847096B publication Critical patent/CN105847096B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00Data switching networks
    • H04L12/28Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
    • H04L12/2803Home automation networks
    • H04L12/2805Home Audio Video Interoperability [HAVI] networks
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00Data switching networks
    • H04L12/28Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
    • H04L12/2803Home automation networks
    • H04L12/2816Controlling appliance services of a home automation network by calling their functionalities
    • H04L12/2818Controlling appliance services of a home automation network by calling their functionalities from a device located outside both the home and the home network
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00Data switching networks
    • H04L12/28Data switching networks characterised by path configuration, e.g. LAN [Local Area Networks] or WAN [Wide Area Networks]
    • H04L12/2803Home automation networks
    • H04L12/283Processing of data at an internetworking point of a home automation network
    • H04L12/2836Protocol conversion between an external network and a home network

Landscapes

  • Engineering & Computer Science (AREA)
  • Automation & Control Theory (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Computing Systems (AREA)
  • Telephonic Communication Services (AREA)

Abstract

An embodiment of the invention discloses an audio frequency data communication method, device and system and belongs to the technical field of communication. First communication links between a main device in a first audio frequency sub-meeting-place and other client ends in the first audio frequency sub-meeting-place are respectively established; via the first communication link, first sound mixing signals that are received are sent to the other client ends in the first audio frequency sub-meeting-place, and the other client ends are enabled to receive the first sound mixing signals synchronously; if the first sound mixing signals are played later than the time when the first sound mixing signals are received by the main device, then the first sound mixing signals tend to be played synchronously by all client ends in the first audio frequency sub-meeting-place, the first sound mixing signals are sound mixing signals of audio frequency signals of other audio frequency sub-meeting-places, a problem that audio feedback squeal and desynchrony are caused when sound of the audio frequency sub-meeting-place is played in the same audio frequency sub-meeting-place can be prevented, and mobile terminals such as mobile phones and the like can be used as client ends in each audio frequency sub-meeting-place.

Description

A kind of comprise the communication means of voice data, Apparatus and system
Technical field
The present invention relates to communication technical field, comprise the communication means of voice data, dress particularly to a kind of Put and system.
Background technology
Demand is being handled official business and had a very wide range of applications in life to audio conferencing, so in different geographical User can use respective conference terminal to join in same audio conferencing and converse, and solves difference The multi-person speech communicating questions of region, is that many people are in (such as one meeting of same meeting-place than more typical scene View indoor) use a conference terminal and each meeting-place, a distant place to carry out speech exchange, and this scene is to meeting eventually End proposes two requirements: the broadcast sound volume of conference terminal is sufficiently large, and the listener in meeting-place can be allowed to listen Seeing, conference terminal pickup effect is especially good simultaneously, because spokesman may be from conference terminal in meeting-place It is the most farther that air line distance reaches 5m.
The scheme of existing comparative maturity is the conference terminal of special conference terminal, such as polycom, should Conference terminal uses larger-size speaker, it is ensured that sound is sufficiently large, uses multiple mike (3 simultaneously More than individual), conventional pickup distance is within 5m, and in order to reach more preferable pickup effect, conference terminal provides External mike expansion module, this module is by wired connection separate microphone pickup module and master Machine, independent microphone module can be placed on the position near spokesman, in order to improves closer to distance pickup Pickup effect.But existing conference terminal equipment cost is higher, and carries inconvenience.
Summary of the invention
The embodiment of the present invention provides a kind of and comprises the communication means of voice data, Apparatus and system so that the First client in the one sub-meeting-place of audio frequency is sent to the first audio frequency meeting by unified for the first audio signal received Other client of field plays out.
The first aspect of the embodiment of the present invention provides a kind of communication means comprising voice data, is applied to bag The first client in communication system containing voice data, described first client belongs to the first audio frequency meeting , described method includes:
Set up respectively and the first communication link between other client in the described first sub-meeting-place of audio frequency;
Receiving the first audio signal, described first audio signal is its outside the described first sub-meeting-place of audio frequency The audio signal of the audio signal in the sub-meeting-place of its audio frequency;
By described first communication link, described first audio signal is sent respectively to other client described Play out;
Described first audio signal is play after preset time delay after receiving described first audio signal, Described preset time delay is the network delay average to other client described.
The second aspect of the embodiment of the present invention provides a kind of communication means comprising voice data, is applied to bag The second client in communication system containing voice data, described second client belongs to the first audio frequency meeting , described method includes:
Set up the first communication link between the main body machine in the described first sub-meeting-place of audio frequency;
Receiving the first audio signal by described first communication link, described first audio signal is described The audio signal of the audio signal in the sub-meeting-place of other audio frequency outside the one sub-meeting-place of audio frequency;
Play described first audio signal.
The third aspect of the embodiment of the present invention provides a kind of communication means comprising voice data, described method The audio mixing equipment being applied in the communication system comprising voice data, including:
Determine the main body machine in the sub-meeting-place of multiple audio frequency respectively;
Receive audio signal and the identification information in the corresponding sub-meeting-place of audio frequency in the sub-meeting-place of the plurality of audio frequency respectively;
According to the identification information in the sub-meeting-place of described audio frequency, sub-for the plurality of audio frequency meeting-place will be removed the first audio frequency The audio signal in the sub-meeting-place of other audio frequency outside sub-meeting-place carries out audio mixing and obtains the first audio signal;
Described first audio signal is sent to the main body machine in the described first sub-meeting-place of audio frequency, in order to described master Other client that described first audio signal is sent in the described first sub-meeting-place of audio frequency by body machine is broadcast Put.
The fourth aspect of the embodiment of the present invention provides a kind of communicator comprising voice data, described in comprise The communicator of voice data belongs to the first sub-meeting-place of audio frequency, including:
First link establishment unit, for setting up respectively and other client in the described first sub-meeting-place of audio frequency Between the first communication link;
Signal receiving unit, for receiving the first audio signal, described first audio signal is described first The audio signal of the audio signal in the sub-meeting-place of other audio frequency outside the sub-meeting-place of audio frequency;
First signal transmitting unit, for dividing described first audio signal by described first communication link It is not sent to other client described play out;
Broadcast unit, described for playing after receiving the preset time delay after described first audio signal First audio signal, described preset time delay is the network delay average to other client described.
The embodiment of the present invention the 5th aspect provide a kind of communicator comprising voice data, described in comprise The communicator of voice data belongs to the first sub-meeting-place of audio frequency, including:
Link establishment unit, for setting up first between the main body machine in the described first sub-meeting-place of audio frequency Communication link;
Audio mixing receives unit, for receiving the first audio signal by described first communication link, and described the One audio signal is the audio mixing of the audio signal in the sub-meeting-place of other audio frequency outside the described first sub-meeting-place of audio frequency Signal;
Signal broadcast unit, is used for playing described first audio signal.
6th aspect of the embodiment of the present invention provides a kind of communicator comprising voice data, including:
Determine unit, for determining the main body machine in the sub-meeting-place of multiple audio frequency respectively;
Receive unit, for receiving the audio signal in the sub-meeting-place of the plurality of audio frequency and corresponding audio frequency respectively The identification information in meeting-place;
Mixing operation unit, for the identification information according to the sub-meeting-place of described audio frequency, by the plurality of audio frequency In sub-meeting-place, the audio signal in the sub-meeting-place of other audio frequency in addition to the first sub-meeting-place of audio frequency carries out audio mixing and obtains First audio signal;
Audio signal transmitting element, for being sent to described first audio frequency meeting by described first audio signal The main body machine of field, in order to described first audio signal is sent to described first audio frequency meeting by described main body machine Other client in Chang plays out.
7th aspect of the embodiment of the present invention provides a kind of communication system comprising voice data, including audio mixing Equipment and the sub-meeting-place of multiple audio frequency, in the sub-meeting-place of the plurality of audio frequency, the sub-meeting-place of each audio frequency includes multiple visitor Family end, the plurality of client includes the first client and multiple second client;
Described audio mixing equipment is the communication the comprising voice data dress as described in terms of the embodiment of the present invention the 6th Put;
Described first client is the communication comprising voice data as described in embodiment of the present invention fourth aspect Device;
Described second client is the communication comprising voice data as described in terms of the embodiment of the present invention the 5th Device.
Embodiment of the present invention eighth aspect provides a kind of system comprising voice data, including two audio frequency Meeting-place, in the sub-meeting-place of said two audio frequency, the sub-meeting-place of each audio frequency includes the first client and multiple second Client, wherein:
Described first client is the communication comprising voice data as described in embodiment of the present invention fourth aspect Device;
Described second client is the communication comprising voice data as described in terms of the embodiment of the present invention the 5th Device.
Visible, in the method for the present embodiment, arbitrary audio frequency meeting in the communication system comprise voice data Main body machine (first client in the such as first sub-meeting-place of audio frequency) in Chang is set up and the first audio frequency respectively First communication link of other client in meeting-place, so owing to the first client is to the first sub-meeting-place of audio frequency In the standard deviation of network delay of other client less so that other client substantially can be synchronously Receive the first audio signal, if the first client is after receiving a fixed response time of the first audio signal Play this first audio signal again, so that all client terminal playing first are mixed in the first sub-meeting-place of audio frequency Tone signal tends to synchronizing substantially, and the audio signal that this first audio signal is the sub-meeting-place of other audio frequency is mixed Tone signal, thus will not produce owing to playing the sound in the sub-meeting-place of this audio frequency in a sub-meeting-place of audio frequency Acoustic feedback is uttered long and high-pitched sounds and asynchronous.So can effectively suppress, due to the method for the embodiment of the present invention, the problem of uttering long and high-pitched sounds, Make the client in the sub-meeting-place of each audio frequency can use the portable terminals such as mobile phone, and need not be special The terminal of voice communication, reduces the cost of voice communication.
Accompanying drawing explanation
In order to be illustrated more clearly that the embodiment of the present invention or technical scheme of the prior art, below will be to reality Execute the required accompanying drawing used in example or description of the prior art to be briefly described, it should be apparent that below, Accompanying drawing in description is only some embodiments of the present invention, for those of ordinary skill in the art, On the premise of not paying creative work, it is also possible to obtain other accompanying drawing according to these accompanying drawings.
Fig. 1 a is the structural representation of a kind of communication system comprising voice data in the embodiment of the present invention;
Fig. 1 b is the structural representation of the another kind of communication system comprising voice data in the embodiment of the present invention;
Fig. 2 is the flow process of a kind of communication means comprising voice data that the inventive method embodiment one provides Figure;
Fig. 3 a is the main body that in the inventive method embodiment one, first client is defined as the first sub-meeting-place of audio frequency A kind of method flow diagram of machine;
Fig. 3 b is the main body that in the inventive method embodiment one, first client is defined as the first sub-meeting-place of audio frequency The another kind of method flow diagram of machine;
Fig. 4 is the flow process of a kind of communication means comprising voice data that the inventive method embodiment two provides Figure;
Fig. 5 is the flow process of a kind of communication means comprising voice data that the inventive method embodiment three provides Figure;
Fig. 6 is the flow process of a kind of communication means comprising voice data that the inventive method embodiment four provides Figure;
Fig. 7 is the flow process of a kind of communication means comprising voice data that the inventive method embodiment five provides Figure;
Fig. 8 is the structure of a kind of communicator comprising voice data that present device embodiment one provides Schematic diagram;
Fig. 9 is the knot of the communicator that the another kind that present device embodiment one provides comprises voice data Structure schematic diagram;
Figure 10 is the structure of a kind of communicator comprising voice data that present device embodiment two provides Schematic diagram;
Figure 11 is the knot of the communicator that the another kind that present device embodiment two provides comprises voice data Structure schematic diagram;
Figure 12 is the structure of a kind of communicator comprising voice data that present device embodiment three provides Schematic diagram;
Figure 13 is the structure of a kind of communicator comprising voice data that present device embodiment three provides Schematic diagram;
Figure 14 is the structure of a kind of communicator comprising voice data that present device embodiment four provides Schematic diagram.
Detailed description of the invention
Below in conjunction with the accompanying drawing in the embodiment of the present invention, the technical scheme in the embodiment of the present invention is carried out Clearly and completely describe, it is clear that described embodiment is only a part of embodiment of the present invention, and It is not all, of embodiment.Based on the embodiment in the present invention, those of ordinary skill in the art are not making Go out the every other embodiment obtained under creative work premise, broadly fall into the scope of protection of the invention.
Term " first " in description and claims of this specification and above-mentioned accompanying drawing, " second ", " Three " (if present) such as " 4th " is for distinguishing similar object, the most suitable without being used for describing Sequence or precedence.Should be appreciated that the data of so use can be exchanged in the appropriate case, in order to here The embodiments of the invention described such as can be with the order in addition to those here illustrating or describing Implement.Additionally, term " includes " and " having " and their any deformation, it is intended that cover not exclusively Comprise, such as, contain series of steps or the process of unit, method, system, product or equipment It is not necessarily limited to those steps or the unit clearly listed, but can include that the most clearly list or right In intrinsic other step of these processes, method, product or equipment or unit.
The inventive method embodiment one
A kind of communication means comprising voice data is provided, mainly can apply to as seen in figure la and lb Comprising the communication system of voice data, system as shown in Figure 1a includes the sub-meeting-place of multiple audio frequency and audio mixing Equipment, includes multiple client in the sub-meeting-place of each audio frequency, some client in these multiple clients (the such as first client) can be as main body machine, other client in main body machine meeting-place sub-with this audio frequency respectively End is communicatively coupled, and audio mixing equipment is communicatively coupled with these multiple clients respectively and (does not shows in Fig. 1 a Go out the communication connection between audio mixing equipment and nonbody machine).Wherein:
Client can add the sub-meeting-place of a certain audio frequency, and between other client, foundation comprises voice data Communication session and carry out, with other client, the communication that comprises voice data, wherein comprise voice data Communication can be the communication of pure audio data, or the communication etc. of video data.Client is mainly used in right It is picked up apart from a range of sound of this client, and pickup signal is sent to audio mixing equipment enters Row audio mixing;Client as main body machine is additionally operable to receive the audio signal that audio mixing equipment sends, and will connect The audio signal received is sent to other client in the sub-meeting-place of affiliated audio frequency and plays out.The embodiment of the present invention In client can be the visitor of the voice communication loaded in portable terminal (such as mobile phone or pad etc.) Family end.
Audio mixing equipment meeting-place sub-with each audio frequency respectively is connected, and is mainly used in receiving the sub-meeting-place of each audio frequency Audio signal, and re-send to the main body in the sub-meeting-place of each audio frequency after the audio signal received is carried out audio mixing Machine, main body machine other client that the audio signal of reception is sent to the sub-meeting-place of affiliated audio frequency is broadcast Put.
System as shown in Figure 1 b includes two sub-meeting-place of audio frequency (the i.e. first sub-meeting-place of audio frequency and the second sound The most sub-meeting-place), the sub-meeting-place of each audio frequency includes multiple client, some client (ratio in multiple clients Such as the first client) can communicate between the main body machine in the sub-meeting-place of two of which audio frequency as main body machine Connect.After any body machine can carry out audio mixing to the audio signal in the sub-meeting-place of audio frequency belonging to this main body machine It is sent to the main body machine in the sub-meeting-place of another audio frequency.
The method of the present embodiment is by the sub-meeting-place of audio frequency a certain in system (the such as first sub-meeting-place of audio frequency) As the method performed by the first client of main body machine, flow chart is as in figure 2 it is shown, include:
Step 101, sets up and the first communication link between other client in the sub-meeting-place of the first audio frequency respectively.
It is appreciated that user can operate the first client so that this first client joins a certain sound In the most sub-meeting-place (the such as first sub-meeting-place of audio frequency), such as can pass through " shaking ", or " face-to-face Build group " user operation instruction so that other in the first client-side search to a range of space The client of voice communication, and together join the first sub-meeting-place of audio frequency with the client of other voice communication In.In the present embodiment, add the multiple clients in the sub-meeting-place of same audio frequency and be mainly in certain limit The interior client in space, the client in such as one room, or a certain wireless network coverage Interior client.
After multiple clients join the first sub-meeting-place of audio frequency, need to determine one in these multiple clients Individual client (the such as first client) is as main body machine, then other client is nonbody machine.In reality In the application of border, when determining the main body machine in the sub-meeting-place of a certain audio frequency, can be set by audio mixing equipment or third party Come really for the network delay average arriving other client according to each client in a sub-meeting-place of audio frequency respectively Fixed.Specifically determine that the process of main body machine can have a following two ways:
(1) in the case of as shown in Figure 1a, after multiple clients join the first sub-meeting-place of audio frequency, Multiple clients just and are communicatively coupled between audio mixing equipment, can select one by audio mixing equipment Main body machine.
With reference to shown in Fig. 3 a, in this case, for the first client, performing following step After rapid A1 to A3, the first client can be triggered and start to perform the flow process of step 101 to 104:
Step A1, obtains the network delay of other client in the first client to the first sub-meeting-place of audio frequency equal Value.
First client can be completed by PING mode to the network delay value of another client, and i.e. first Client sends network Internet Control Message Protocol (Internet Control Messages to another client Protocol, ICMP) echo request, meeting after another client receives ICMP echo request Auto-returned ICMP return response message, will send ICMP request bag and receives between ICMP response bag Time interval is as the networking time delay value of this first client to another client, the net of this first client Network time delay average is that the first client is respectively to the network delay value of other client in the first sub-meeting-place of audio frequency Meansigma methods.
Step A2, is sent to comprise the communication system of voice data by the network delay average of the first client In audio mixing equipment, such audio mixing equipment other client in obtaining the first sub-meeting-place of audio frequency is corresponding After network delay average, choose client corresponding to wherein minimum network delay average (the such as first visitor Family end) as main body machine, in the sub-meeting-place of network delay average ratio the first audio frequency of the i.e. first client other The network delay average of client is the least, then audio mixing equipment can send announcement information to the first client.
Step A3, receives the announcement information that audio mixing equipment sends, and this announcement information includes that the first client is made It is the information of the main body machine in the first sub-meeting-place of audio frequency.
(2) in the case of as shown in Figure 1 b, after multiple clients join the first sub-meeting-place of audio frequency, A main body machine can be selected by the third party device being all connected with multiple clients respectively.3rd Method, apparatus can be the management equipment etc. in system for multiple clients.
With reference to shown in Fig. 3 b, in this case, for the first client, performing following step After rapid B1 to B3, the first client can be triggered and start to perform the flow process of step 101 to 104:
Step B1, obtains the network delay of other client in the first client to the first sub-meeting-place of audio frequency equal Value.
Step B2, is sent to third party device, such third party by the network delay average of the first client After the equipment network delay average that other client is corresponding in obtaining the first sub-meeting-place of audio frequency, choose it Client (the such as first client) corresponding to the network delay average of middle minimum is as main body machine, concurrently Send announcement information to the first client.
Step B3, receives the announcement information that third party device sends, and this announcement information includes the first client Information as the main body machine in the first sub-meeting-place of audio frequency.
So, after determining main body machine by said method, the main body machine in the sub-meeting-place of arbitrary audio frequency is to this sound The standard deviation of the network delay of other client in the most sub-meeting-place is minimum.
Step 102, receives the first audio signal, and this first audio signal is outside the first sub-meeting-place of audio frequency The audio signal of the audio signal in the sub-meeting-place of other audio frequency.
In the case of the one such as Fig. 1 a, the audio signal in audio mixing equipment meeting-place sub-to each audio frequency carry out Audio mixing, the first client is to receive the first audio signal that audio mixing equipment sends.As shown in Figure 1 b In the case of Zhong, the audio signal in the meeting-place sub-to affiliated audio frequency of the main body machine in the sub-meeting-place of each audio frequency carry out Audio mixing, the first client is to receive the first audio signal that the main body machine in the second sub-meeting-place of audio frequency sends.
Step 103, the first audio signal is sent respectively to by the first communication link set up by step 101 Other client in the first sub-meeting-place of audio frequency plays out.
Step 104, plays the first audio signal after the preset time delay after receiving the first audio signal, Preset time delay is the network delay average to other client.
Owing to the first client is to need certain network when sending the first audio signal to other client Time delay, then the first client is play first after receiving the certain time after the first audio signal again and is mixed During tone signal, it is only possible to so that in the first sub-meeting-place of audio frequency, all client synchronization play this first audio mixing letter Number.Wherein certain time is network delay average, and the specially first client transmits a signal to first respectively The average of time, i.e. network delay average used by other client in the sub-meeting-place of audio frequency.
It should be noted that ordering relation the most absolute between above-mentioned steps 103 and 104, Ke Yitong Shi Zhihang, it is also possible to order performs, the simply one of which concrete implementation mode shown in Fig. 2.
Visible, in the method for the present embodiment, arbitrary audio frequency meeting in the communication system comprise voice data Main body machine (first client in the such as first sub-meeting-place of audio frequency) in Chang is set up and the first audio frequency respectively First communication link of other client in meeting-place, so due to main body machine (the i.e. first client) to In the one sub-meeting-place of audio frequency, the standard deviation of the network delay of other client is less so that other client's end group Originally the first audio signal can be synchronously received, if main body machine is receiving the one of the first audio signal This first audio signal is play again, so that all clients are broadcast in a sub-meeting-place of audio frequency after fixed response time Put the first audio signal substantially to tend to synchronizing;And owing to all clients in the sub-meeting-place of some audio frequency are broadcast The audio signal put is the most identical, and is the audio signal of the audio signal in the sub-meeting-place of other audio frequency, does not exists The sub-meeting-place of this audio frequency is play the sound in the sub-meeting-place of this audio frequency and produces acoustic feedback and utter long and high-pitched sounds.So due to this The method of bright embodiment can suppress the problem of uttering long and high-pitched sounds effectively so that the client in the sub-meeting-place of each audio frequency can To use the portable terminals such as mobile phone, and the terminal of voice communication that need not be special, reduce voice communication Cost.
It should be noted that the method for above-mentioned steps 101 to 104 is that the first client is at downlink reception first The process of audio signal, mainly has the following two kinds feelings for the first client in the process of up transmission signal Condition:
(1) in system as shown in Figure 1a, the first client can obtain pickup signal, by this pickup signal And first identification information in the sub-meeting-place of audio frequency, the signal after maybe pickup signal being processed at least one times And first the identification information in the sub-meeting-place of audio frequency be sent to audio mixing equipment, such audio mixing equipment can be by pickup signal Or at least one second audio frequency outside pickup signal and the first sub-meeting-place of audio frequency after processing at least one times After the audio signal in meeting-place carries out audio mixing, it is sent to the client in the 3rd sub-meeting-place of audio frequency.Wherein, It is to allow audio mixing equipment know this audio mixing equipment that one client sends the identification information in the first sub-meeting-place of audio frequency Which signal received is belonging to the sub-meeting-place of same audio frequency.
In one case, the first client, when obtaining pickup signal, can obtain this first client The first pickup signal.Signal after processing pickup signal at least one times is to the first ten obtained Tone signal carries out the signal after stereo echo Processing for removing.
In another case, the first client, when obtaining pickup signal, mainly obtains the first audio frequency The second pickup signal that in sub-meeting-place, other client (i.e. nonbody machine) sends and obtain the first client The first pickup signal.Signal after processing pickup signal at least one times is for the first pickup signal The audio signal in the first sub-meeting-place of audio frequency obtained after carrying out audio mixing with the second pickup signal, or to the first ten Tone signal carries out the signal after stereo echo Processing for removing, obtains after carrying out audio mixing with the second pickup signal The audio signal in the first sub-meeting-place of audio frequency.
In other cases, the first client, when obtaining pickup signal, mainly obtains the first audio frequency After what in meeting-place, other client (i.e. nonbody machine) sent carried out stereo echo Processing for removing the 3rd Pickup signal, and obtain the first pickup signal of the first client.Pickup signal is located at least one times Signal after reason be the 3rd pickup signal and the second pickup signal are carried out audio mixing after the first audio frequency of obtaining The audio signal in meeting-place, or the first pickup signal is carried out the signal after stereo echo Processing for removing, with The audio signal in the first sub-meeting-place of audio frequency that the 3rd pickup signal obtains after carrying out audio mixing.
It should be noted that above-mentioned two kinds of situations below are that the main body machine by the sub-meeting-place of each audio frequency should The audio signal in the sub-meeting-place of audio frequency is then forwarded to audio mixing equipment audio mixing again after carrying out audio mixing, the most permissible Shared a part of mixing operation by main body machine, alleviate the burden of audio mixing equipment.
(2) in system as shown in Figure 1 b, when the first client is being defined as the first sub-meeting-place of audio frequency During main body machine, the first client not only needs and sets up in the sub-meeting-place of the first audio frequency between other client One communication link, in addition it is also necessary to set up the second communication link between the main body machine in the sub-meeting-place of the second audio frequency. During such first client executing above-mentioned steps 102, it is to receive the second audio frequency by this second communication link The first audio signal that main body machine in meeting-place sends.And the first client is when up transmission signal:
First client can by each client in the first sub-meeting-place of audio frequency (include the first client and other Client) audio signal carry out audio mixing and obtain the second audio signal, then will by the second communication link Second audio signal is sent to the main body machine in the second sub-meeting-place of audio frequency, in order to the second audio mixing is believed by this main body machine Number it is sent to the nonbody machine in the second sub-meeting-place of audio frequency.Wherein the audio signal of each client can be each The pickup signal of individual client, or for the pickup signal of each client is carried out at stereo echo elimination Signal after reason.
The inventive method embodiment two
A kind of communication means comprising voice data is provided, mainly can apply to as illustrated in figs. ia and ib The communication system comprising voice data in, the method for the present embodiment is by the sub-meeting-place of audio frequency a certain in system As the method performed by the second client of nonbody machine, flow process in (the such as first sub-meeting-place of audio frequency) Scheme as shown in Figure 4, including:
Step 201, sets up the first communication link between the main body machine in the sub-meeting-place of the first audio frequency.
It is appreciated that user can operate the second client so that this second client joins a certain sound In the most sub-meeting-place (the such as first sub-meeting-place of audio frequency), such as can pass through " shaking ", or " face-to-face Build group " user operation instruction so that the second client together adds with the client of other voice communication In the first sub-meeting-place of audio frequency.In the present embodiment, add the multiple clients in the sub-meeting-place of same audio frequency The client in space the most within the specific limits.
After multiple clients join the first sub-meeting-place of audio frequency, can be by audio mixing equipment or third party device The network delay average arriving other client according to each client in a sub-meeting-place of audio frequency respectively determines The main body machine in the sub-meeting-place of this audio frequency and nonbody machine.The process specifically determined can have a following two ways:
(1) in the case of as shown in Figure 1a, after multiple clients join the first sub-meeting-place of audio frequency, Multiple clients just and are communicatively coupled between audio mixing equipment, can determine main body by audio mixing equipment Machine and nonbody machine.
In this case, for the second client, after performing following steps, can touch Send out the second client and start to perform the flow process of step 201 to 203: obtain the second client to the first audio frequency The network delay average of other client in meeting-place;The network delay average of the second client is sent to bag Audio mixing equipment in communication system containing voice data;If the network delay average ratio of the first client In the one sub-meeting-place of audio frequency, the network delay average of other client in addition to the first client is little, receives mixed The announcement information that sound equipment sends, this announcement information includes that the first client is as the first sub-meeting-place of audio frequency The information of main body machine.
Wherein, obtaining the second client can be as above-mentioned to the method for the network delay average of other client First client obtains the method for corresponding network delay average, does not repeats at this.
(2) in the case of as shown in Figure 1 b, after multiple clients join the first sub-meeting-place of audio frequency, Main body machine and nonbody machine can be determined by the third party device being all connected with multiple clients respectively. This third party device can be the management equipment etc. in system for multiple clients.
In this case, for the second client, after performing following steps, can touch Send out the second client and start to perform the flow process of step 201 to 203: obtain the second client to the first audio frequency The network delay average of other client in meeting-place;The network delay average of the second client is sent to Three method, apparatus;If except the first client in the sub-meeting-place of network delay average ratio the first audio frequency of the first client The network delay average of other client outside end is little, receives the announcement information that third party device sends, This announcement information includes first client information as the main body machine in the first sub-meeting-place of audio frequency.
Step 202, receives the first audio signal by the first communication link, and this first audio signal is first The audio signal of the audio signal in the sub-meeting-place of other audio frequency outside the sub-meeting-place of audio frequency.
Step 203, plays the first audio signal.
Visible, in the method for the present embodiment, due in a sub-meeting-place of audio frequency main body machine to this audio frequency meeting In Chang, other client i.e. standard deviation of the network delay of nonbody machine is less, the of such downlink reception One audio signal can be sent to other client by the main body machine in a sub-meeting-place of audio frequency so that other Client can be synchronously received the first audio signal substantially, so that non-in a sub-meeting-place of audio frequency Main body machine sowing is put audio signal and is substantially tended to synchronizing.And each client terminal playing that first in the sub-meeting-place of audio frequency The first audio signal identical, and be the audio signal of the audio signal in the sub-meeting-place of other audio frequency, do not exist The sound in the sub-meeting-place of this audio frequency is play in this sub-meeting-place of the first audio frequency and produces acoustic feedback and utter long and high-pitched sounds.Therefore due to The method of the embodiment of the present invention can suppress the problem of uttering long and high-pitched sounds effectively so that the client in the sub-meeting-place of each audio frequency End can use the portable terminals such as mobile phone, and the terminal of voice communication that need not be special, reduce audio frequency The cost of communication.
It should be noted that the method for above-mentioned steps 201 to 203 is that the second client is at downlink reception first The process of audio signal, mainly has the following two kinds feelings for the second client in the process of up transmission signal Condition:
(1) in system as shown in Figure 1a, the second client can be by the second pickup letter of the second client Number and the identification information in the sub-meeting-place of the first audio frequency audio mixing that is sent in the communication system comprising voice data set Standby, the signal after maybe the second pickup signal being processed at least one times and the mark in the sub-meeting-place of the first audio frequency Knowledge information is sent to audio mixing equipment, is so sent by the client in audio mixing equipment meeting-place sub-to each audio frequency Signal carries out audio mixing.Wherein, the second client sends the identification information in the first sub-meeting-place of audio frequency is to allow Audio mixing equipment knows which signal that this audio mixing equipment receives is belonging to the sub-meeting-place of same audio frequency.
(2) in system as shown in Figure 1 b, the second client can be by the second pickup letter of the second client Number, or the signal after processing the second pickup signal at least one times is sent to main body machine, and main body machine will After the signal that in the first sub-meeting-place of audio frequency, each nonbody machine sends carries out audio mixing, it is sent to the second audio frequency The main body machine in meeting-place.
Wherein, it is processed as at least one times carrying out stereo to the second pickup signal to the second pickup signal Signal after echo cancellation process.
Further, in a specific embodiment, if the main body machine in the first sub-meeting-place of audio frequency moves back Going out the first sub-meeting-place of audio frequency, the use user of such as main body machine leaves other client in the first sub-meeting-place of audio frequency The a range of space at end place, in order to maintain the communication of current voice data, can be by this enforcement Second client (i.e. nonbody machine) of example can be set up and the first audio frequency respectively as new main body machine In sub-meeting-place, other remains the third communication link between client;If by another client (except Client outside two clients) as new main body machine, then second client of the present embodiment can be set up And the fourth communication link between main body machine new in the first sub-meeting-place of audio frequency.
Wherein, this second client can be come by audio mixing equipment or third party device as new main body machine Determine, after audio mixing equipment or third party device determine new main body machine (the such as second client), Can send announcement information to this second client, this announcement information includes that the second client is new main body machine Information.So after the second client receives announcement information, just set up with other residue client it Between third communication link.
The inventive method embodiment three
A kind of communication means comprising voice data is provided, mainly can apply to comprising as shown in Figure 1a In the communication system of voice data, the method for the present embodiment is the method performed by audio mixing equipment in system, Flow chart is as it is shown in figure 5, include:
Step 301, determines the main body machine in the sub-meeting-place of multiple audio frequency respectively.
Specifically, audio mixing equipment is determining the master in a sub-meeting-place of audio frequency (the such as first sub-meeting-place of audio frequency) During body machine, can be according to the network delay average of each client in the sub-meeting-place of this audio frequency to other client Determining, specifically, audio mixing equipment can obtain each client in the first sub-meeting-place of audio frequency respectively and arrive it The network delay average of its client, if the first client is to other client in the first sub-meeting-place of audio frequency The network delay average of network delay other client of average ratio little, the first client is defined as first The main body machine in the sub-meeting-place of audio frequency;Transmission announcement information is to the first client, and announcement information includes the first client Hold the information of the main body machine as the first sub-meeting-place of audio frequency.
If the first client exits the first sub-meeting-place of audio frequency, the use user of the such as first client leaves The a range of space at first other client place in the sub-meeting-place of audio frequency, then in the first sub-meeting-place of audio frequency Including multiple residue clients, audio mixing equipment also needs to redefine first in these multiple residue clients The main body machine in the sub-meeting-place of audio frequency.
Step 302, receives audio signal and the mark in the corresponding sub-meeting-place of audio frequency in the sub-meeting-place of multiple audio frequency respectively Information.
In one case, the client in the sub-meeting-place of each audio frequency all can be adjusted the distance the certain model of this client Enclose interior sound to be picked up, it is possible to the pickup signal obtained is transmitted directly to audio mixing equipment, by mixing Sound equipment carries out mixing operation.In this case, in the sub-meeting-place of multiple audio frequency that audio mixing equipment receives The audio signal in the sub-meeting-place of arbitrary audio frequency is the audio signal that in the sub-meeting-place of arbitrary audio frequency, each client sends.
In another case, the client in the sub-meeting-place of each audio frequency can be adjusted the distance the certain model of this client Enclose interior sound to be picked up, the client in meeting-place sub-for arbitrary audio frequency, the pickup letter that can will obtain Number it is sent to the main body machine in the sub-meeting-place of this audio frequency, by each client in main body machine meeting-place sub-to this audio frequency Pickup signal carry out audio mixing after audio signal is sent to audio mixing equipment, by audio mixing equipment to each audio frequency The audio signal that the main body machine in sub-meeting-place sends carries out mixing operation again.In this case, audio mixing sets In the standby sub-meeting-place of multiple audio frequency received, the audio signal in the sub-meeting-place of arbitrary audio frequency is for arbitrary audio frequency meeting Signal after the audio signal of each client carries out audio mixing in Chang.So a part of mixing operation is placed Operate to client, alleviate the burden of the audio mixing equipment of the present embodiment.
Further, each client in the sub-meeting-place of each audio frequency after obtaining pickup signal, Ke Yixian Pickup signal carries out stereo echo Processing for removing, and the signal after processing the most again is sent to audio mixing and sets Standby.Owing to the echo in the sub-meeting-place of audio frequency is eliminated, it is possible to be effectively prevented from audio mixing equipment and echo is mixed Enter to be formed circulation in effective audio signal of client pickup and then utter long and high-pitched sounds.In this case, audio mixing In the sub-meeting-place of multiple audio frequency that equipment receives, the audio signal in the sub-meeting-place of arbitrary audio frequency is for arbitrary audio frequency The pickup signal of the client in meeting-place carries out the signal after stereo echo Processing for removing.
Step 303, according to the identification information in the sub-meeting-place of audio frequency, will remove the first audio frequency in sub-for multiple audio frequency meeting-place The audio signal in the sub-meeting-place of other audio frequency outside sub-meeting-place carries out audio mixing and obtains the first audio signal.Wherein, The identification information in the sub-meeting-place of audio frequency is primarily to determine which audio signal belongs to the sub-meeting-place of same audio frequency 's.
In one case, the audio frequency letter that the client in sub-for same audio frequency meeting-place is first sent by audio mixing equipment Number carrying out audio mixing obtains the audio signal that the sub-meeting-place of each audio frequency is corresponding, the most again by sub-for difference audio frequency meeting-place Corresponding audio signal carries out audio mixing again.
In the case of another kind, if audio mixing equipment receives each of the main body machine transmission in the sub-meeting-place of each audio frequency The audio signal that the sub-meeting-place of individual audio frequency is corresponding, the audio mixing equipment audio mixing that meeting-place sub-to each audio frequency is corresponding again is believed Number carry out audio mixing again.
Step 304, is sent to the main body machine in the first sub-meeting-place of audio frequency, in order to main body machine by the first audio signal Other client first audio signal being sent in the first sub-meeting-place of audio frequency plays out, and such first The audio signal of each client terminal playing in the sub-meeting-place of audio frequency is identical, is the first audio signal, It is the audio signal in the sub-meeting-place of other audio frequency (the i.e. second sub-meeting-place of audio frequency), there is not this first audio frequency In meeting-place, the pickup signal of other client is mixed into and produces and utter long and high-pitched sounds.
Visible, in the method for the present embodiment, audio mixing equipment can be by except the sub-meeting-place of a certain audio frequency such as first The audio signal in the sub-meeting-place of other audio frequency outside the sub-meeting-place of audio frequency carries out audio mixing and obtains the first audio signal, And the first audio signal is sent to the main body machine in this sub-meeting-place of the first audio frequency, then it is sent to by main body machine Other client plays out.Audio signal phase due to the client terminal playing in the sub-meeting-place of some audio frequency With, and be the audio signal of the audio signal in the sub-meeting-place of other audio frequency, do not exist in the sub-meeting-place of this audio frequency and broadcast Put the sound in the sub-meeting-place of this audio frequency and produce acoustic feedback and utter long and high-pitched sounds.Further, due to main body machine to audio frequency In meeting-place, the standard deviation of the network delay of other client is less so that other client substantially can be same Receive the first audio signal to step, if main body machine is receiving the first audio mixing letter that audio mixing equipment sends Number a fixed response time after play this first audio signal again, so that all visitors in a sub-meeting-place of audio frequency Family end is play the first audio signal and is substantially tended to synchronizing.
The inventive method embodiment four
A kind of communication means comprising voice data is provided, be applied to as shown in Figure 1a include voice data Communication system in, the method flow diagram of the present embodiment as shown in Figure 6, including:
Step 401, client adds the sub-meeting-place of audio frequency, forms the sub-meeting-place of plural audio frequency, the most each Each client in the sub-meeting-place of individual audio frequency is connected with audio mixing communication between devices respectively.
In the present embodiment, user is by the client loaded in mobile phone, joins certain in the way of certain is arranged The sub-meeting-place of individual audio frequency.Owing to possessing pickup microphone and speaker on mobile phone, so by the mobile phone of oneself Pickup in relatively short distance, pickup effect is guaranteed, and same mobile phone is closely play sound and be can ensure that use Family can effectively be listened to.
Step 402, if there is multiple client in a sub-meeting-place of audio frequency, audio mixing selection of equipment one of them Client as main body machine, the standard deviation of the network delay of other client in the sub-meeting-place of main body machine to audio frequency Difference minimum.
Step 403, other client in the main body machine in the sub-meeting-place of each audio frequency meeting-place sub-with affiliated audio frequency respectively The first communication link is set up between end.
Step 404, it is judged that whether the main body machine in a sub-meeting-place of audio frequency exits the sub-meeting-place of affiliated audio frequency, Without exiting, then perform step 405;If exited, then return and perform step 402, switch audio frequency Main body machine in sub-meeting-place, chooses another main body machine, and re-establishes connection.
Step 405, for any one client in meeting-place sub-for certain audio frequency, this client is to this Sound in the sub-meeting-place of audio frequency is picked up obtaining pickup signal, then pickup signal is carried out stereo time Sound Processing for removing.
In one case, after the client in the sub-meeting-place of each audio frequency will carry out stereo echo Processing for removing Pickup signal and the identification information in the corresponding sub-meeting-place of audio frequency be transmitted directly to audio mixing equipment, by audio mixing equipment Perform step 406.
In the case of another kind, in order to alleviate the burden of audio mixing equipment, a part of mixing operation can be placed On main body machine, then after the pickup signal of main body machine is carried out stereo echo Processing for removing by main body chance, With receive other client send carry out stereo Processing for removing after pickup signal carry out stereo process Obtain the audio signal that the sub-meeting-place of this audio frequency is corresponding, and by belonging to the audio signal obtained and this main body machine The identification information in the sub-meeting-place of audio frequency is sent to audio mixing equipment, audio mixing equipment perform step 407.
Step 406, after audio mixing equipment receives the audio signal in the sub-meeting-place of each audio frequency, according to corresponding sound The identification information in the most sub-meeting-place, is first carried out the audio signal that the client in sub-for same audio frequency meeting-place sends Audio mixing obtains the audio signal that the sub-meeting-place of each audio frequency is corresponding;The most again by corresponding for the different sub-meeting-place of audio frequency Audio signal carries out audio mixing again.
Step 407, after audio mixing equipment receives the audio signal of main body machine transmission in the sub-meeting-place of each audio frequency, The audio signal in sub-for each audio frequency meeting-place is carried out audio mixing again.
Wherein, in step 406 and 407, the principle of audio mixing equipment audio mixing again is by sub-for a certain audio frequency meeting-place (ratio Such as the first sub-meeting-place of audio frequency) outside audio signal audio mixing again corresponding to the sub-meeting-place of other audio frequency obtain A whole audio signal the such as first audio signal.
Step 408, the first audio signal is sent to the main body machine in the first sub-meeting-place of audio frequency by audio mixing equipment, Other client this first audio signal being sent in the first sub-meeting-place of audio frequency by main body machine.
Step 409, other client is direct after receiving the first audio signal plays this first audio signal, This first audio signal is just play after main body machine then certain network delay after receiving the first audio signal.
In the present embodiment, due in a sub-meeting-place of audio frequency main body machine to other client in the sub-meeting-place of this audio frequency The standard deviation of the i.e. network delay of nonbody machine of end is minimum so that other client substantially can be synchronously Receive audio signal, if main body machine is at the fixed response time receiving the audio signal that audio mixing equipment sends After play this audio signal again, so that all client terminal playing audio signal in a sub-meeting-place of audio frequency Substantially tend to synchronizing.
The inventive method embodiment five
A kind of communication means comprising voice data is provided, be applied to as shown in Figure 1 b comprise voice data Communication system in, the method flow diagram of the present embodiment as it is shown in fig. 7, comprises:
Step 501, client adds the sub-meeting-place of audio frequency, forms two sub-meeting-place of audio frequency, the i.e. first audio frequency Meeting-place and the sub-meeting-place of the second audio frequency.
In the present embodiment, user is by the client loaded in mobile phone, joins certain in the way of certain is arranged The sub-meeting-place of individual audio frequency.Wherein, the multiple clients in the sub-meeting-place of same audio frequency refer to a range of The client that mobile phone in space loads respectively.Owing to possessing pickup microphone and speaker on mobile phone, this Sample mobile phone pickup in relatively short distance by oneself, pickup effect is guaranteed, and same mobile phone is closely Play sound and can ensure that user can effectively listen to.
The third party device that in step 502, with two sub-meeting-place of audio frequency, client all communicates to connect determines each The main body machine in the sub-meeting-place of audio frequency, the network delay of other client in main body machine to the sub-meeting-place of affiliated audio frequency Standard deviation is minimum.
Step 503, sets up the second communication link between the main body machine in two sub-meeting-place of audio frequency, each audio frequency The main body machine in meeting-place respectively and sets up the first communication link between other client in the sub-meeting-place of affiliated audio frequency.
Step 504, for the nonbody machine in meeting-place sub-for certain audio frequency, mainly to this audio frequency meeting Sound in Chang is picked up obtaining pickup signal, then carries out pickup signal at stereo echo elimination Reason, the pickup signal after processing is sent to the main body machine in the sub-meeting-place of affiliated audio frequency by the first communication link.
In the present embodiment, owing in the sub-meeting-place of each audio frequency, the audio signal of all client terminal playing is the most identical, Then each client all can utilize identical signal as echo reference when doing stereo echo Processing for removing Signal, so can the echo in meeting-place sub-to audio frequency effectively eliminate.
Step 505, for the main body machine in meeting-place sub-for certain audio frequency, mainly obtains pickup signal also Pickup signal is carried out stereo echo Processing for removing, as other client receiving the sub-meeting-place of affiliated audio frequency The signal that end sends, after carrying out stereo echo Processing for removing by each signal received and this main body machine Signal carries out audio mixing and obtains audio signal.
Step 506, the second communication chain that audio signal step 505 obtained is set up by above-mentioned steps 503 Road is sent to the main body machine in the sub-meeting-place of another audio frequency, and the audio signal of reception is then forwarded to by main body machine Other client in the affiliated sub-meeting-place of audio frequency.
Step 507, directly plays the audio signal of reception as the client of nonbody machine, and main body machine then exists The audio signal of reception is play after receiving the certain network delay after audio signal.
In the method for the present embodiment, the audio signal of each client terminal playing in the sub-meeting-place of same audio frequency Identical, and be the audio signal of the audio signal in the sub-meeting-place of another audio frequency, do not exist in the sub-meeting-place of this audio frequency Play the sound in the sub-meeting-place of this audio frequency and produce acoustic feedback and utter long and high-pitched sounds.And the present embodiment is carried out by main body machine Mixing operation, carries out mixing operation without single audio mixing equipment, saves the resource of the network equipment.
Present device embodiment one
Also providing for a kind of communicator comprising voice data, this communicator comprising voice data is The main body machine in the one sub-meeting-place of audio frequency, ratio the first client described above, its structural representation as shown in Figure 8, Specifically may include that
First link establishment unit 10, for setting up respectively and other client in the described first sub-meeting-place of audio frequency The first communication link between end.
Signal receiving unit 11, for receiving the first audio signal, described first audio signal is described the The audio signal of the audio signal in the sub-meeting-place of other audio frequency outside the one sub-meeting-place of audio frequency.Signal receiving unit 11 can receive the audio mixing equipment in the communication system comprising voice data or the main body in the sub-meeting-place of the second audio frequency The first audio signal that machine sends.
First signal transmitting unit 12, first for being set up by described first link establishment unit 10 is led to The first audio signal that described signal receiving unit 11 receives is sent respectively to other client described by letter link End plays out.
Broadcast unit 13, for after described signal receiving unit 11 receives described first audio signal Preset time delay after play described first audio signal, described preset time delay is to other client described Network delay average, the specially first client transmits a signal to other visitor in the first sub-meeting-place of audio frequency respectively The average of time used by the end of family, i.e. network delay average.
In the device of the present embodiment, the first link establishment unit 10 is set up and the first sub-meeting-place of audio frequency respectively First communication link of other client, so owing to the device of the present embodiment is in the first sub-meeting-place of audio frequency The standard deviation of the network delay of other client is less so that other client can synchronously connect substantially Receive the first audio signal, if signal receiving unit 11 is receiving a fixed response time of the first audio signal After play this first audio signal by broadcast unit 13 again, so that all visitors in a sub-meeting-place of audio frequency Family end is play the first audio signal and is substantially tended to synchronizing;And due to all visitors in the sub-meeting-place of some audio frequency The audio signal that family end is play is the most identical, and is the audio signal of the audio signal in the sub-meeting-place of other audio frequency, Do not exist and the sub-meeting-place of this audio frequency is play the sound in the sub-meeting-place of this audio frequency and produces acoustic feedback and utter long and high-pitched sounds.So by In can effectively suppress the problem of uttering long and high-pitched sounds so that the client i.e. dress of the present embodiment in the sub-meeting-place of each audio frequency Put and can use the portable terminals such as mobile phone, and the terminal of voice communication that need not be special, reduce audio frequency The cost of communication.
With reference to shown in Fig. 9, in a specific embodiment, comprise the communicator of voice data except can To include outside structure as shown in Figure 8, it is also possible to include secondary signal transmitting element 14, the second link establishment Unit 15, the 3rd signal transmitting unit 16, add unit 17, the first average transmitting element 18 and the first letter Breath receives unit 19, wherein:
Secondary signal transmitting element 14, is used for obtaining pickup signal, by described pickup signal and described first The identification information in the sub-meeting-place of audio frequency, signal after maybe described pickup signal being processed at least one times and The identification information in the described first sub-meeting-place of audio frequency is sent to described audio mixing equipment.
Described secondary signal transmitting element 14, specifically for obtaining the first pickup letter of described first client Number;Described described pickup signal is processed at least one times after signal for described first pickup signal Carry out the signal after stereo echo Processing for removing;
Or, described secondary signal transmitting element 14, specifically for obtain that other client described sends the Two pickup signal and obtain the first pickup signal of described first client;Described described pickup signal is entered Walk to the signal after few single treatment for described second pickup signal to be mixed with described first pickup signal The audio signal in the described first sub-meeting-place of audio frequency obtained after sound, or described first pickup signal is stood Signal after body acoustic echo Processing for removing, described obtained after carrying out audio mixing with described second pickup signal The audio signal in the one sub-meeting-place of audio frequency;
Or, described secondary signal transmitting element 14, specifically for obtaining entering of described other client transmission The 3rd pickup signal after row stereo echo Processing for removing, and obtain the first the ten of described first client Tone signal;Described described pickup signal is processed at least one times after signal for described 3rd pickup The audio signal in the described first sub-meeting-place of audio frequency that signal and described first pickup signal obtain after carrying out audio mixing, Or described first pickup signal is carried out the signal after stereo echo Processing for removing, with described 3rd pickup The audio signal in the described first sub-meeting-place of audio frequency that signal obtains after carrying out audio mixing.
Second link establishment list 15, leads to for setting up between the main body machine in the sub-meeting-place of the second audio frequency second Letter link.
3rd signal transmitting unit 16, for by the audio frequency of each client in the described first sub-meeting-place of audio frequency Signal carries out audio mixing and obtains the second audio signal;Second set up by described second link establishment unit 15 Described second audio signal is sent to the main body machine in the described second sub-meeting-place of audio frequency by communication link, in order to institute State main body machine and described second audio signal is sent to the nonbody machine in the described second sub-meeting-place of audio frequency.
Add unit 17, be used for adding the described first sub-meeting-place of audio frequency.
First average transmitting element 18, the communicator comprising voice data described in obtain to described the The network delay average of other client in the one sub-meeting-place of audio frequency, by the described communication dress comprising voice data The network delay average put be sent to described in comprise voice data communication system in audio mixing equipment or the 3rd Method, apparatus;
The first information receives unit 19, if comprising sound for what described first average transmitting element 18 sent Described in the network delay average ratio of the communicator of frequency evidence, the network delay average of other client is little, connects Receive the announcement information that described audio mixing equipment or third party device send, described announcement information include described in comprise The communicator of voice data is as the information of the main body machine in the described first sub-meeting-place of audio frequency.
In one case, as the device in the present embodiment be in system as shown in Figure 1a arbitrary audio frequency The main body machine in meeting-place, then after addition unit 17 joins the first sub-meeting-place of audio frequency, it is possible to set with audio mixing Being attached between Bei, then the first average transmitting element 18 just can be by the network of the device of the present embodiment Time delay average is sent to audio mixing equipment.The notice that audio mixing equipment sends is received when the first information receives unit 19 After information, the first link establishment unit 10 can be triggered and set up the first communication link, work as signal receiving unit After 11 receive the first audio signal that audio mixing equipment sends, by the first signal transmitting unit 12 by this First audio signal is sent to other client by one communication link.
In another case, it is arbitrary audio frequency in system as shown in Figure 1 b such as the device in the present embodiment The main body machine in sub-meeting-place, then, after addition unit 17 joins the first sub-meeting-place of audio frequency, the first average sends The network delay average of the device of the present embodiment just can be sent to third party device by unit 18.When first After information receiving unit 19 receives the announcement information that third party device sends, the first link establishment can be triggered Unit 10 sets up the first communication link, and the second link establishment unit 15 sets up the second communication link, this feelings Under condition, the first signal transmitting unit 12 can lead to by the second of described second link establishment unit 15 foundation Letter link receives the first audio signal signal that the main body machine in the described second sub-meeting-place of audio frequency sends;Also may be used To be sent the second audio signal by the 3rd signal transmitting unit 16 by the second communication link.
Present device embodiment two
Also providing for a kind of communicator comprising voice data, this communicator comprising voice data belongs to The nonbody machine in the first sub-meeting-place of audio frequency, ratio the second client described above, its structural representation such as Figure 10 Shown in, specifically may include that
Link establishment unit 20, for setting up the between the main body machine in the described first sub-meeting-place of audio frequency One communication link;
Audio mixing receives unit 21, connects for the first communication link set up by described link establishment unit 20 Receiving the first audio signal, described first audio signal is other audio frequency outside the described first sub-meeting-place of audio frequency The audio signal of the audio signal in sub-meeting-place;
Signal broadcast unit 22, receives, for playing described audio mixing, the first audio signal that unit 21 receives.
With reference to shown in Figure 11, in a specific embodiment, comprise the communicator of voice data except Can include outside structure as shown in Figure 10, it is also possible to include signal transmitting unit 23, reconstruction unit 24, Meeting-place addition unit 25, the second average transmitting element 26 and the second information receiving unit 27, wherein:
Signal transmitting unit 23, for by the second pickup signal of described second client, or to described the Signal after two pickup signal process at least one times is sent to described main body machine;Or,
Described signal transmitting unit 23, for by the second pickup signal of described second client and described the The identification information in the one sub-meeting-place of audio frequency be sent to described in comprise voice data communication system in audio mixing equipment, Or by described described second pickup signal is processed at least one times after signal and described first audio frequency The identification information in meeting-place is sent to described audio mixing equipment;
Wherein, it is processed as at least one times described second pickup signal is entered to described second pickup signal Signal after row stereo echo Processing for removing.
Reconstruction unit 24, if the main body machine in the described first sub-meeting-place of audio frequency exits described first sound The most sub-meeting-place, using described second client as new main body machine, sets up and described first audio frequency respectively In meeting-place, other remains the third communication link between client.Or, if the described first sub-meeting-place of audio frequency In main body machine exit the described first sub-meeting-place of audio frequency, set up the master new with the described first sub-meeting-place of audio frequency Fourth communication link between body machine.
Meeting-place adds unit 25, is used for adding the described first sub-meeting-place of audio frequency.
Second average transmitting element 26, the communicator comprising voice data described in obtain to described the The network delay average of other client in the one sub-meeting-place of audio frequency;By the described communication dress comprising voice data The network delay average put be sent to described in comprise voice data communication system in audio mixing equipment or the 3rd Method, apparatus;
Second information receiving unit 27, if for described in the network delay average ratio of described first client In the first sub-meeting-place of audio frequency, the network delay average of other client in addition to the first client is little, receives The announcement information that described audio mixing equipment or third party device send, described announcement information includes the first client Information as the main body machine in the described first sub-meeting-place of audio frequency.
In one case, as the device in the present embodiment be in system as shown in Figure 1a arbitrary audio frequency The nonbody machine in meeting-place, then after meeting-place addition unit 24 joins the first sub-meeting-place of audio frequency, it is possible to Being attached between audio mixing equipment, then the second average transmitting element 25 just can be by the device of the present embodiment Network delay average be sent to audio mixing equipment.Send when the second information receiving unit 26 receives audio mixing equipment Announcement information after, unit 20 can be set up with trigger link and set up the first communication link, when audio mixing receives single After unit 21 receives the first audio signal that main body machine sends, signal broadcast unit 22 play this and first mix Tone signal.
In another case, it is arbitrary audio frequency in system as shown in Figure 1 b such as the device in the present embodiment The nonbody machine in sub-meeting-place, then, after meeting-place addition unit 24 joins the first sub-meeting-place of audio frequency, second is equal The network delay average of the device of the present embodiment just can be sent to third party device by value transmitting element 25. After the second information receiving unit 26 receives the announcement information that third party device sends, can build with trigger link Vertical unit 20 sets up the first communication link.When the main body machine in the first sub-meeting-place of audio frequency exits the first audio frequency meeting After Chang, audio mixing equipment or third party device determine new main body machine, if the device of selected the present embodiment For main body machine, reconstruction unit 24 can re-establish the communication link between other client, the most mixed Sound receives unit 21 just can receive the first audio mixing letter by the communication link that this reconstruction unit 24 re-establishes Number.
Present device embodiment three
Also providing for a kind of communicator comprising voice data, ratio audio mixing equipment described above, its structure is shown It is intended to as shown in figure 12, specifically may include that
Determine unit 30, for determining the main body machine in the sub-meeting-place of multiple audio frequency respectively.
Described determine unit 30, specifically for obtaining each client in the described first sub-meeting-place of audio frequency respectively Network delay average to other client;If the first client arrives it in the described first sub-meeting-place of audio frequency The network delay average of network delay other client of average ratio of its client is little, by described first client End is defined as the main body machine in the described first sub-meeting-place of audio frequency;Send announcement information to described first client, Described announcement information includes described first client information as the main body machine in the first sub-meeting-place of audio frequency.
Receive unit 31, for receiving the audio signal in the sub-meeting-place of the plurality of audio frequency and corresponding audio frequency respectively The identification information in sub-meeting-place.
Specifically, the sound in the sub-meeting-place of arbitrary audio frequency in the sub-meeting-place of the plurality of audio frequency that unit 31 receives is received Frequently signal is that the pickup signal to the client in the described sub-meeting-place of arbitrary audio frequency carries out stereo echo elimination Signal after process.
Or, receive the audio frequency letter in the sub-meeting-place of arbitrary audio frequency in the sub-meeting-place of the plurality of audio frequency that unit 31 receives It number it is the audio signal that in the described sub-meeting-place of arbitrary audio frequency, each client sends;Or,
Or, receiving the audio signal in the sub-meeting-place of arbitrary audio frequency in the sub-meeting-place of multiple audio frequency that unit 31 receives is To the signal after the audio signal of each client carries out audio mixing in the described sub-meeting-place of arbitrary audio frequency.
Mixing operation unit 32, the mark letter in the sub-meeting-place of audio frequency for receiving according to described reception unit 31 Breath, by the sound in the sub-meeting-place of other audio frequency in addition to the first sub-meeting-place of audio frequency in sub-for the plurality of audio frequency meeting-place Frequently signal carries out audio mixing and obtains the first audio signal.
Audio signal transmitting element 33, for the first audio signal obtained by described mixing operation unit 32 It is sent to the described main body machine determining the first sub-meeting-place of audio frequency that unit 30 determines, in order to described main body machine will Other client that described first audio signal is sent in the described first sub-meeting-place of audio frequency plays out.
With reference to shown in Figure 13, in a specific embodiment, comprise the communicator of voice data except Can include outside structure as shown in figure 12, it is also possible to including: redefine unit 34, if for institute Stating the first client and exit the described first sub-meeting-place of audio frequency, the most described first sub-meeting-place of audio frequency includes multiple Residue client, redefines the main body in the described first sub-meeting-place of audio frequency in the plurality of residue client Machine.First audio signal just can be sent to redefine unit 34 by audio signal transmitting element 33 afterwards Again new main body machine.
In the device of the present embodiment, mixing operation unit 32 meeting will be except the sub-meeting-place of a certain audio frequency such as first The audio signal in the sub-meeting-place of other audio frequency outside the sub-meeting-place of audio frequency carries out audio mixing and obtains the first audio signal, And by audio signal transmitting element 33, first audio signal is sent to the main body machine in this sub-meeting-place of the first audio frequency, Then it is sent to other client by main body machine play out.Due to the client in the sub-meeting-place of some audio frequency The audio signal that end is play is identical, and is the audio signal of the audio signal in the sub-meeting-place of other audio frequency, does not deposits In the sub-meeting-place of this audio frequency, play the sound in the sub-meeting-place of this audio frequency and produce acoustic feedback and utter long and high-pitched sounds.Further, Owing in the sub-meeting-place of main body machine to audio frequency, the standard deviation of the network delay of other client is less so that its Its client can be synchronously received the first audio signal substantially, if main body machine sets receiving audio mixing This first audio signal is play again after one fixed response time of the first audio signal that preparation is sent, so that one In the sub-meeting-place of audio frequency, all client terminal playing the first audio signal tend to synchronizing substantially.
Present device embodiment four
Also provide for a kind of communicator comprising voice data, its structural representation as shown in figure 14, this bag Communicator containing voice data can produce bigger difference because of configuration or performance difference, can include One or more central processing units (central processing units, CPU) 40 (such as, one Or more than one processor) and memorizer 41, one or more storage application program 421 or data 422 Storage medium 42 (such as one or more mass memory units).Wherein, memorizer 41 and storage Medium 42 can be of short duration storage or persistently store.The program being stored in storage medium 42 can include one Or more than one module (diagram does not marks), each module can include the communication dress comprising voice data A series of command operatings in putting.Further, central processing unit 40 could be arranged to and storage medium 42 communications, perform a series of command operatings in storage medium 42 on the communicator comprise voice data.
The communicator comprising voice data can also include one or more power supplys 43, one or one Individual above wired or wireless network interface 44, one or more input/output interfaces 45, and/or, one Individual or more than one operating system 423, such as Windows ServerTM, Mac OS XTM, UnixTM, LinuxTM, FreeBSDTM etc..
Described in said method embodiment by the step performed by audio mixing equipment, performed by the first client Step, and the step performed by the second client can be based on comprising voice data shown in this Figure 14 The structure of communicator.
The embodiment of the present invention also provides for a kind of communication system comprising voice data, its structural representation such as figure Shown in 1a, including audio mixing equipment and the sub-meeting-place of multiple audio frequency, each audio frequency meeting in the sub-meeting-place of multiple audio frequency Field includes multiple client, and these multiple clients include the first client and multiple second client, its In:
The structure of audio mixing equipment can comprising as described in above-mentioned apparatus embodiments three or apparatus embodiments four The structure of the communicator of voice data, the structure of the first client can such as above-mentioned apparatus embodiments one or The structure of the communicator comprising voice data described in apparatus embodiments four, the structure of the second client Can the communicator comprising voice data as described in above-mentioned apparatus embodiments two or apparatus embodiments four Structure, do not repeat at this.
The embodiment of the present invention also provides for another kind of audio communication system, its structural representation as shown in Figure 1 b, Including two sub-meeting-place of audio frequency, in the sub-meeting-place of the two audio frequency, the sub-meeting-place of each audio frequency includes the first client End and multiple second clients, wherein:
The structure of the first client can bag as described in above-mentioned apparatus embodiments one or apparatus embodiments four The structure of the communicator containing voice data, the structure of the second client can be such as above-mentioned apparatus embodiments two Or the structure of the communicator comprising voice data described in apparatus embodiments four, do not repeat at this.
One of ordinary skill in the art will appreciate that all or part of step in the various methods of above-described embodiment Suddenly the program that can be by completes to instruct relevant hardware, and this program can be stored in a computer can Reading in storage medium, storage medium may include that read only memory (ROM), random access memory RAM), disk or CD etc..
The communication means comprising voice data, the Apparatus and system that are thered is provided the embodiment of the present invention above enter Having gone and be discussed in detail, principle and the embodiment of the present invention are explained by specific case used herein Stating, the explanation of above example is only intended to help to understand method and the core concept thereof of the present invention;Meanwhile, For one of ordinary skill in the art, according to the thought of the present invention, at detailed description of the invention and application model Placing and all will change, in sum, this specification content should not be construed as limitation of the present invention.

Claims (34)

1. the communication means comprising voice data, it is characterised in that be applied to comprise voice data The first client in communication system, described first client belongs to the first sub-meeting-place of audio frequency, described method Including:
Set up respectively and the first communication link between other client in the described first sub-meeting-place of audio frequency;
Receiving the first audio signal, described first audio signal is its outside the described first sub-meeting-place of audio frequency The audio signal of the audio signal in the sub-meeting-place of its audio frequency;
By described first communication link, described first audio signal is sent respectively to other client described Play out;
Described first audio signal is play after preset time delay after receiving described first audio signal, Described preset time delay is the network delay average to other client described.
2. the method for claim 1, it is characterised in that described reception the first audio signal, tool Body includes: comprise the first audio mixing letter that the audio mixing equipment in the communication system of voice data sends described in reception Number;
Described method also includes:
Obtain pickup signal, by described pickup signal and the identification information in the described first sub-meeting-place of audio frequency, or Signal after described pickup signal being processed at least one times and the mark in the described first sub-meeting-place of audio frequency Information is sent to described audio mixing equipment.
3. method as claimed in claim 2, it is characterised in that
Described acquisition pickup signal specifically includes: obtain the first pickup signal of described first client;Institute State the signal after described pickup signal is processed at least one times for described first pickup signal to be stood Signal after body acoustic echo Processing for removing;
Or,
Described acquisition pickup signal specifically includes: obtain the second pickup signal that other client described sends And obtain the first pickup signal of described first client;Described described pickup signal is carried out at least one times Signal after process be described second pickup signal and described first pickup signal are carried out audio mixing after obtain The audio signal in the described first sub-meeting-place of audio frequency, or described first pickup signal is carried out stereo echo disappear Except the signal after processing, the described first audio frequency meeting obtained after carrying out audio mixing with described second pickup signal The audio signal of field;
Or,
Described acquisition pickup signal specifically includes: obtain described other client transmission carries out stereo time The 3rd pickup signal after sound Processing for removing, and obtain the first pickup signal of described first client;Institute Stating the signal after processing described pickup signal at least one times is with described to described 3rd pickup signal The audio signal in the described first sub-meeting-place of audio frequency that the first pickup signal obtains after carrying out audio mixing, or to described First pickup signal carries out the signal after stereo echo Processing for removing, carries out with described 3rd pickup signal The audio signal in the described first sub-meeting-place of audio frequency obtained after audio mixing.
4. the method for claim 1, it is characterised in that before described reception the first audio signal, Also include: set up the second communication link between the main body machine in the sub-meeting-place of the second audio frequency;
Described reception the first audio signal, specifically includes: receive described the by described second communication link The first audio signal that main body machine in the two sub-meeting-place of audio frequency sends;
Described method also includes:
The audio signal of each client in the described first sub-meeting-place of audio frequency is carried out audio mixing and obtains the second audio mixing Signal;
By described second communication link, described second audio signal is sent to the described second sub-meeting-place of audio frequency Main body machine, in order to described second audio signal is sent to the described second sub-meeting-place of audio frequency by described main body machine Nonbody machine.
5. the method as described in any one of Claims 1-4, it is characterised in that described foundation and institute respectively Before stating in the first sub-meeting-place of audio frequency the first communication link between other client, described method also includes:
Add the described first sub-meeting-place of audio frequency.
6. the method as described in any one of Claims 1-4, it is characterised in that described foundation and institute respectively Before stating in the first sub-meeting-place of audio frequency the first communication link between other client, described method also includes:
Obtain described first client equal to the network delay of other client in the described first sub-meeting-place of audio frequency Value;
The communication system comprising voice data described in the network delay average of described first client being sent to In audio mixing equipment or third party device;
If the network delay average of other client described in the network delay average ratio of described first client Little, receive described audio mixing equipment or the announcement information of third party device transmission, described announcement information includes institute State first client information as the main body machine in the described first sub-meeting-place of audio frequency.
7. the communication means comprising voice data, it is characterised in that be applied to comprise voice data The second client in communication system, described second client belongs to the first sub-meeting-place of audio frequency, described method Including:
Set up the first communication link between the main body machine in the described first sub-meeting-place of audio frequency;
Receiving the first audio signal by described first communication link, described first audio signal is described The audio signal of the audio signal in the sub-meeting-place of other audio frequency outside the one sub-meeting-place of audio frequency;
Play described first audio signal.
8. method as claimed in claim 7, it is characterised in that described method also includes:
By the second pickup signal of described second client, or described second pickup signal is carried out at least one Signal after secondary process is sent to described main body machine;Or,
Second pickup signal of described second client and the identification information in the described first sub-meeting-place of audio frequency are sent out The audio mixing equipment in the communication system of voice data is comprised described in giving, or by described to described second pickup Signal process at least one times after signal and the identification information in the described first sub-meeting-place of audio frequency be sent to institute State audio mixing equipment;
Wherein, it is processed as at least one times described second pickup signal is entered to described second pickup signal Signal after row stereo echo Processing for removing.
9. method as claimed in claim 7, it is characterised in that described method also includes:
If the main body machine in the described first sub-meeting-place of audio frequency exits the described first sub-meeting-place of audio frequency, by described Second client, as new main body machine, is set up and other residue visitor in the described first sub-meeting-place of audio frequency respectively Third communication link between the end of family;
Or, if the main body machine in the described first sub-meeting-place of audio frequency exits the described first sub-meeting-place of audio frequency, build The fourth communication link between main body machine new in the vertical and described first sub-meeting-place of audio frequency.
10. the method as described in any one of claim 7 to 10, it is characterised in that described foundation is with described In the first sub-meeting-place of audio frequency before the first communication link between main body machine, described method also includes:
Add the described first sub-meeting-place of audio frequency.
11. methods as claimed in claim 10, it is characterised in that described foundation and described first audio frequency In sub-meeting-place before the first communication link between main body machine, described method also includes:
Obtain described second client equal to the network delay of other client in the described first sub-meeting-place of audio frequency Value;
The communication system comprising voice data described in the network delay average of described second client being sent to In audio mixing equipment or third party device;
If except the first visitor in the first sub-meeting-place of audio frequency described in the network delay average ratio of described first client The network delay average of other client outside the end of family is little, receives described audio mixing equipment or third party device The announcement information sent, described announcement information includes that the first client is as the described first sub-meeting-place of audio frequency The information of main body machine.
12. 1 kinds of communication means comprising voice data, it is characterised in that described method is applied to comprise Audio mixing equipment in the communication system of voice data, including:
Determine the main body machine in the sub-meeting-place of multiple audio frequency respectively;
Receive audio signal and the identification information in the corresponding sub-meeting-place of audio frequency in the sub-meeting-place of the plurality of audio frequency respectively;
According to the identification information in the sub-meeting-place of described audio frequency, sub-for the plurality of audio frequency meeting-place will be removed the first audio frequency The audio signal in the sub-meeting-place of other audio frequency outside sub-meeting-place carries out audio mixing and obtains the first audio signal;
Described first audio signal is sent to the main body machine in the described first sub-meeting-place of audio frequency, in order to described master Other client that described first audio signal is sent in the described first sub-meeting-place of audio frequency by body machine is broadcast Put.
13. methods as claimed in claim 12, it is characterised in that determine the sub-meeting-place of the plurality of audio frequency In the main body machine in the first sub-meeting-place of audio frequency, specifically include:
Obtain each client in the described first sub-meeting-place of audio frequency respectively equal to the network delay of other client Value;
If the first client is to the network delay average ratio of other client in the described first sub-meeting-place of audio frequency The network delay average of other client is little, and described first client is defined as described first audio frequency meeting The main body machine of field;
Transmission announcement information is to described first client, and described announcement information includes that described first client is made It is the information of the main body machine in the first sub-meeting-place of audio frequency.
14. methods as claimed in claim 13, it is characterised in that described method also includes:
If described first client exits the described first sub-meeting-place of audio frequency, the most described first sub-meeting-place of audio frequency Include multiple residue client, the plurality of residue client redefines described first audio frequency The main body machine in meeting-place.
15. methods as described in any one of claim 12 to 14, it is characterised in that the plurality of audio frequency In sub-meeting-place, the audio signal in the sub-meeting-place of arbitrary audio frequency is to the client in the described sub-meeting-place of arbitrary audio frequency Pickup signal carries out the signal after stereo echo Processing for removing.
16. methods as described in any one of claim 12 to 14, it is characterised in that the plurality of audio frequency During in sub-meeting-place, the audio signal in the sub-meeting-place of arbitrary audio frequency is the described sub-meeting-place of arbitrary audio frequency, each client is sent out The audio signal sent;Or,
In the sub-meeting-place of the plurality of audio frequency, the audio signal in the sub-meeting-place of arbitrary audio frequency is to described arbitrary audio frequency Signal after the audio signal of each client carries out audio mixing in meeting-place.
17. 1 kinds of communicators comprising voice data, it is characterised in that described in comprise voice data Communicator belongs to the first sub-meeting-place of audio frequency, including:
First link establishment unit, for setting up respectively and other client in the described first sub-meeting-place of audio frequency Between the first communication link;
Signal receiving unit, for receiving the first audio signal, described first audio signal is described first The audio signal of the audio signal in the sub-meeting-place of other audio frequency outside the sub-meeting-place of audio frequency;
First signal transmitting unit, for dividing described first audio signal by described first communication link It is not sent to other client described play out;
Broadcast unit, described for playing after receiving the preset time delay after described first audio signal First audio signal, described preset time delay is the network delay average to other client described.
18. devices as claimed in claim 17, it is characterised in that
Described signal receiving unit, mixed specifically for comprise described in receiving in the communication system of voice data The first audio signal that sound equipment sends;
Also include: secondary signal transmitting element, be used for obtaining pickup signal, by described pickup signal and institute State the identification information in the first sub-meeting-place of audio frequency, after maybe described pickup signal being processed at least one times The identification information in signal and the described first sub-meeting-place of audio frequency is sent to described audio mixing equipment.
19. devices as claimed in claim 18, it is characterised in that
Described secondary signal transmitting element, specifically for obtaining the first pickup signal of described first client; Described described pickup signal is processed at least one times after signal for described first pickup signal is carried out Signal after stereo echo Processing for removing;
Or,
Described secondary signal transmitting element, specifically for obtaining the second pickup that other client described sends Signal and obtain the first pickup signal of described first client;Described described pickup signal is carried out at least Signal after single treatment is for obtaining after described second pickup signal and described first pickup signal are carried out audio mixing The audio signal in the described first sub-meeting-place of audio frequency arrived, or described first pickup signal is carried out stereo time Signal after sound Processing for removing, described first audio frequency obtained after carrying out audio mixing with described second pickup signal The audio signal in sub-meeting-place;
Or,
Described secondary signal transmitting element, carries out solid specifically for what acquisition other client described sent The 3rd pickup signal after acoustic echo Processing for removing, and obtain the first pickup signal of described first client; Described described pickup signal is processed at least one times after signal for described 3rd pickup signal and institute State the audio signal in the described first sub-meeting-place of audio frequency obtained after the first pickup signal carries out audio mixing, or to institute State the signal after the first pickup signal carries out stereo echo Processing for removing, enter with described 3rd pickup signal The audio signal in the described first sub-meeting-place of audio frequency obtained after row audio mixing.
20. devices as claimed in claim 17, it is characterised in that also include: the second link establishment list Unit, for setting up the second communication link between the main body machine in the sub-meeting-place of the second audio frequency;
Described first signal transmitting unit, specifically for receiving described second by described second communication link The first audio signal that main body machine in the sub-meeting-place of audio frequency sends;
Described device also includes:
3rd signal transmitting unit, for by the audio frequency letter of each client in the described first sub-meeting-place of audio frequency Number carrying out audio mixing obtains the second audio signal;By described second communication link by described second audio signal It is sent to the main body machine in the described second sub-meeting-place of audio frequency, in order to described main body machine is by described second audio signal It is sent to the nonbody machine in the described second sub-meeting-place of audio frequency.
21. devices as described in any one of claim 17 to 20, it is characterised in that also include:
Add unit, be used for adding the described first sub-meeting-place of audio frequency.
22. devices as described in any one of claim 17 to 20, it is characterised in that also include:
First average transmitting element, the communicator being used for comprising voice data described in obtaining is to described first The network delay average of other client in the sub-meeting-place of audio frequency, by the described communicator comprising voice data Network delay average be sent to described in comprise voice data communication system in audio mixing equipment or third party Equipment;
The first information receives unit, if comprising the network delay of the communicator of voice data described in Yong Yu The network delay average of other client described in average ratio is little, receives described audio mixing equipment or third party device Send announcement information, described announcement information include described in comprise voice data communicator as described The information of the main body machine in the first sub-meeting-place of audio frequency.
23. 1 kinds of communicators comprising voice data, it is characterised in that described in comprise voice data Communicator belongs to the first sub-meeting-place of audio frequency, including:
Link establishment unit, for setting up first between the main body machine in the described first sub-meeting-place of audio frequency Communication link;
Audio mixing receives unit, for receiving the first audio signal by described first communication link, and described the One audio signal is the audio mixing of the audio signal in the sub-meeting-place of other audio frequency outside the described first sub-meeting-place of audio frequency Signal;
Signal broadcast unit, is used for playing described first audio signal.
24. devices as claimed in claim 23, it is characterised in that also include:
Signal transmitting unit, is used for the second pickup signal of described second client, or to described second Signal after pickup signal processes at least one times is sent to described main body machine;Or,
Described signal transmitting unit, for by second pickup signal and described first of described second client The identification information in the sub-meeting-place of audio frequency be sent to described in comprise voice data communication system in audio mixing equipment, Or by described described second pickup signal is processed at least one times after signal and described first audio frequency The identification information in meeting-place is sent to described audio mixing equipment;
Wherein, it is processed as at least one times described second pickup signal is entered to described second pickup signal Signal after row stereo echo Processing for removing.
25. devices as claimed in claim 23, it is characterised in that also include:
Reconstruction unit, if the main body machine in the described first sub-meeting-place of audio frequency exits described first audio frequency Sub-meeting-place, using described second client as new main body machine, sets up and described first audio frequency meeting respectively In Chang, other remains the third communication link between client;
Or, if the main body machine in the described first sub-meeting-place of audio frequency exits the described first sub-meeting-place of audio frequency, build The fourth communication link between main body machine new in the vertical and described first sub-meeting-place of audio frequency.
26. devices as described in any one of claim 23 to 25, it is characterised in that also include:
Meeting-place adds unit, is used for adding the described first sub-meeting-place of audio frequency.
27. devices as claimed in claim 26, it is characterised in that also include:
Second average transmitting element, the communicator being used for comprising voice data described in obtaining is to described first The network delay average of other client in the sub-meeting-place of audio frequency;By the described communicator comprising voice data Network delay average be sent to described in comprise voice data communication system in audio mixing equipment or third party Equipment;
Second information receiving unit, if for described in the network delay average ratio of described first client the In the one sub-meeting-place of audio frequency, the network delay average of other client in addition to the first client is little, receives institute Stating audio mixing equipment or the announcement information of third party device transmission, described announcement information includes that the first client is made Information for the main body machine in the described first sub-meeting-place of audio frequency.
28. 1 kinds of communicators comprising voice data, it is characterised in that including:
Determine unit, for determining the main body machine in the sub-meeting-place of multiple audio frequency respectively;
Receive unit, for receiving the audio signal in the sub-meeting-place of the plurality of audio frequency and corresponding audio frequency respectively The identification information in meeting-place;
Mixing operation unit, for the identification information according to the sub-meeting-place of described audio frequency, by the plurality of audio frequency In sub-meeting-place, the audio signal in the sub-meeting-place of other audio frequency in addition to the first sub-meeting-place of audio frequency carries out audio mixing and obtains First audio signal;
Audio signal transmitting element, for being sent to described first audio frequency meeting by described first audio signal The main body machine of field, in order to described first audio signal is sent to described first audio frequency meeting by described main body machine Other client in Chang plays out.
29. devices as claimed in claim 28, it is characterised in that
Described determine unit, arrive specifically for obtaining each client in the described first sub-meeting-place of audio frequency respectively The network delay average of other client;If the first client arrives other in the described first sub-meeting-place of audio frequency The network delay average of network delay other client of average ratio of client is little, by described first client It is defined as the main body machine in the described first sub-meeting-place of audio frequency;Send announcement information to described first client, institute State announcement information and include described first client information as the main body machine in the first sub-meeting-place of audio frequency.
30. devices as claimed in claim 28, it is characterised in that also include:
Redefine unit, if exiting the described first sub-meeting-place of audio frequency, then for described first client The described first sub-meeting-place of audio frequency includes multiple residue client, in the plurality of residue client again Determine the main body machine in the described first sub-meeting-place of audio frequency.
31. devices as described in any one of claim 28 to 30, it is characterised in that the plurality of audio frequency In sub-meeting-place, the audio signal in the sub-meeting-place of arbitrary audio frequency is to the client in the described sub-meeting-place of arbitrary audio frequency Pickup signal carries out the signal after stereo echo Processing for removing.
32. devices as described in any one of claim 28 to 30, it is characterised in that the plurality of audio frequency During in sub-meeting-place, the audio signal in the sub-meeting-place of arbitrary audio frequency is the described sub-meeting-place of arbitrary audio frequency, each client is sent out The audio signal sent;Or,
In the sub-meeting-place of the plurality of audio frequency, the audio signal in the sub-meeting-place of arbitrary audio frequency is to described arbitrary audio frequency Signal after the audio signal of each client carries out audio mixing in meeting-place.
33. 1 kinds of communication systems comprising voice data, it is characterised in that include audio mixing equipment and multiple The sub-meeting-place of audio frequency, in the sub-meeting-place of the plurality of audio frequency, the sub-meeting-place of each audio frequency includes multiple client, described Multiple clients include the first client and multiple second client;
Described audio mixing equipment is to comprise the logical of voice data as described in described any one of claim 28 to 32 T unit;
Described first client is such as claim 17 to 19, comprises audio frequency according to any one of 21 and 22 The communicator of data;
Described second client is the communication comprising voice data as described in any one of claim 23 to 27 Device.
34. 1 kinds of systems comprising voice data, it is characterised in that include two sub-meeting-place of audio frequency, institute State the sub-meeting-place of each audio frequency in two sub-meeting-place of audio frequency and include the first client and multiple second client, Wherein:
Described first client is such as claim 17, comprises voice data according to any one of 20 to 22 Communicator;
Described second client is the communication comprising voice data as described in any one of claim 23 to 27 Device.
CN201610321348.XA 2016-05-12 2016-05-12 A kind of communication means comprising audio data, apparatus and system Active CN105847096B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201610321348.XA CN105847096B (en) 2016-05-12 2016-05-12 A kind of communication means comprising audio data, apparatus and system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610321348.XA CN105847096B (en) 2016-05-12 2016-05-12 A kind of communication means comprising audio data, apparatus and system

Publications (2)

Publication Number Publication Date
CN105847096A true CN105847096A (en) 2016-08-10
CN105847096B CN105847096B (en) 2018-10-30

Family

ID=56593657

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610321348.XA Active CN105847096B (en) 2016-05-12 2016-05-12 A kind of communication means comprising audio data, apparatus and system

Country Status (1)

Country Link
CN (1) CN105847096B (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107484075A (en) * 2017-08-31 2017-12-15 深圳市豪恩声学股份有限公司 Device sound mixing and sound processing system
CN108712584A (en) * 2018-05-16 2018-10-26 中国电子科技集团公司第二十八研究所 A kind of distributed sound mixing method for videoconference
CN111586527A (en) * 2020-04-28 2020-08-25 重庆西原楼宇自动化工程有限公司 Intelligent voice processing system
CN111955018A (en) * 2018-05-02 2020-11-17 谷歌有限责任公司 Wireless solution for Bluetooth stereo audio playback

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101877643A (en) * 2010-06-29 2010-11-03 中兴通讯股份有限公司 Multipoint sound-mixing distant view presenting method, device and system
CN102065265A (en) * 2009-11-13 2011-05-18 华为终端有限公司 Method, device and system for realizing sound mixing
CN103152185A (en) * 2013-02-27 2013-06-12 深圳大学 Establishment method and system for conference site of voice conference
CN103312912A (en) * 2013-05-03 2013-09-18 华为软件技术有限公司 Sound mixing system and method
CN105374377A (en) * 2015-10-20 2016-03-02 北京小鸟听听科技有限公司 Control method, control system, and loudspeaker box of multiroom audio playing
US20160065898A1 (en) * 2014-08-28 2016-03-03 Samsung Sds Co., Ltd. Method for extending participants of multiparty video conference service
CN105429831A (en) * 2015-11-04 2016-03-23 广东欧珀移动通信有限公司 Main play equipment selection method and play equipment

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102065265A (en) * 2009-11-13 2011-05-18 华为终端有限公司 Method, device and system for realizing sound mixing
CN101877643A (en) * 2010-06-29 2010-11-03 中兴通讯股份有限公司 Multipoint sound-mixing distant view presenting method, device and system
CN103152185A (en) * 2013-02-27 2013-06-12 深圳大学 Establishment method and system for conference site of voice conference
CN103312912A (en) * 2013-05-03 2013-09-18 华为软件技术有限公司 Sound mixing system and method
US20160065898A1 (en) * 2014-08-28 2016-03-03 Samsung Sds Co., Ltd. Method for extending participants of multiparty video conference service
CN105374377A (en) * 2015-10-20 2016-03-02 北京小鸟听听科技有限公司 Control method, control system, and loudspeaker box of multiroom audio playing
CN105429831A (en) * 2015-11-04 2016-03-23 广东欧珀移动通信有限公司 Main play equipment selection method and play equipment

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN107484075A (en) * 2017-08-31 2017-12-15 深圳市豪恩声学股份有限公司 Device sound mixing and sound processing system
CN111955018A (en) * 2018-05-02 2020-11-17 谷歌有限责任公司 Wireless solution for Bluetooth stereo audio playback
US11071150B2 (en) 2018-05-02 2021-07-20 Google Llc True wireless solution for BT stereo audio playback
CN111955018B (en) * 2018-05-02 2022-02-01 谷歌有限责任公司 Method and system for connecting an audio accessory device with a client computing device
US11690109B2 (en) 2018-05-02 2023-06-27 Google Llc True wireless solution for BT stereo audio playback
CN108712584A (en) * 2018-05-16 2018-10-26 中国电子科技集团公司第二十八研究所 A kind of distributed sound mixing method for videoconference
CN111586527A (en) * 2020-04-28 2020-08-25 重庆西原楼宇自动化工程有限公司 Intelligent voice processing system

Also Published As

Publication number Publication date
CN105847096B (en) 2018-10-30

Similar Documents

Publication Publication Date Title
CN104299632B (en) Audio synchronization method, device and corresponding system
US20100048235A1 (en) Method and Device for Data Capture for Push Over Cellular
CN106126168B (en) A kind of sound effect treatment method and device
CN105847096A (en) Audio frequency data communication method, device and system
US20160080433A1 (en) Remote Conference Implementation Method and Apparatus
CN105210396B (en) A kind of method and device of selection information push terminal
CN105430459B (en) Audio data play method, device and intelligent TV set
JPWO2015068665A1 (en) RELAY DEVICE, VOICE COMMUNICATION SYSTEM, PROGRAM, AND RELAY METHOD
CN107040848A (en) Synchronization parameter transmission method, device and the equipment of AVDTP agreements
CN109743782A (en) Communication means, device and equipment
CN111049709B (en) Bluetooth-based interconnected loudspeaker box control method, equipment and storage medium
CN107277208A (en) Call method, the first communicator and terminal
CN106488023A (en) A kind of intercommunication call method, system and mobile terminal
CN107786965B (en) Team game communication method and related product
EP2207311A1 (en) Voice communication device
AU2015265881A1 (en) Method and system for establishing real-time audio connections
CN109874179B (en) Communication system, main controller, wireless processing unit and forwarding method
CN109672630A (en) A kind of system information transmission method, terminal and the network equipment
CN102036125B (en) Portable digital radio group navigation system
CN106254935A (en) A kind of method of resource-sharing and terminal
CN107195308B (en) Audio mixing method, device and system of audio and video conference system
CN106161044B (en) A kind of information transferring method and device
CN105282856B (en) A kind of method and user terminal of the transmission of control information
WO2017219546A1 (en) Information processing method, terminal, and computer storage medium
CN209358787U (en) Phone system, master controller and wireless processing unit

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant