CN102543087A - Audio mixing method applied to multi-point mobile audio communication system - Google Patents

Audio mixing method applied to multi-point mobile audio communication system Download PDF

Info

Publication number
CN102543087A
CN102543087A CN 201110445435 CN201110445435A CN102543087A CN 102543087 A CN102543087 A CN 102543087A CN 201110445435 CN201110445435 CN 201110445435 CN 201110445435 A CN201110445435 A CN 201110445435A CN 102543087 A CN102543087 A CN 102543087A
Authority
CN
Grant status
Application
Patent type
Prior art keywords
audio
audio data
multi
mixing
communication system
Prior art date
Application number
CN 201110445435
Other languages
Chinese (zh)
Inventor
余尧毅
向满天
周海
罗建平
虞贵财
邹文生
龙承志
Original Assignee
中兴长天信息技术(南昌)有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date

Links

Abstract

The invention discloses an audio mixing method applied to a multi-point mobile audio communication system. Audio data stream is acquired by means of network acquisition and server local acquisition, the acquired audio data stream is subjected to linear superposition, and audio data are attenuated by dynamically modifying variation factors. Using the method can guarantee integral sound intensity not to be attenuated too fast and guarantee low distortion, noise is avoided within a multi-channel audio mixing range, and audio effects can meet the requirements. The method is widely applicable to multi-point mobile audio communication command systems or multimedia online video conference systems.

Description

一种应用于多点移动音频通信系统的混音方法 Mixing one kind of method is applied to multi-point communication system, a mobile audio

技术领域 FIELD

[0001] 本发明涉及语音通信方法,特别是一种应用于多点移动音频通信系统的混音方法。 [0001] The present invention relates to a voice communication method, applied particularly to a multi-point audio mixing method in a mobile communication system.

背景技术 Background technique

[0002] 随着移动领域的飞速发展,工作的实时传达,实现团队合作,提高工作效率以及对现场情况传递,保证上级对下级工作状况有清晰了解等问题逐渐显现出来,多点移动音频通信指挥系统由此需要而产生。 [0002] With the rapid development of the mobile space, to convey real-time work, to achieve teamwork, increase productivity and deliver on-site, to ensure a higher level have a clear understanding of the subordinate working conditions and other issues came to the fore, mobile multi-point audio communications command the system thus needs arising. 而在多点移动音频通信指挥中当有多人同时进行讲话,传统的方式是使用控制发言权的方法,即某一时刻只允许一个人发言,发言前需向中心申请发言权,发言结束以后释放发言权,这种方法限制了成员之间的交流,也给移动通信带来了很多的不便。 In the multi-point mobile audio command communication when there are many people speak at the same time, the traditional way is to use voice control method that allows only one person at a time to speak, need to apply to the center before speaking voice, concluding later the floor is released, this approach limits the exchanges between members, it also brings a lot of inconvenience to mobile communications. 因此音频混合是个不可或缺的特性。 The audio mix is ​​therefore an essential characteristic.

[0003] 而现在一般的软件混音算法都是对输入的音频数据进行线性叠加: οηΐρηφ] = 2 = — l (1) [0003] Now general software algorithms are mixing audio data inputted linear superposition: οηΐρηφ] = 2 = - l (1)

或者是叠加后取平均值: After averaging or superimposition:

其中,m为输入音频数的个数,η为一帧的样本数目,f为一帧中第ί个样本,J为第/个音频流,所以"《Φ"®为混音后的一帧中第f个样本,^C/13为第/个输入音频流当前帧的第ι"个样本。通常的语音数据位16bit,即算法中的short类型,取值范围是-32768 ( 采样值< 32767,多个音频流直接线性叠加以后就有可能溢出,所以式(1)最后的结果可能会有溢出产生噪音;式(2)对,_«4/1(丨求平均值,解决了溢出问题,但是混音处理后的音量非常小,效果非常不理想。而本专利方法则可以很好解决上面出现的噪音和音频效果问题。 Wherein, m is the number of audio input, [eta] is the number of samples of one frame, f is a first sample ί, J for the first / audio streams, the "" Φ "® is a post-mix the first sample f, ^ C / 13 for the first / current input frame of audio streams ι "sample. typically speech data bits 16bit, i.e., algorithm type short range -32768 (sample values ​​< 32767, a plurality of audio streams directly after the linear superposition is possible overflow, the formula (1) may be the final result of noise overflow; (2) formula, _ «4/1 (Shu averaging, the overflow solution problem, but the volume after the mixing process is very small, the effect is very unsatisfactory. the method of this patent can be a good solution to the problem of noise and audio effects above.

发明内容 SUMMARY

[0004] 本发明的目的是提供一种应用于多点移动音频通信系统的混音方法,它可以最大限度的在进行混音处理过程中确保音频播放的效果以及真实度。 [0004] The object of the present invention is to provide a multi-point audio mixing method in a mobile communication system is applied, it can maximize the mixing process is performed to secure the effect and fidelity audio playback. 从而实现移动语音通信的正常运行。 Enabling normal operation of a mobile voice communication.

[0005] 本发明的目的是这样来实现的,其混音方法包含如下步骤: 1接收来自网络终端设备的音频数据流并进行解码。 Objective [0005] The present invention is achieved, which method comprises the steps of mixing: an audio data stream received from the network terminal device and decoding.

[0006] 2对服务器本地的音频数据流进行采集。 [0006] 2 on the local server collected audio data stream.

[0007] 3消除目的地自己的音频数据。 [0007] 3 to eliminate their destination audio data.

[0008] 4将接收到的网络音频数据流与服务器本地的音频数据流进行混音操作。 [0008] The network 4 stores the received audio data stream and a server local audio stream mix operation. [0009] 5系统计算当前混音处理模块需要处理的当前的混音通道有多少路。 [0009] 5 mixing processing module calculates the current system to be treated a current path mixer channel number.

[0010] a)设定好音频变化因子的初始值,并开始取每个混音通道内的一帧音频数据进行线性叠加操作。 [0010] a) setting an initial value of a good audio change factors, and starts taking a mix of audio data for each channel in the linear superposition operation.

[0011] b)对叠加后的混音值与变化因子进行相乘计算得出相乘后的混音大小。 [0011] b) change the mix factor value calculated by multiplying the superimposed mix after multiplying the size.

[0012] c)对步骤(b)计算出来的混音大小进行判断,如果大小超出预设的最大值和最小值,则通过调节变化因子的步长来获取满足在预设范围值内的变化因子大小。 [0012] c) step (b) mixing the calculated size judgment, if the size exceeds a preset maximum value and the minimum value, obtained by adjusting the step size change factors meet the changing values ​​within a preset range factor size.

[0013] d)将满足步骤(C)得出的混音值作为输出的混音数据。 [0013] d) satisfying the step (C) the value obtained mix mix data as output.

[0014] e)将满足步骤(d)的变化因子作为初始的变化因子大小并开始进行下一帧的音频数据进行处理。 [0014] e) satisfying the step (d) is the initial change factors as changes in the size factor and starts the audio data for the next frame is processed.

[0015] f)将满足(e)中的输出的音频数据流进行后期处理,如果目的地是服务器本身, 则直接进行播放,如果是要转发给终端设备,则进行编码再转发。 [0015] f) satisfies the audio data stream (e) in the post-processing output, if the destination is the server itself, the player directly, if it is to be forwarded to the terminal device, is coded and then transmitted.

[0016] 本发明的技术效果是:本发明混音处理过程不仅仅适用于多点移动音频通信指挥系统,同样也可以适用于多媒体网络视频会议系统中。 [0016] Technical effects of the invention are: mixing process of the invention is not only applicable to a mobile audio multi-point communication command system, is also applicable to a multimedia video conference system. 混音处理后在多路范围内无失真现象,而且音频效果良好,能够满足系统的音频通信要求。 After the mixing process non-multiplexed within the range of distortion, and good audio effects, to meet the system requirements of audio communication.

附图说明 BRIEF DESCRIPTION

[0017] 图1为本发明终端设备采集音频数据流到服务器的流程。 [0017] FIG capture audio data stream to a terminal server process equipment of the present invention.

[0018] 图2为本发明服务器接受到网络音频数据流后与服务器本身音频数据流后的具体处理流程。 [0018] FIG. 2 is received after a specific processing flow of the server itself and the audio stream stream data network audio server of the present invention.

[0019] 图3为本发明服务器进行具体混音算法的实现流程。 [0019] FIG. 3 process to achieve particular mixing algorithm of the present invention the server. 具体实施方式 detailed description

[0020] 下面根据附图对本专利做进一步的说明 [0020] The following drawings further illustrate the present patent

如图1所示,从设备终端采集音频数据流并对数据流进行编码,通过网络将流媒体数据传输给服务器,当服务器接收到终端设备的音频信号后,先对接收到的音频数据流进行解码,并交给相关的处理模块进行处理。 1, the audio data collected from the terminal device and the data stream is encoded stream via a network streaming media data to the server, when the server receives the audio signal to the terminal device, the received first audio stream decoding, and to the relevant processing module for processing.

[0021] 图2所示,则是对图1处理的具体描述。 [0021] As shown in FIG. 2, a detailed description of the process of FIG. 在原有的采集到的终端设备音频数据流的基础上对服务器本地的音频数据流进行采集,然后对音频数据流进行过滤,主要是过滤掉目的地自己的音频数据,比如混音后的数据流是要转发给终端设备A的,则要把A传过来的音频数据给过滤,只保留B,C,以及服务器本地采集到的音频数据;如果要在服务器上进行播放,则要保留A,B, C的终端设备的音频数据,而服务器本地采集到的音频数据需要过滤掉。 Be based on the terminal apparatus the original audio data stream to a collection of local servers capture audio data stream, the audio data stream is then filtered, mainly to filter out their destination audio data, such as data streams mix is to be forwarded to the terminal apparatus a, then a should pass over the audio data to the filter, leaving only B, C, and the local server to collect audio data; If you want to play on the server, will have to retain a, B , the audio data C of the terminal device, the server locally collected audio data needs to be filtered out. 图3为音频数据过滤后的混音处理实施过程,其实施步骤如下: FIG 3 is a mixing treatment in the audio data after the filtering process, its implementation steps are as follows:

a)系统计算当前混音处理模块需要处理的当前的混音通道有多少路。 a) mixing the processing system calculates a current block to be processed of the current path of the mixer channel number.

[0022] b)设定好音频的变化因子的初始值f = 1,并开始取每个混音通道内的一帧音频数据进行线性叠加操作。 [0022] b) Factor audio set up the initial value of f = 1, and starts taking a mix of audio data in each channel linear superposition operation.

[0023] c)对叠加后的混音值与变化因子进行相乘计算得出相乘后的混音大小。 [0023] c) change the mix factor value calculated by multiplying the superimposed mix after multiplying the size.

[0024] d)对步骤(C)计算出来的混音数据流大小进行判断,如果大小超出预设的最大值和最小值,则通过调节变化因子的步长来获取满足在预设范围值内的变化因子大小。 [0024] d) to step (C) calculated from the data stream size mix judgment, if the size exceeds a preset maximum and minimum values ​​satisfy the acquired within a predetermined range by adjusting the step size change factors changes in the size factor.

[0025] e)将满足步骤(d)得出的混音数据流大小作为输出的混音数据f)将满足步骤(e)的变化因子作为初始的变化因子大小并开始进行下一帧的音频数据进行处理。 [0025] e) satisfying the step (d) obtained as the size of data stream mixer mixes the output data f) satisfying in step (e) is the initial change factors as changes in the size factor and the next frame begins audio data processing.

[0026] 当混音处理过程结束后,则要对混音的数据进行处理,如果目的地是服务器本身, 则只需将混音后的数据直接在服务器本地进行播放。 [0026] When the end of the mixing process, the mix will have the data are processed, if the destination is the server itself, then the data is simply played directly mix in the local server. 如果需要转发给终端设备,节省网络带宽,要在转发前对混音的数据进行音频编码(主要采用G. 723编码),最后通过网络转发给相应的终端设备,当终端设备接收到音频信号后,进行相关的解码播放操作。 If to be forwarded to the terminal device, to save network bandwidth, to encode the audio mix data before forwarding (mainly coding G. 723), and finally forwarded through the network to the corresponding terminal device, the terminal device receives the audio signal when , the associated decode and play operation.

[0027] 以上所述,描述了多点移动音频通信指挥系统的整个通信过程,并对混音处理过程做了具体详细的描述。 [0027] The above, describes a multi-point communication process a mobile audio command system, and to do a specific mixing process is described in detail. 由描述所知,该混音处理过程不仅仅适用于多点移动音频通信指挥系统,同样可以适用于多媒体网络视频会议系统中。 Known from the description, the mixing process applies not only to multi-point communication a mobile audio command system, multimedia network equally applicable to video conferencing systems. 混音处理后在多路范围内无失真现象,而且音频效果良好,能够满足系统的音频通信要求。 After the mixing process non-multiplexed within the range of distortion, and good audio effects, to meet the system requirements of audio communication.

[0028] 任何熟悉该技术的人在本发明所揭露的技术范围内,可轻易想到的变化或替换, 都应涵盖在本发明的保护范围之内。 [0028] Any person skilled in the art within the technical scope of the present invention is disclosed, variations or substitutions readily occur, shall fall within the protection scope of the present invention.

Claims (6)

1. 一种应用于多点移动音频通信系统的混音方法,其特征在于:接收来自网络终端设备的音频数据流并进行解码;对服务器本地的音频数据流进行采集;消除目的地自己的音频数据;将接收到的网络音频数据流与服务器本地的音频数据流进行混音操作;1. 5系统计算当前混音处理模块需要处理的当前混音通道有多少路;设定好音频变化因子的初始值,并开始取每个混音通道内的一帧音频数据进行线性叠加操作;对叠加后的混音值与变化因子进行相乘计算得出相乘后的混音大小;对步骤(b)计算出来的混音大小进行判断,如果大小超出预设的最大值和最小值,则通过调节变化因子的步长来获取满足在预设范围值内的变化因子大小;将满足步骤(c)得出的混音值作为输出的混音数据;将满足步骤(d)的变化因子作为初始的变化因子大小并开始进行下一帧的 1. A method of mixing is applied to a mobile audio multi-point communication system, wherein: receiving audio data stream from the network terminal device and decoding; local servers audio data stream collected; their elimination destination audio transactions; the received audio data stream and a network server of the local audio data stream mixing operation;. the system 15 calculates the current channel mixer processing module needs this mixing process the number of paths; set up the audio factor an initial value, and starts taking a mix of audio data in each channel linear superposition operation; the mix value and the change in the superimposed factor calculated by multiplying the size of the multiplied mix; step (b ) calculated mix size judgment, if the size exceeds a preset maximum value and the minimum value, is acquired by the change factor adjustment step size satisfies the change factor value within a preset range; satisfying the step (c) mix mix obtained value as the output data; satisfying step (d) is the initial change factors as changes in the size factor and begin the next frame 音频数据进行处理;f)将满足(e)中的输出的音频数据流进行后期处理,如果目的地是服务器本身,则直接进行播放,如果是要转发给终端设备,则进行编码再转发。 The audio data is processed; F) satisfies the audio data stream (e) in the post-processing output, if the destination is the server itself, the player directly, if it is to be forwarded to the terminal device, is coded and then transmitted.
2.根据权利1所述的一种应用于多点移动音频通信系统的混音方法,其特征在于实现了网络音频数据流和服务器本地音频数据流的同时采集。 2. The applied multi-point audio mixing method in a mobile communication system according to claim 1, characterized in that while the network implements audio data streams and audio data streams local server collection.
3.根据权利1所述的一种应用于多点移动音频通信系统的混音方法,其特征在于语音信号的混合采用了线性叠加方式。 According to claim 1 is applied to one of said multi-point method of mixing audio mobile communication system, wherein the mixed voice signal using a linear superposition manner.
4.根据权利1所述的一种应用于多点移动音频通信系统的混音方法,其特征在于在混音处理过程中消除了目的地自己的音频数据。 4. According to an applied multi-point audio mixing method in a mobile communication system according to claim 1, characterized in that the elimination of audio data in their destination mixing process.
5.根据权利1所述的一种应用于多点移动音频通信系统的混音方法,其特征在于混音处理过程都是在服务器端即后台中心完成的,然后由服务器端转发给各个移动终端设备。 5. According to an applied multi-point audio mixing method in a mobile communication system according to claim 1, characterized in that the mixing process is completed i.e., the center of the background on the server side, and then is forwarded to the mobile terminal by the server equipment.
6.根据权利1所述的一种应用于多点移动音频通信系统的混音方法,其特征在于动态平滑的控制,音频信号变化没有跳跃现象,无噪音出现。 6. According to an applied multi-point audio mixing method in a mobile communication system according to claim 1, characterized in that the dynamic smooth control, jumping phenomenon does not change the audio signal, no noise occurs.
CN 201110445435 2011-12-28 2011-12-28 Audio mixing method applied to multi-point mobile audio communication system CN102543087A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN 201110445435 CN102543087A (en) 2011-12-28 2011-12-28 Audio mixing method applied to multi-point mobile audio communication system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN 201110445435 CN102543087A (en) 2011-12-28 2011-12-28 Audio mixing method applied to multi-point mobile audio communication system

Publications (1)

Publication Number Publication Date
CN102543087A true true CN102543087A (en) 2012-07-04

Family

ID=46349825

Family Applications (1)

Application Number Title Priority Date Filing Date
CN 201110445435 CN102543087A (en) 2011-12-28 2011-12-28 Audio mixing method applied to multi-point mobile audio communication system

Country Status (1)

Country Link
CN (1) CN102543087A (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102968995A (en) * 2012-11-16 2013-03-13 新奥特(北京)视频技术有限公司 Sound mixing method and device of audio signal
CN103021419A (en) * 2012-12-26 2013-04-03 大唐移动通信设备有限公司 Processing method and device for mixed audio
CN103067221A (en) * 2012-12-24 2013-04-24 广东威创视讯科技股份有限公司 Voice-frequency telephony testing system

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1805006A (en) * 2006-01-24 2006-07-19 北京邮电大学 Quick and real-time sound mixing method for multimedia conference
CN101674450A (en) * 2008-09-10 2010-03-17 深圳市邦彦信息技术有限公司 Sound mixing method in video directing and scheduling system
CN102005206A (en) * 2010-11-16 2011-04-06 上海华平信息技术股份有限公司 Audio mixing method of multiple-channel audio frequency
US20110150200A1 (en) * 2009-12-23 2011-06-23 Sun Microsystems, Inc. Web guided collaborative audio
US20110161836A1 (en) * 2009-12-31 2011-06-30 Ruicao Mu System for processing and synchronizing large scale video conferencing and document sharing

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1805006A (en) * 2006-01-24 2006-07-19 北京邮电大学 Quick and real-time sound mixing method for multimedia conference
CN101674450A (en) * 2008-09-10 2010-03-17 深圳市邦彦信息技术有限公司 Sound mixing method in video directing and scheduling system
US20110150200A1 (en) * 2009-12-23 2011-06-23 Sun Microsystems, Inc. Web guided collaborative audio
US20110161836A1 (en) * 2009-12-31 2011-06-30 Ruicao Mu System for processing and synchronizing large scale video conferencing and document sharing
CN102005206A (en) * 2010-11-16 2011-04-06 上海华平信息技术股份有限公司 Audio mixing method of multiple-channel audio frequency

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102968995A (en) * 2012-11-16 2013-03-13 新奥特(北京)视频技术有限公司 Sound mixing method and device of audio signal
CN102968995B (en) * 2012-11-16 2018-10-02 新奥特(北京)视频技术有限公司 A method and apparatus for mixing audio signals
CN103067221A (en) * 2012-12-24 2013-04-24 广东威创视讯科技股份有限公司 Voice-frequency telephony testing system
CN103067221B (en) * 2012-12-24 2016-08-03 广东威创视讯科技股份有限公司 An audio call test system
CN103021419A (en) * 2012-12-26 2013-04-03 大唐移动通信设备有限公司 Processing method and device for mixed audio

Similar Documents

Publication Publication Date Title
US20060245379A1 (en) Multi-participant conference adjustments
US20090086013A1 (en) Individual Adjustment of Audio and Video Properties in Network Conferencing
US6317776B1 (en) Method and apparatus for automatic chat room source selection based on filtered audio input amplitude of associated data streams
US7899170B2 (en) Multi-participant conference setup
US6269483B1 (en) Method and apparatus for using audio level to make a multimedia conference dormant
US20090326960A1 (en) Encoding and decoding of audio objects
US6463414B1 (en) Conference bridge processing of speech in a packet network environment
US20050237377A1 (en) Audio data control
US20020123895A1 (en) Control unit for multipoint multimedia/audio conference
US20080232353A1 (en) Method of transmitting data in a communication system
Allamanche et al. MPEG-4 low delay audio coding based on the AAC codec
US20070127671A1 (en) System and method for audio multicast
CN1668109A (en) Adaptive video transcoding gateway having multiple transforming functions
US20060227870A1 (en) Context-adaptive bandwidth adjustment in video rate control
US20110196682A1 (en) Common Scene Based Conference System
WO2006116750A2 (en) Multi-participant conferencing
CN101309390A (en) Visual communication system, apparatus and subtitle displaying method
US20110137660A1 (en) Encoding and decoding speech signals
CN101009824A (en) A network transfer method for audio/video data
WO2009001292A1 (en) A method of merging at least two input object-oriented audio parameter streams into an output object-oriented audio parameter stream
CN101123571A (en) Adjustment method for scheduling policy based on self-adapted jitter buffer
CN102025970A (en) Method and system for automatically adjusting display mode of video conference
CN101751926A (en) Signal coding and decoding method and device, and coding and decoding system
US20110187814A1 (en) Automatic Audio Priority Designation During Conference
US7460671B1 (en) Encryption processing apparatus and method for voice over packet networks

Legal Events

Date Code Title Description
C06 Publication
C10 Entry into substantive examination
C05 Deemed withdrawal (patent law before 1993)