CN106534762A - Low-time-delay distributed audio processing method and system - Google Patents
Low-time-delay distributed audio processing method and system Download PDFInfo
- Publication number
- CN106534762A CN106534762A CN201611009743.0A CN201611009743A CN106534762A CN 106534762 A CN106534762 A CN 106534762A CN 201611009743 A CN201611009743 A CN 201611009743A CN 106534762 A CN106534762 A CN 106534762A
- Authority
- CN
- China
- Prior art keywords
- audio
- audio signal
- processor
- data
- local
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000003672 processing method Methods 0.000 title claims abstract description 12
- 230000005236 sound signal Effects 0.000 claims abstract description 116
- 238000012545 processing Methods 0.000 claims abstract description 60
- 238000000034 method Methods 0.000 claims abstract description 44
- 230000000694 effects Effects 0.000 claims abstract description 17
- 241001269238 Data Species 0.000 claims 1
- 230000001629 suppression Effects 0.000 description 7
- 230000005540 biological transmission Effects 0.000 description 6
- 230000008901 benefit Effects 0.000 description 4
- 238000005516 engineering process Methods 0.000 description 3
- 230000011664 signaling Effects 0.000 description 2
- 238000004364 calculation method Methods 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 150000001875 compounds Chemical class 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- UJKWLAZYSLJTKA-UHFFFAOYSA-N edma Chemical compound O1CCOC2=CC(CC(C)NC)=CC=C21 UJKWLAZYSLJTKA-UHFFFAOYSA-N 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 238000002360 preparation method Methods 0.000 description 1
- 238000012827 research and development Methods 0.000 description 1
- 239000011435 rock Substances 0.000 description 1
- 230000001360 synchronised effect Effects 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/14—Systems for two-way working
- H04N7/15—Conference systems
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
- G10L19/008—Multichannel audio signal coding or decoding using interchannel correlation to reduce redundancy, e.g. joint-stereo, intensity-coding or matrixing
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L21/00—Speech or voice signal processing techniques to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
- G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
- G10L21/0208—Noise filtering
Landscapes
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Multimedia (AREA)
- Physics & Mathematics (AREA)
- Computational Linguistics (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Human Computer Interaction (AREA)
- Acoustics & Sound (AREA)
- Mathematical Physics (AREA)
- Quality & Reliability (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- Telephonic Communication Services (AREA)
Abstract
The invention discloses a low-time-delay distributed audio processing method and system. The method comprises the following steps that any one of two processors serves a main processor, the other serves as an auxiliary processor; audio signals transmitted via an FPGA are received; in the main processor, far-end audio signals in the audio signals are decoded to obtain decoded audio data, and sound effect processing is carried out on the decoded audio data to generate first audio data, and in the auxiliary processor, audio processing is carried out on local audio signals in the audio signals to generate second audio data; first and second audio processing data is transmitted to the FPGA for audio mixing, and the FPGA issues the mixed first and second audio processing data. The method and system can reduced time delay of audio processing, the system stability is improved, and better using experience is provided for users.
Description
Technical field
The present invention relates to a kind of technical field of video communication, more particularly to a kind of low delay distributed audio processing method and
System.
Background technology
With the development of multimedia technology, the raising of national economy level, professional video conference system not only should in tradition
Use in great demand, also in long-distance education, the industry such as digital court generates new demand, and professional video conference terminal is also had
Higher requirement, audio frequency and video disposal ability of the user desirable to provide more multichannel meet the various different application scenes of user.
Simultaneously as video conferencing system belongs to the application of strong interactivity, the quality of multi-media processing is most important to Consumer's Experience
's.To continuous data streams such as audio frequency and video, the real-time of transmission is not required nothing more than, will also ensure that good voice quality and video are clear
Degree, the synchronization also ensured by audio frequency and video.Video conferencing system in reality, it is ensured that the using effect of product, relative video
For, the process of audio frequency is particularly critical.
As video conference sound intermediate frequency application scenarios are relative complex, distal end, local sound are sent comprising local acoustic coding
Local to play, by player plays distal end sound, local broadcasting etc. after distal end sound and local sound audio mixing uses scene, is
Ensure audio frequency effect needs Audio Processing to be carried out by audio algorithm, including：Echo cancelltion, background noise suppress, suppression of uttering long and high-pitched sounds
System, automatic gain compensation etc..Traditional separate unit video conference terminal carries out MCVF multichannel voice frequency algorithm process using a processor,
But increase to tens tunnels as audio frequency accesses way, the different of also various audio algorithm disposal abilities require that a cpu is
Audio frequency and other business cannot being processed simultaneously, but needing same video conference terminal, inside there are multiple processors to be assisted
Same operation, shares the cpu performance requirements of Audio Processing, and then reduces audio delay, provides the user more preferable effect experience.
And how work compound is carried out using multiple processors, so that the effect of Video processing more preferably, becomes this programme to be solved
Technical problem.
The content of the invention
To solve an above-mentioned at least technical problem, the main object of the present invention is to provide at a kind of low delay distributed audio
Reason method and device.
For achieving the above object, one aspect of the present invention is：There is provided at a kind of low delay distributed audio
Reason method, comprises the steps：
From two processors, specify any one processor as primary processor, another processor is used as from processor；
The audio signal of Jing FPGA conveyings is received, the audio signal is according to including far-end audio signal and local audio letter
Number；
On the host processor, decoding process is carried out to the far-end audio signal in audio signal and obtains decoding audio data,
And audio effect processing is carried out to decoding audio data generate the first voice data, and from processor, in audio signal
Local audio signal carries out Audio Processing and generates second audio data；
First Audio Processing data and the second Audio Processing data are sent to FPGA carries out stereo process, and by FPGA pair
The first Audio Processing data and the second Audio Processing data of stereo process are distributed.
Preferably, it is described to specify any one processor as primary processor from two processors, another processor as from
After the step of processor, also include：
Synchronizing clock signals are provided for primary processor and from processor.
Preferably, it is described decoding audio data is carried out audio effect processing generate the first voice data the step of, specifically include：
Carry out automatic audio mixing, automatic gain, echo cancelltion and noise suppressed to process to decoding audio data, generate the first sound
Frequency evidence.
Preferably, the local audio signal in audio signal carries out the step that Audio Processing generates second audio data
Suddenly, specifically include：
Local audio signal in voice data is carried out at automatic audio mixing, automatic gain, whistle suppression and noise suppressed
Reason, generates second audio data.
Preferably, on the host processor, also include carrying out local audio signal coded treatment, and by the sheet of coded treatment
Ground audio signal is sent to FPGA, and is distributed to distal end by FPGA.
For achieving the above object, another technical solution used in the present invention is：A kind of low delay distributed audio is provided
Processing system, including：
An at least AD/DA chipsets, AD/DA chips described in a group include AD/DA chip of the two panels in daisy chain connection, use
To gather audio signal, and first audio signal and the second audio signal of the weighted stereo process of broadcasting, the audio frequency letter
Number include far-end audio signal, local audio signal；
FPGA device, the FPGA device are electrically connected with AD/DA chipsets, to receive and forward audio signal, and
First audio signal and the second audio signal are weighted by stereo process and are distributed；
Primary processor, the primary processor are electrically connected with FPGA device, to the far-end audio signal in audio signal
Carry out decoding process and obtain decoding audio data, and carry out decoding audio data audio effect processing generating the first voice data and passing
Deliver to FPGA device；
It is from processor, described to electrically connect from processor with FPGA device, to the local audio signal in audio signal
Carry out Audio Processing to generate second audio data and be sent to FPGA device.
Preferably, the low delay distributed audio processing system also includes audio sync clock, to for primary processor
And synchronizing clock signals are provided from processor.
Preferably, the master server, is solved to carry out decoding process to the far-end audio signal in audio signal
Code voice data, and audio effect processing is carried out to decoding audio data, generate the first voice data and be sent to FPGA device.
Preferably, it is described from server, automatic audio mixing is carried out to the local audio signal in voice data, is increased automatically
Benefit, whistle suppress and noise suppressed is processed, and generate second audio data and are sent to FPGA device.
Preferably, the master server, also to carry out coded treatment to local audio signal, and by the sheet of coded treatment
Ground audio signal is sent to FPGA device, and is distributed to distal end by FPGA device.
Technical scheme processes far-end audio signal and local audio letter respectively by using two processors
Number, specifically, it is primary processor to specify a processor from two processors, and another processor is the primary processor from processor
Being responsible for carrying out remote signaling carries out audio decoder, and the voice data of decoding carries out echo cancelltion, background noise and suppresses, automatically
Gain control and automatic audio mixing are processed and generate the first voice data, should be responsible for carrying out noise to local audio signal from processor
Suppression, chauvent's criterion, automatic growth control and automatic audio mixing are processed and generate second audio data, by FPGA to the first audio frequency number
According to and the audio mixing of second audio data after distribute, thus, cpu is taken full advantage of in the distribution of principal and subordinate cpu by audio task
Can, Audio Processing time delay is reduced, system stability is improve, more preferable experience is presented to user.
Description of the drawings
In order to be illustrated more clearly that the embodiment of the present invention or technical scheme of the prior art, below will be to embodiment or existing
Accompanying drawing to be used needed for having technology description is briefly described, it should be apparent that, drawings in the following description are only this
Some embodiments of invention, for those of ordinary skill in the art, on the premise of not paying creative work, can be with
Structure according to these accompanying drawings obtains other accompanying drawings.
Schematic flow sheets of the Fig. 1 for one embodiment of the invention low delay distributed audio processing method；
Block diagrams of the Fig. 2 for one embodiment of the invention low delay distributed audio processing system.
The realization of the object of the invention, functional characteristics and advantage will be described further in conjunction with the embodiments referring to the drawings.
Specific embodiment
Below in conjunction with the accompanying drawing in the embodiment of the present invention, the technical scheme in the embodiment of the present invention is carried out clear, complete
Site preparation is described, it is clear that described embodiment a part of embodiment only of the invention, rather than the embodiment of whole.Base
Embodiment in the present invention, those of ordinary skill in the art obtained under the premise of creative work is not made it is all its
His embodiment, belongs to the scope of protection of the invention.
It is to be appreciated that the description for being related to " first ", " second " etc. in the present invention be only used for describe purpose, and it is not intended that
Indicate or imply its relative importance or the implicit quantity for indicating indicated technical characteristic.Thus, define " first ",
At least one this feature can be expressed or be implicitly included to the feature of " second ".In addition, the technical side between each embodiment
Case can be combined with each other, but must can be implemented as basis with those of ordinary skill in the art, when the combination of technical scheme
Will be understood that the combination of this technical scheme is not present when appearance is conflicting or cannot realize, also not in the guarantor of application claims
Within the scope of shield.
In being different from prior art, traditional separate unit video conference terminal carries out MCVF multichannel voice frequency calculation using a processor
Method process, but increase to tens tunnels as audio frequency accesses way, the different of also various audio algorithm disposal abilities require, one
Cpu cannot process audio frequency and other traffic issues simultaneously, and this programme completes remote audio using at least two processors
The process of signal and local audio signal, specific method and device refer to following embodiments.
Fig. 1 is refer to, in embodiments of the present invention, the low delay distributed audio processing method comprises the steps：
Step S10, from two processors specify any one processor as primary processor, another processor is used as from
Reason device；
Step S20, the audio signal for receiving Jing FPGA conveyings, the audio signal evidence is including far-end audio signal and locally
Audio signal；
Step S30, on the host processor, carries out decoding process and obtains decoding sound to the far-end audio signal in audio signal
Frequency evidence, and audio effect processing the first voice data of generation is carried out to decoding audio data, and from processor, audio frequency is believed
Local audio signal in number carries out Audio Processing and generates second audio data；
Step S40, the first Audio Processing data and the second Audio Processing data are sent to into FPGA carry out stereo process, and
The first Audio Processing data and the second Audio Processing data of stereo process are distributed by FPGA.
In the present embodiment, far-end audio signal can be processed by primary processor, by processing locally from processor
Audio signal, thus, by far-end audio signal and local audio signal are separately processed, each processor can be made full use of
Performance, it is to avoid monolithic CPU processes echo cancelltion simultaneously and chauvent's criterion can not run or occur latency issue, improve
System stability, is presented more preferable experience to user.The FPGA is weighted stereo process, and the weight of stereo process can
According to actual requirement flexible configuration.In audio signal transmission, the method carries out voice data using time-multiplexed mode
Transmission, each data link support that 16 passages, 4 data link support the output of 64 channel audio data inputs.
Technical scheme processes far-end audio signal and local audio letter respectively by using two processors
Number, specifically, it is primary processor to specify a processor from two processors, and another processor is the primary processor from processor
Being responsible for carrying out remote signaling carries out audio decoder, and the voice data of decoding carries out echo cancelltion, background noise and suppresses, automatically
Gain control and automatic audio mixing are processed and generate the first voice data, should be responsible for carrying out noise to local audio signal from processor
Suppression, chauvent's criterion, automatic growth control and automatic audio mixing are processed and generate second audio data, by FPGA to the first audio frequency number
According to and the audio mixing of second audio data after distribute, thus, cpu is taken full advantage of in the distribution of principal and subordinate cpu by audio task
Can, Audio Processing time delay is reduced, system stability is improve, more preferable experience is presented to user.
It is in a specific embodiment, described to specify any one processor as primary processor from two processors, it is another
Processor as from processor the step of S10 after, also include：
Synchronizing clock signals are provided for primary processor and from processor.
To ensure the clock synchronization between different chips, in the present embodiment, it is both needed to for primary processor and from processor provide
Clock sync signal, the clock sync signal make primary processor and from processor synchronization.
It is in a specific embodiment, described that the step that audio effect processing generates the first voice data is carried out to decoding audio data
Suddenly, specifically include：
Carry out automatic audio mixing, automatic gain, echo cancelltion and noise suppressed to process to decoding audio data, generate the first sound
Frequency evidence.
In the present embodiment, when primary processor receives far-end audio signal, decoding process is carried out to far-end audio signal first,
Decoding audio data is obtained, then through automatic audio mixing, automatic growth control, echo cancelltion being carried out to decoding audio data and being made an uproar
Sound suppresses, and obtains the first voice data, thus, the service behaviour of primary processor can be made full use of.
Further, the local audio signal in audio signal carries out Audio Processing and generates second audio data
Step, specifically includes：
Local audio signal in voice data is carried out at automatic audio mixing, automatic gain, whistle suppression and noise suppressed
Reason, generates second audio data.
In the present embodiment, when receiving local audio signal from processor, local audio signal is carried out automatic audio mixing, from
Dynamic gain control, echo cancelltion and noise suppressed, obtain second audio data, thus, the work from processor can be made full use of
Make performance.
By the comparison of two above-mentioned embodiments, it is known that distinctive points are：Using primary processor to far-end audio signal
Echo cancelltion process is carried out, whistle suppression is carried out to local frequency signal using from processor, same luck on a CPU can be avoided
The latency issue that row whistle suppresses and echo cancelltion occurs, so as to primary processor and make full use of respective performance from processor.
In a specific embodiment, on the host processor, also include carrying out local audio signal coded treatment, and will
The local audio signal of coded treatment is sent to FPGA, and is distributed to distal end by FPGA.Compiled by local audio signal
Code, can be by the transmission of local audio signal.
Fig. 2 is refer to, in embodiments of the invention, the low delay distributed audio processing system, including：
An at least AD/DA chipsets 10, AD/DA chips described in a group include AD/DA chip of the two panels in daisy chain connection,
To gather audio signal, and first audio signal and the second audio signal of the weighted stereo process of broadcasting, the audio frequency
Signal includes far-end audio signal, local audio signal；
FPGA device 20, the FPGA device 20 are electrically connected with AD/DA chipsets 10, to receive and forward audio frequency to believe
Number, and the first audio signal and the second audio signal are weighted by stereo process and are distributed；
Primary processor 30, the primary processor 30 are electrically connected with FPGA device 20, to the distal end sound in audio signal
Frequency signal carries out decoding process and obtains decoding audio data, and audio effect processing the first audio frequency number of generation is carried out to decoding audio data
According to and be sent to FPGA device 20；
It is from processor 40, described to electrically connect from processor 40 with FPGA device 20, to this rock noise in audio signal
Frequency signal carries out Audio Processing and generates second audio data and be sent to FPGA device 20.
In the present embodiment, using the ti8168 of ti companies as processor, it is a multichannel high definition soc systems to the system
System chip, wherein be integrated with the C674x DSP cores of lGHz dominant frequency, in same station terminal, our 2 ti8168 chips of having arranged in pairs or groups come
Parallel Audio Processing is carried out, is described for convenience, be referred to as main 8168, main DSP (primary processor 30), from 8168, from DSP
(from processor 40).Audio algorithm is just operated on principal and subordinate DSP.Based on the powerful Audio Processing ability of ti8168 chips and system
The implementation of the multiprocessor cooperative cooperating of design so that product can provide good experience for client completely.
During audio signal transmission, the system carries out voice data transmission using time-multiplexed mode, and each data link supports 16 to lead to
The output of 64 channel audio data inputs is supported in road, 4 data link.To ensure data interaction low delay, the system adopts EDMA
Fast data exchange carries out the transmitting-receiving of audio signal.In addition, the system has more preferable expansion to Audio Processing, due to main place
Manage device 30 and from processor 40, there are 3 audio frequency to pick out interface, each audio frequency picks out interface there are multiple transmitting-receivings logical again
Road, easily carries out the research and development of audio extension plate.
In a specific embodiment, the low delay distributed audio processing system also includes audio sync clock, uses
With as primary processor 30 and from the offer synchronizing clock signals of processor 40.
In the present embodiment, the audio sync clock also includes providing clock sync signal for polylith AD/DA chips, so that not
The synchronous working of same chip.
In a specific embodiment, the master server, to solve to the far-end audio signal in audio signal
Code is processed and obtains decoding audio data, and audio effect processing is carried out to decoding audio data, is generated the first voice data and is sent to
FPGA device 20.
In the present embodiment, when primary processor 30 receives far-end audio signal, first far-end audio signal is carried out at decoding
Reason, obtains decoding audio data, then through carrying out automatic audio mixing, automatic growth control, echo cancelltion to decoding audio data
And noise suppressed, the first voice data is obtained, thus, the service behaviour of primary processor 30 can be made full use of.
Further, it is described from server, automatic audio mixing, automatically is carried out to the local audio signal in voice data
Gain, whistle suppress and noise suppressed is processed, and generate second audio data and are sent to FPGA device 20.
In the present embodiment, when receiving local audio signal from processor 40, local audio signal is carried out automatic audio mixing,
Automatic growth control, echo cancelltion and noise suppressed, obtain second audio data, thus, can make full use of from processor 40
Service behaviour.
By the comparison of two above-mentioned embodiments, it is known that distinctive points are：Far-end audio is believed using primary processor 30
Number echo cancelltion process is carried out, whistle suppression is carried out using from 40 pairs of local frequency signals of processor, can avoid same on a CPU
The latency issue that Shi Yunhang whistles suppress and echo cancelltion occurs, so as to primary processor 30 and make full use of each from processor 40
Performance.
In a specific embodiment, the master server 30, also coded treatment is carried out to local audio signal, and
The local audio signal of coded treatment is sent to into FPGA device 20, and distal end is distributed to by FPGA device 20.By local
Coding audio signal, being capable of transmitting local audio signal to distal end.
The preferred embodiments of the present invention are the foregoing is only, the scope of the claims of the present invention is not thereby limited, it is every at this
Under the inventive concept of invention, the equivalent structure transformation made using description of the invention and accompanying drawing content, or directly/use indirectly
It is included in the scope of patent protection of the present invention in other related technical fields.
Claims (10)
1. a kind of low delay distributed audio processing method, it is characterised in that the low delay distributed audio processing method bag
Include following steps：
From two processors, specify any one processor as primary processor, another processor is used as from processor；
The audio signal of Jing FPGA conveyings is received, the audio signal is according to including far-end audio signal and local audio signal；
On the host processor, decoding process is carried out to the far-end audio signal in audio signal and obtains decoding audio data, and it is right
Decoding audio data carries out audio effect processing and generates the first voice data, and from processor, to audio signal in it is local
Audio signal carries out Audio Processing and generates second audio data；
First Audio Processing data and the second Audio Processing data are sent to FPGA carries out stereo process, and by FPGA to audio mixing
The the first Audio Processing data and the second Audio Processing data for processing are distributed.
2. low delay distributed audio processing method as claimed in claim 1, it is characterised in that described to refer to from two processors
Fixed any one processor as primary processor, another processor as from processor the step of after, also include：
Synchronizing clock signals are provided for primary processor and from processor.
3. low delay distributed audio processing method as claimed in claim 1, it is characterised in that described to decoding audio data
The step of carrying out audio effect processing the first voice data of generation, specifically includes：
Carry out automatic audio mixing, automatic gain, echo cancelltion and noise suppressed to process to decoding audio data, generate the first audio frequency number
According to.
4. low delay distributed audio processing method as claimed in claim 3, it is characterised in that described in audio signal
The step of local audio signal carries out Audio Processing generation second audio data, specifically includes：
Carry out automatic audio mixing, automatic gain, whistle to suppress and noise suppressed process to the local audio signal in voice data, it is raw
Into second audio data.
5. low delay distributed audio processing method as claimed in claim 1, it is characterised in that on the host processor, also wrap
Include carries out coded treatment to local audio signal, and the local audio signal of coded treatment is sent to FPGA, and passes through FPGA
It is distributed to distal end.
6. a kind of low delay distributed audio processing system, it is characterised in that the low delay distributed audio processing system bag
Include：
An at least AD/DA chipsets, AD/DA chips described in a group include AD/DA chip of the two panels in daisy chain connection, to adopt
Collection audio signal, and play first audio signal and the second audio signal of weighted stereo process, the audio signal bags
Include far-end audio signal, local audio signal；
FPGA device, the FPGA device are electrically connected with AD/DA chipsets, to receive and forward audio signal, and to
One audio signal and the second audio signal are weighted stereo process and distribute；
Primary processor, the primary processor are electrically connected with FPGA device, to carry out to the far-end audio signal in audio signal
Decoding process obtains decoding audio data, and audio effect processing the first voice data of generation is carried out to decoding audio data and is sent to
FPGA device；
It is from processor, described to electrically connect from processor with FPGA device, to carry out to the local audio signal in audio signal
Audio Processing generates second audio data and is sent to FPGA device.
7. low delay distributed audio processing system as claimed in claim 6, it is characterised in that the low delay distributed tones
Frequency processing system also includes audio sync clock, to provide synchronizing clock signals for primary processor and from processor.
8. low delay distributed audio processing system as claimed in claim 6, it is characterised in that the master server, to
Decoding process is carried out to the far-end audio signal in audio signal and obtains decoding audio data, and sound is carried out to decoding audio data
Effect process, generates the first voice data and is sent to FPGA device.
9. low delay distributed audio processing system as claimed in claim 8, it is characterised in that described from server, to
Carry out to the local audio signal in voice data that automatic audio mixing, automatic gain, whistle suppress and noise suppressed is processed, generate the
Two voice datas are simultaneously sent to FPGA device.
10. low delay distributed audio processing system as claimed in claim 6, it is characterised in that the master server, also uses
So that coded treatment is carried out to local audio signal, and the local audio signal of coded treatment is sent to into FPGA device, and is passed through
FPGA device is distributed to distal end.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611009743.0A CN106534762B (en) | 2016-11-16 | 2016-11-16 | low-delay distributed audio processing method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201611009743.0A CN106534762B (en) | 2016-11-16 | 2016-11-16 | low-delay distributed audio processing method and system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN106534762A true CN106534762A (en) | 2017-03-22 |
| CN106534762B CN106534762B (en) | 2019-12-13 |
Family
ID=58353390
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201611009743.0A Active CN106534762B (en) | 2016-11-16 | 2016-11-16 | low-delay distributed audio processing method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN106534762B (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109003620A (en) * | 2018-05-24 | 2018-12-14 | 北京潘达互娱科技有限公司 | A kind of echo removing method, device, electronic equipment and storage medium |
| CN110070878A (en) * | 2019-03-26 | 2019-07-30 | 苏州科达科技股份有限公司 | The coding/decoding method and electronic equipment of audio code stream |
| CN110265050A (en) * | 2019-05-29 | 2019-09-20 | 广州小鹏汽车科技有限公司 | AEC audio control system and its clock machinery of consultation |
| CN110634485A (en) * | 2019-10-16 | 2019-12-31 | 声耕智能科技(西安)研究院有限公司 | Voice interaction service processor and processing method |
| WO2020048423A1 (en) * | 2018-09-06 | 2020-03-12 | 深圳市东微智能科技股份有限公司 | Audio processing method, terminal, and computer-readable storage medium |
| CN111726669A (en) * | 2019-03-18 | 2020-09-29 | 浙江宇视科技有限公司 | Distributed decoding equipment and audio and video synchronization method thereof |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1443006A (en) * | 2003-01-16 | 2003-09-17 | 浙江南望图像信息产业有限公司 | Mixed sound system of intelligent controlled video frequency conference and method of controlling conference course |
| CN101192407A (en) * | 2006-11-30 | 2008-06-04 | 索尼株式会社 | Regeneration method and apparatus, program and recording medium |
| CN202127439U (en) * | 2011-03-15 | 2012-01-25 | 华为终端有限公司 | Hand-free circuit and terminal |
| CN102348097A (en) * | 2010-08-02 | 2012-02-08 | 杭州华三通信技术有限公司 | Session method and multi-point control unit for video conference |
| WO2012046256A2 (en) * | 2010-10-08 | 2012-04-12 | Optical Fusion Inc. | Audio acoustic echo cancellation for video conferencing |
| CN105611222A (en) * | 2015-12-25 | 2016-05-25 | 北京紫荆视通科技有限公司 | Voice data processing method, device and system and controlled device |
| CN106060450A (en) * | 2016-07-13 | 2016-10-26 | 苏州科达科技股份有限公司 | Video conference audio mixing method and device |
-
2016
- 2016-11-16 CN CN201611009743.0A patent/CN106534762B/en active Active
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1443006A (en) * | 2003-01-16 | 2003-09-17 | 浙江南望图像信息产业有限公司 | Mixed sound system of intelligent controlled video frequency conference and method of controlling conference course |
| CN101192407A (en) * | 2006-11-30 | 2008-06-04 | 索尼株式会社 | Regeneration method and apparatus, program and recording medium |
| CN102348097A (en) * | 2010-08-02 | 2012-02-08 | 杭州华三通信技术有限公司 | Session method and multi-point control unit for video conference |
| WO2012046256A2 (en) * | 2010-10-08 | 2012-04-12 | Optical Fusion Inc. | Audio acoustic echo cancellation for video conferencing |
| CN202127439U (en) * | 2011-03-15 | 2012-01-25 | 华为终端有限公司 | Hand-free circuit and terminal |
| CN105611222A (en) * | 2015-12-25 | 2016-05-25 | 北京紫荆视通科技有限公司 | Voice data processing method, device and system and controlled device |
| CN106060450A (en) * | 2016-07-13 | 2016-10-26 | 苏州科达科技股份有限公司 | Video conference audio mixing method and device |
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109003620A (en) * | 2018-05-24 | 2018-12-14 | 北京潘达互娱科技有限公司 | A kind of echo removing method, device, electronic equipment and storage medium |
| WO2020048423A1 (en) * | 2018-09-06 | 2020-03-12 | 深圳市东微智能科技股份有限公司 | Audio processing method, terminal, and computer-readable storage medium |
| CN111726669A (en) * | 2019-03-18 | 2020-09-29 | 浙江宇视科技有限公司 | Distributed decoding equipment and audio and video synchronization method thereof |
| CN111726669B (en) * | 2019-03-18 | 2022-12-23 | 浙江宇视科技有限公司 | Distributed decoding equipment and audio and video synchronization method thereof |
| CN110070878A (en) * | 2019-03-26 | 2019-07-30 | 苏州科达科技股份有限公司 | The coding/decoding method and electronic equipment of audio code stream |
| CN110265050A (en) * | 2019-05-29 | 2019-09-20 | 广州小鹏汽车科技有限公司 | AEC audio control system and its clock machinery of consultation |
| CN110265050B (en) * | 2019-05-29 | 2021-06-04 | 广州小鹏汽车科技有限公司 | AEC audio control system and clock negotiation method thereof |
| CN110634485A (en) * | 2019-10-16 | 2019-12-31 | 声耕智能科技(西安)研究院有限公司 | Voice interaction service processor and processing method |
| CN110634485B (en) * | 2019-10-16 | 2023-06-13 | 声耕智能科技(西安)研究院有限公司 | Voice interaction service processor and processing method |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106534762B (en) | 2019-12-13 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN106534762A (en) | Low-time-delay distributed audio processing method and system | |
| CN103337240B (en) | The method of processed voice data, terminal, server and system | |
| CN101365127B (en) | Network game on-line live broadcast system and method | |
| KR20140103290A (en) | Method and arrangement for echo cancellation in conference systems | |
| CN105916002A (en) | Player multi-window displaying system and method of realizing hard and soft decoding switching | |
| JP7144429B2 (en) | A/V Interconnect Architecture Including Audio Downmixing Transmitter A/V Endpoints and Distributed Channel Amplification | |
| CN102984496A (en) | Processing method, device and system of video and audio information in video conference | |
| CN107820112A (en) | A kind of audio written broadcasting live system | |
| CN106937009A (en) | One kind cascade acoustic echo cancellation system and its control method and device | |
| CN103716171B (en) | A kind of audio data transmission method and main frame, terminal | |
| CN207731651U (en) | A kind of automobile audio HDMI ARC circuits | |
| CN101459481A (en) | General purpose radio for amplitude modulation, frequency modulation and DRM | |
| CN103826084A (en) | Audio encoding method | |
| JPH02204794A (en) | Ensemble system | |
| CN207802170U (en) | A kind of multi-path HDMI interfaces codec terminal system | |
| CN109640030A (en) | A kind of audio-video peripheral expansion device and method of video conferencing system | |
| CN206524849U (en) | A kind of anterior entertainment systems for supporting MOST buses | |
| CN201418131Y (en) | Train entertainment system based on digit signal | |
| CN208739395U (en) | Audio board and digital sound console | |
| CN1953526B (en) | A display device and the AV playing system using the same | |
| CN209419734U (en) | A kind of audio-video peripheral expansion device of video conferencing system | |
| CN206850806U (en) | A kind of multimedia advertisement delivery system | |
| CN207099275U (en) | One kind chats multi-screen interactive device | |
| CN110062311A (en) | A kind of intelligent sound box system by the more room music playback functions of local area network | |
| CN216122906U (en) | Audio wireless transmission device and audio transmission system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |