CN106782562A - Audio-frequency processing method, apparatus and system - Google Patents

Audio-frequency processing method, apparatus and system Download PDF

Info

Publication number
CN106782562A
CN106782562A CN201611187280.7A CN201611187280A CN106782562A CN 106782562 A CN106782562 A CN 106782562A CN 201611187280 A CN201611187280 A CN 201611187280A CN 106782562 A CN106782562 A CN 106782562A
Authority
CN
China
Prior art keywords
channel data
audio
signal
digital signal
path digital
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201611187280.7A
Other languages
Chinese (zh)
Inventor
梁建立
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
TCL Tongli Electronics Huizhou Co Ltd
Original Assignee
TCL Tongli Electronics Huizhou Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by TCL Tongli Electronics Huizhou Co Ltd filed Critical TCL Tongli Electronics Huizhou Co Ltd
Priority to CN201611187280.7A priority Critical patent/CN106782562A/en
Publication of CN106782562A publication Critical patent/CN106782562A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00Speech recognition
    • G10L15/28Constructional details of speech recognition systems
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00Speech recognition
    • G10L15/28Constructional details of speech recognition systems
    • G10L15/32Multiple recognisers used in sequence or in parallel; Score combination systems therefor, e.g. voting systems
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • G10L19/008Multichannel audio signal coding or decoding using interchannel correlation to reduce redundancy, e.g. joint-stereo, intensity-coding or matrixing

Abstract

The present invention proposes a kind of audio-frequency processing method, apparatus and system, the voice signal that microphone array is picked up is converted into multi-path digital signal input FGPA chips or MCU chip by ADC first, receive the left channel data and right channel data in the multi-path digital signal successively by FGPA chips or MCU chip, and after to the left channel data and right channel data caching Preset Time respectively, data convert to each passage is carried out audio frequency process by single channel data signal of the output with synchronous identification signal to audio process by audio process.Audio-frequency processing method of the invention is exported to back-end processing system after being single channel data signal by the multi-path digital signal transacting that be input into for front end by software or hardware mode, improves the compatibility of system design, saves construction cycle and cost.

Description

Audio-frequency processing method, apparatus and system
Technical field
The present invention relates to multimedia technology field, more particularly to a kind of audio-frequency processing method, apparatus and system.
Background technology
In voice application system, with the development of speech recognition application, the way requirement ratio being input into microphone simultaneously It is more, but back-end processing system does not support the interface that microphone multichannel is input into simultaneously substantially.Such as in current application system, There are No. 8 microphones to add 3 road audio collection signals again while being input in back-end processing system, but back-end processing system only has one Road IIS interfaces or pcm interface, it is impossible to meet the demand that above-mentioned multiple signals are input into simultaneously.
The content of the invention
It is a primary object of the present invention to provide a kind of audio-frequency processing method, it is intended to solve the rear end of existing voice application Reason system cannot meet the technical problem that multiple signals are input into simultaneously.
To achieve the above object, audio-frequency processing method proposed by the present invention, comprises the following steps:
The voice signal that microphone array is picked up is converted into multi-path digital signal;
Receive sequentially inputting for the left channel data in the multi-path digital signal and right channel data;
After the left channel data and right channel data are cached into Preset Time respectively, output is with synchronous identification signal Single channel data signal;
The single channel data signal is restored into each passage according to the synchronous identification signal carries out audio frequency process.
Further, the left channel data received in the multi-path digital signal and right channel data sequentially input The step of, specifically include:
The multi-path digital signal being input into through IIS is synchronously received with the first sample rate;
Whether the frame clock for judging the multi-path digital signal is predetermined level, if so, the multi-path digital signal for then receiving It is left channel data, if it is not, the multi-path digital signal for then receiving is right channel data;
After predetermined interval, switch the channel data type of the multi-path digital signal for receiving.
Further, it is described left channel data and right channel data are cached into Preset Time respectively after, output is with synchronous The step of recognizing the single channel data signal of signal, specifically includes:
According to the left channel data or the number of channels of right channel data that receive, the second sample rate is set;
The left channel data and right channel data that will be sequentially received are cached respectively in sequence, and to last group of passage Data make synchronous identifying processing;
After the preset lime, according to left channel data and right channel data caching sequentially, with second sample rate Single channel is exported.
Further, first sample rate is set to f1, second sample rate is set to f2, the number of channels is set to n, Then f2=n*f1
Another object of the present invention is to propose a kind of apparatus for processing audio, the apparatus for processing audio includes:
Analog-to-digital conversion module, multi-path digital signal is converted into by the voice signal that microphone array is picked up;
Audio merging module, receives the defeated successively of left channel data in the multi-path digital signal and right channel data Enter, the single channel with synchronous identification signal is output as after the left channel data and right channel data are cached into Preset Time respectively Data signal;
Audio processing modules, the single channel data signal is restored into each passage according to the synchronous identification signal carries out sound Frequency is processed.
Further, the audio merging module includes:
Receiving unit, the multi-path digital signal being input into through IIS is synchronously received with the first sample rate;
Judging unit, whether the frame clock for judging the multi-path digital signal is predetermined level, if so, the multichannel for then receiving Data signal is left channel data, if it is not, the multi-path digital signal for then receiving is right channel data;
Switch unit, after predetermined interval, switches the channel data type of the multi-path digital signal for receiving.
Further, the audio merging module also includes:
Setup unit, according to the left channel data or the number of channels of right channel data that receive, sets the second sample rate;
Buffer unit, the left channel data and right channel data that will be sequentially received is cached respectively in sequence, and to most Later group channel data makees synchronous identifying processing;
Output unit, after the preset lime, according to left channel data and right channel data caching sequentially, with described Two sample rate single channel are exported.
Further, first sample rate is set to f1, second sample rate is set to f2, the number of channels is set to n, Then f2=n*f1
Further, the audio merging module is fpga chip or MCU chip.
The present invention also propose a kind of audio frequency processing system, the audio frequency processing system include analog-digital converter, audio process, And apparatus for processing audio as described above, the apparatus for processing audio connection analog-digital converter and audio process, receive The multi-path digital signal of multiple analog-digital converter inputs, output single channel data signal to audio process.
Audio-frequency processing method of the invention, is converted into many ways by the voice signal that microphone array is picked up through ADC first Word signal, then receives left channel data and right channel data successively according to the level value of the clock of the multi-path digital signal Input, then after the left channel data and right channel data are cached into Preset Time respectively, output is with synchronous identification signal Single channel data signal, the single channel data signal finally is restored into each passage according to the synchronous identification signal is carried out at audio Reason.Audio-frequency processing method of the invention is single channel number by the multi-path digital signal transacting that be input into for front end by software or hardware mode Exported to back-end processing system after word signal, improve the compatibility of system design, save construction cycle and cost.
Brief description of the drawings
In order to illustrate more clearly about the embodiment of the present invention or technical scheme of the prior art, below will be to embodiment or existing The accompanying drawing to be used needed for having technology description is briefly described, it should be apparent that, drawings in the following description are only this Some embodiments of invention, for those of ordinary skill in the art, on the premise of not paying creative work, can be with Structure according to these accompanying drawings obtains other accompanying drawings.
Fig. 1 is the flow chart of the embodiment of audio-frequency processing method of the present invention;
Fig. 2 is the particular flow sheet of step S20 in Fig. 1;
Fig. 3 is the particular flow sheet of step S30 in Fig. 1;
Fig. 4 is the functional block diagram of the embodiment of apparatus for processing audio of the present invention.
Drawing reference numeral explanation:
The realization of the object of the invention, functional characteristics and advantage will be described further referring to the drawings in conjunction with the embodiments.
Specific embodiment
It should be appreciated that the specific embodiments described herein are merely illustrative of the present invention, it is not intended to limit the present invention.
The present invention proposes a kind of audio-frequency processing method.
Reference picture 1, Fig. 1 is the flow chart of the embodiment of audio-frequency processing method of the invention.
In the present embodiment, the audio-frequency processing method is comprised the following steps:
S10:The voice signal that microphone array is picked up is converted into multi-path digital signal;
S20:Receive sequentially inputting for the left channel data in the multi-path digital signal and right channel data;
S30:After the left channel data and right channel data are cached into Preset Time respectively, output is with synchronous identification letter Number single channel data signal;
S40:The single channel data signal is restored into each passage according to the synchronous identification signal carries out audio frequency process.
The multiple signals that the audio-frequency processing method of the present embodiment is mainly used in front-end collection in voice application system are merged into One-channel signal, audio frequency process is carried out into the audio process of rear end to be input into, and in one embodiment, sets MIC1To MIC8 It is the MIC arrays of voice collecting, each MIC is linked into the input all the way of ADC, the input of MIC needs 4 groups of IIS altogether, and internal Audio sample is also required to 2 groups of IIS, is total up to 6 groups of IIS while being input to audio frequency processing system, but most of audio frequency processing system Only 1 group IIS or pcm interface are input into, so multigroup while the IIS of input cannot be directly inputted in audio frequency processing system, institute With need by the synthesis of multigroup IIS signals all the way signal input in audio frequency processing system, to solve what is configured in existing system Hardware only exists an IIS interface or PCM input or output interfaces mostly, so as to cause the cycle stretch-out in system development, and Capacitive reduction.
The audio-frequency processing method of the present embodiment, when being operated, the voice signal mould for first picking up microphone array Plan signal sends to the ADC (analog-digital converter) being connected with the microphone array and is converted into data signal, in general, every two Group microphone one ADC of correspondence, two groups of microphones are input into left channel data and right channel data, ADC respectively after being changed by ADC After multi-path voice analog signal is converted into multi-path digital signal, by IIS interfaces by the multi-path digital signal by software Tupe or hardware handles pattern carry out Data Data merging and fusion, software processing pattern such as MCU etc. and are cached by building Area, total data is received to the buffer area, is packed by total data, by the packet after packing by only One IIS output interfaces or PCM output interfaces, output to audio frequency processing system is applied;Hardware handles pattern is typically used FGPA (field-programmable gate array), by increasing transmission rate during output, exports single channel data signal in same time.
Obtain ADC by IIS by the operation of multi-path digital signal input when, perform and receive the multi-path digital signal Operational order, because voice analog signal through ADC when analog-to-digital conversion is carried out, can directly according to the level of voice analog signal Height is converted to high level digital signal and low level digital signal, when being input into through IIS interfaces, according to data signal internal clock Level value height input left channel data or right channel data, general LRCK be high level when simultaneously be input into multi-path digital letter Left channel data in number, the right channel data being input into multi-path digital signal simultaneously when LRCK is low level, is receiving After the left channel data and right channel data of the multi-path digital signal, the left channel data and right channel data are delayed Deposit, and the left channel data or right channel data that are input into last group carry out identifying processing simultaneously, after the preset lime, will This left channel data of caching, right channel data and synchronous identification signal data successively from unique IIS output interfaces or PCM output interfaces are exported, and the audio process that formation single channel data signal is exported to rear end carries out next step audio frequency process.
After the single channel data signal is received, the synchronous identification signal data carried according to the single channel data signal After the single channel data signal is restored into each passage, it is possible to carry out follow-up audio frequency process, solving is carrying out multichannel Special configuration multichannel input or output interface is also needed during audio frequency process, development time and cost is saved, system application is improve Compatibility.
Audio-frequency processing method of the invention, is converted into many ways by the voice signal that microphone array is picked up through ADC first Word signal, then receives left channel data and right channel data successively according to the level value of the clock of the multi-path digital signal Input, then after the left channel data and right channel data are cached into Preset Time respectively, output is with synchronous identification signal Single channel data signal, the single channel data signal finally is restored into each passage according to the synchronous identification signal is carried out at audio Reason.Audio-frequency processing method of the invention is single channel number by the multi-path digital signal transacting that be input into for front end by software or hardware mode Exported to back-end processing system after word signal, improve the compatibility of system design, save construction cycle and cost.
Further, reference picture 2, the audio-frequency processing method based on above-described embodiment, step S20 is specifically included:
S21:The multi-path digital signal being input into through IIS is synchronously received with the first sample rate;
S22:Whether the frame clock for judging the multi-path digital signal is predetermined level, if so, the multi-path digital for then receiving Signal is left channel data, if it is not, the multi-path digital signal for then receiving is right channel data;
S23:After predetermined interval, switch the channel data type of the multi-path digital signal for receiving.
In the present embodiment, to being changed via ADC after multi-path digital signal when receiving, first according to the group of ADC Number, multiple interfaces of CPU, FPGA or MCU of subsequent treatment is connected to by IIS interfaces, according to the first sample rate, Ye Jibiao Accurate sampling transmission rate is synchronously received per data signal input all the way, because every railway digital signal is picked up by two groups of microphones Voice signal analog signal convert, and left channel data and right channel data have been distinguished, so in the numeral of multichannel During signal input, whether the frame clock that need to judge the railway digital signal is high level in predetermined level, namely electronic engineering, It is that 2.4V-5.0V, low level are 0.0V-0.4V generally for high level for TTL, high level is 4.99- for CMOS 5.0v, low level are 0.0-0.01v, if so, the multi-path digital signal for then receiving is left channel data, if the multichannel for otherwise receiving Data signal is right channel data, certainly, it is necessary to switch the channel data of the multi-path digital signal of reception after predetermined interval Type, namely after predetermined interval, left channel data will be received and switch to the right channel data of reception.
With further reference to above-described embodiment, by taking left-justify IIS signals as an example, when LRCK is high level, the DATA data of ADC It is the data of left passage, when LRCK is low level, DATA data are right channel data;Because the clock of ADC is connected together , so when LRCK is high, being input into MIC1、MIC3、MIC5、MIC7Deng the left channel data on ADC;It is defeated when LRCK is low Enter MIC2、MIC4、MIC6、MIC8Deng the right channel data on ADC.
Further, reference picture 3, the audio-frequency processing method based on above-described embodiment, step S30 is specifically included:
S31:According to the left channel data or the number of channels of right channel data that receive, the second sample rate is set;
S32:The left channel data and right channel data that will be sequentially received are cached respectively in sequence, and to last group Channel data makees synchronous identifying processing;
S33:After the preset lime, according to left channel data and right channel data caching sequentially, adopted with described second Sample rate single channel is exported.
In the present embodiment, when multigroup left channel data or right channel data is received, in addition it is also necessary to according to the left passage Or the number of channels of right passage sets the second sampling road of left channel data and right channel data, namely speed during output, so Order when the left channel data that will be sequentially received afterwards and right channel data are according to input cached, and will be recently entered That group data replaces with the synchronous identification data with identification function, according to left channel data in caching Preset Time after the meeting It is data cached with right channel data, it is defeated from an IIS output interface or PCM output interfaces with the second sample rate of above-mentioned setting Go out, the data setting between two groups of synchronous identification datas is a frame section, every time one voice data of frame section of output.
With further reference to above-described embodiment, synchronization has 6 left passage or right the channel data inputs of ADC, then Current data to receiving is cached, after the completion of current data reception, using pcm interface data are received, typically Exported from PCM or IIS interfacing orders at the audio to rear end with 6 times of (just how many times of how many passage) speed after caching 1/2fs Reason system, while output, another channel datas of each ADC of synchronization caching, and the data is activation of another passage is also to use phase Same mode.
Because the single-pass data for exporting is transmitted according to channel sequence, the data transmitted for Division identification Channel recognition is, it is necessary to last group of data of the right passage sent in PCM, are changed to synchronous identification data, that is, sacrifice ADC6 Right data, use for synchronous identification, and the data between two synchronous identification datas are considered as a frame, and each frame is exactly every each passage The data of secondary sampling.
Further, first sample rate is set to f1, second sample rate is set to f2, the number of channels is set to n, Then f2=n*f1, the multi-path digital signal that will also receive is within the identical time with single channel output.
Present invention further propose that a kind of apparatus for processing audio.
Reference picture 4, Fig. 4 is the functional block diagram of the embodiment of apparatus for processing audio of the invention.
In the present embodiment, the apparatus for processing audio 100 includes:
Analog-to-digital conversion module 10, multi-path digital signal is converted into by the voice signal that microphone array is picked up;
Audio merging module 20, receives the defeated successively of left channel data in the multi-path digital signal and right channel data Enter, the single channel with synchronous identification signal is output as after the left channel data and right channel data are cached into Preset Time respectively Data signal;
Audio processing modules 30, the single channel data signal is restored into each passage according to the synchronous identification signal is carried out Audio frequency process.
The apparatus for processing audio of the present embodiment is mainly used in the multiple signals of front-end collection in voice application system through FPGA Or MCU merges into one-channel signal, audio frequency process is carried out into the audio process of rear end to be input into, set in one embodiment MIC1To MIC8It is the MIC arrays of voice collecting, each MIC is linked into the input all the way of ADC, the input of MIC needs 4 groups altogether IIS, and internal audio frequency sampling is also required to 2 groups of IIS, is total up to 6 groups of IIS while being input to audio frequency processing system, but most of sound Frequency processing system only has 1 group of IIS or pcm interface to be input into, so multigroup while the IIS of input cannot be directly inputted to audio frequency process In system, thus need by the synthesis of multigroup IIS signals all the way signal input in audio frequency processing system, to solve existing system The hardware of middle configuration only exists an IIS interface or PCM input or output interfaces mostly, so as to cause the cycle in system development Extension, compatibility is reduced.
The apparatus for processing audio 100 of the present embodiment, when being operated, first by analog-to-digital conversion module 10 by microphone array The voice signal analog signal for arranging pickup is converted into data signal, in general, one ADC of every two groups of microphones correspondence, two groups of wheats Gram wind is input into left channel data and right channel data respectively after being changed by ADC, and be converted into for multi-path voice analog signal by ADC After multi-path digital signal, the multi-path digital signal is entered by software processing pattern or hardware handles pattern by IIS interfaces Row Data Data merges and merges, and total data is received to described and delayed by software processing pattern such as MCU etc. by building buffer area After depositing area, packed by total data, the packet after packing is exported by unique IIS output interfaces or PCM Interface, output to audio process is applied;Hardware handles pattern typically uses FGPA (field-programmable gate array), passes through Transmission rate during increase output, exports single channel data signal in same time.
Audio merging module 20 obtain ADC by IIS by the operation of multi-path digital signal input when, perform and receive described The operational order of multi-path digital signal, because voice analog signal through ADC when analog-to-digital conversion is carried out, can be directly according to voice The level height of analog signal is converted to high level digital signal and low level digital signal, when being input into through IIS interfaces, according to Height input left channel data or the right channel data of the level value of data signal internal clock, when general LRCK is high level simultaneously Left channel data in input multi-path digital signal, the right passage being input into multi-path digital signal simultaneously when LRCK is low level Data, after the left channel data and right channel data for receiving the multi-path digital signal, to the left channel data and the right side Channel data is cached, and the left channel data or right channel data that are input into last group carry out identifying processing simultaneously, After Preset Time, by this left channel data of caching, right channel data and synchronous identification signal data successively from unique IIS output interfaces or PCM output interfaces are exported, and the audio process that formation single channel data signal is exported to rear end carries out next step Audio frequency process, the audio merging module 20 in the present embodiment can be fpga chip, or MCU chip.
Audio processing modules 30 after the single channel data signal is received, according to the single channel data signal carry it is same After the single channel data signal is restored to each passage by step identification signal data, it is possible to carry out follow-up audio frequency process, solve Having determined is carrying out also needing special configuration multichannel input or output interface when MCVF multichannel voice frequency is processed, and saves development time and cost, Improve the compatibility of system application.
Apparatus for processing audio of the invention 100, the voice for first being picked up microphone array by analog-to-digital conversion module 10 is believed Number be converted into multi-path digital signal through ADC, then by audio merging module 20 according to the clock of the multi-path digital signal electricity Level values receive sequentially inputting for left channel data and right channel data, then the left channel data and right channel data are delayed respectively After depositing Preset Time, single channel data signal of the output with synchronous identification signal, finally by audio processing modules 30 according to described The single channel data signal is restored to each passage by synchronous identification signal carries out audio frequency process.Apparatus for processing audio of the invention 100 export to rear end after the multi-path digital signal transacting that is input into for front end by software or hardware mode is for single channel data signal Reason system, improves the compatibility of system design, saves construction cycle and cost.
Further, reference picture 4, the audio merging module 20 includes:
Receiving unit 21, the multi-path digital signal being input into through IIS is synchronously received with the first sample rate;
Judging unit 22, whether the frame clock for judging the multi-path digital signal is predetermined level, if so, what is then received is more Railway digital signal is left channel data, if it is not, the multi-path digital signal for then receiving is right channel data;
Switch unit 23, after predetermined interval, switches the channel data type of the multi-path digital signal for receiving.
In the present embodiment, to being changed via ADC after multi-path digital signal when receiving, receiving unit 21 first According to the group number of ADC, multiple interfaces of CPU, FPGA or MCU of subsequent treatment are connected to by IIS interfaces, according to the first sampling Rate, namely the sampling transmission rate of standard is synchronously received per data signal input all the way, because every railway digital signal is by two groups The voice signal analog signal of microphone pickup is converted, and has distinguished left channel data and right channel data, so When the data signal of multichannel is input into, judging unit 22 is needed to judge whether the frame clock of the railway digital signal is predetermined level, namely High level in electronic engineering, is that 2.4V-5.0V, low level are 0.0V-0.4V generally for high level for TTL, for High level is that 4.99-5.0v, low level are 0.0-0.01v for CMOS, if so, the multi-path digital signal for then receiving is left passage Data, if the multi-path digital signal for otherwise receiving is right channel data, certainly, it is necessary to switch unit 23 after predetermined interval Switch the channel data type of the multi-path digital signal for receiving, namely after predetermined interval, left channel data switching will be received To receive right channel data.
With further reference to above-described embodiment, by taking left-justify IIS signals as an example, when LRCK is high level, the DATA data of ADC It is the data of left passage, when LRCK is low level, DATA data are right channel data;Because the clock of ADC is connected together , so when LRCK is high, being input into MIC1、MIC3、MIC5、MIC7Deng the left channel data on ADC;It is defeated when LRCK is low Enter MIC2、MIC4、MIC6、MIC8Deng the right channel data on ADC.
Further, reference picture 4, the audio merging module 20 also includes:
Setup unit 24, according to the left channel data or the number of channels of right channel data that receive, sets the second sample rate;
Buffer unit 25, the left channel data and right channel data that will be sequentially received is cached respectively in sequence, and right Last group of channel data makees synchronous identifying processing;
Output unit 26, after the preset lime, according to left channel data and right channel data caching sequentially, with described Second sample rate single channel is exported.
In the present embodiment, when multigroup left channel data or right channel data is received, in addition it is also necessary to the foundation of setup unit 24 The number of channels of the left passage or right passage sets the second sampling road of left channel data and right channel data, namely during output Speed, order when the left channel data that then will be sequentially received by buffer unit 25 and right channel data are according to input enters Row caching, and that group data that will be recently entered replace with the synchronous identification data with identification function, it is finally single by output Unit 26 in caching Preset Time after the meeting, according to the data cached of left channel data and right channel data, with the second of above-mentioned setting Sample rate is exported from an IIS output interface or PCM output interfaces, and the data setting between two groups of synchronous identification datas is one Frame section, exports a voice data for frame section every time.
With further reference to above-described embodiment, the left passage or right channel data that synchronization has 6 ADC are input to audio Merging module 20,25 data being currently received of buffer unit are cached, after the completion of current data reception, by exporting The data that unit 26 will be received using pcm interface, after general cache 1/2fs, with 6 times of (how many passage just how many times) speed from Export PCM or IIS interfacing orders to audio frequency processing system;While output is to audio frequency processing system, merging module synchronization Another channel datas of each ADC are cached, and the data is activation of another passage is also to adopt in a like fashion.
Because the data that audio merging module 20 is given to audio processing modules 30 are transmitted according to channel sequence, it is The channel recognition of the data that Division identification is transmitted is, it is necessary to last group of data of the right passage sent in PCM, are changed to synchronization Identification data, that is, sacrifice ADC6Right data, use for synchronous identification, and the data between two synchronous identification datas are considered as One frame, each frame is exactly the data that each passage is sampled every time, and audio processing modules 30 are according to synchronous identification signal, it is possible to defeated The single-pass data for going out is restored to each passage and carries out audio frequency process.
Further, first sample rate is set to f1, second sample rate is set to f2, the number of channels is set to n, Then f2=n*f1, the multi-path digital signal that will also receive is within the identical time with single channel output.
The present invention also proposes a kind of audio frequency processing system, and the audio frequency processing system includes analog-digital converter 200, audio frequency process Device 300 and apparatus for processing audio 100 as described above, the apparatus for processing audio 100 connect the He of the analog-digital converter 200 Audio process 300, receives the multi-path digital signal of multiple inputs of analog-digital converter 200, output single channel data signal to audio Processor 300, when audio frequency process is carried out, the voice signal for being picked up microphone array by analog-to-digital conversion module 10 first is through mould Number converter 200 is converted into multi-path digital signal, then by audio merging module 20 according to the multi-path digital signal clock Level value receive sequentially inputting for left channel data and right channel data, then by the left channel data and right channel data point Huan Cun not be after Preset Time, single channel data signal of the output with synchronous identification signal is finally controlled by audio processing modules 30 The single channel data signal is restored to each passage and carries out audio frequency process by audio process 300 according to the synchronous identification signal, The compatibility of system design is improve, construction cycle and cost is saved.
The preferred embodiments of the present invention are these are only, the scope of the claims of the invention is not thereby limited, it is every to utilize this hair Equivalent structure or equivalent flow conversion that bright specification and accompanying drawing content are made, or directly or indirectly it is used in other related skills Art field, is included within the scope of the present invention.

Claims (10)

1. a kind of audio-frequency processing method, it is characterised in that the audio-frequency processing method is comprised the following steps:
The voice signal that microphone array is picked up is converted into multi-path digital signal;
Receive sequentially inputting for the left channel data in the multi-path digital signal and right channel data;
After the left channel data and right channel data are cached into Preset Time respectively, single channel of the output with synchronous identification signal Data signal;
The single channel data signal is restored into each passage according to the synchronous identification signal carries out audio frequency process.
2. audio-frequency processing method according to claim 1, it is characterised in that in the reception multi-path digital signal Left channel data and the step of sequentially inputting of right channel data, specifically include:
The multi-path digital signal being input into through IIS is synchronously received with the first sample rate;
Whether the frame clock for judging the multi-path digital signal is predetermined level, if so, the multi-path digital signal for then receiving is a left side Channel data, if it is not, the multi-path digital signal for then receiving is right channel data;
After preset interval time, switch the channel data type of the multi-path digital signal for receiving.
3. audio-frequency processing method according to claim 2, it is characterised in that described by left channel data and right channel data Respectively after caching Preset Time, export the step of with the synchronously single channel data signal of identification signal, specifically include:
According to the left channel data or the number of channels of right channel data that receive, the second sample rate is set;
The left channel data and right channel data that will be sequentially received are cached respectively in sequence, and to last group of channel data Make synchronous identifying processing;
After the preset lime, according to left channel data and right channel data caching sequentially, with the second sample rate single channel Output.
4. audio-frequency processing method according to claim 3, it is characterised in that first sample rate is set to f1, described second Sample rate is set to f2, the number of channels is set to n, then f2=n*f1
5. a kind of apparatus for processing audio, it is characterised in that the apparatus for processing audio includes:
Analog-to-digital conversion module, multi-path digital signal is converted into by the voice signal that microphone array is picked up;
Audio merging module, receives sequentially inputting for the left channel data in the multi-path digital signal and right channel data, will The left channel data and right channel data are output as the single channel numeral with synchronous identification signal after caching Preset Time respectively Signal;
Audio processing modules, being restored to the single channel data signal according to the synchronous identification signal carries out audio on each passage Treatment.
6. apparatus for processing audio according to claim 5, it is characterised in that the audio merging module includes:
Receiving unit, the multi-path digital signal being input into through IIS is synchronously received with the first sample rate;
Judging unit, whether the frame clock for judging the multi-path digital signal is predetermined level, if so, the multi-path digital for then receiving Signal is left channel data, if it is not, the multi-path digital signal for then receiving is right channel data;
Switch unit, after predetermined interval, switches the channel data type of the multi-path digital signal for receiving.
7. apparatus for processing audio according to claim 6, it is characterised in that the audio merging module also includes:
Setup unit, according to the left channel data or the number of channels of right channel data that receive, sets the second sample rate;
Buffer unit, the left channel data and right channel data that will be sequentially received is cached respectively in sequence, and to last Group channel data makees synchronous identifying processing;
Output unit, after the preset lime, according to left channel data and right channel data caching sequentially, adopted with described second Sample rate single channel is exported.
8. apparatus for processing audio according to claim 7, it is characterised in that first sample rate is set to f1, described second Sample rate is set to f2, the number of channels is set to n, then f2=n*f1
9. the apparatus for processing audio according to claim any one of 5-8, it is characterised in that the audio merging module is Fpga chip or MCU chip.
10. a kind of audio frequency processing system, it is characterised in that the audio frequency processing system include analog-digital converter, audio process and Apparatus for processing audio as claimed in claim 9, the apparatus for processing audio connects the analog-digital converter and audio process, Receive the multi-path digital signal of multiple analog-digital converter inputs, output single channel data signal to audio process.
CN201611187280.7A 2016-12-20 2016-12-20 Audio-frequency processing method, apparatus and system Pending CN106782562A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201611187280.7A CN106782562A (en) 2016-12-20 2016-12-20 Audio-frequency processing method, apparatus and system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201611187280.7A CN106782562A (en) 2016-12-20 2016-12-20 Audio-frequency processing method, apparatus and system

Publications (1)

Publication Number Publication Date
CN106782562A true CN106782562A (en) 2017-05-31

Family

ID=58896434

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201611187280.7A Pending CN106782562A (en) 2016-12-20 2016-12-20 Audio-frequency processing method, apparatus and system

Country Status (1)

Country Link
CN (1) CN106782562A (en)

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109379674A (en) * 2018-11-09 2019-02-22 福建星网智慧科技股份有限公司 One kind realizing MCVF multichannel voice frequency polyplant and method based on CPLD
CN109709842A (en) * 2018-12-10 2019-05-03 武汉市衡德实业有限公司 A kind of Transmission system and method for injection molding machine floor data
CN110085241A (en) * 2019-04-28 2019-08-02 北京地平线机器人技术研发有限公司 Data-encoding scheme, device, computer storage medium and data encoding apparatus
CN110838298A (en) * 2019-11-15 2020-02-25 闻泰科技(无锡)有限公司 Method, device and equipment for processing multi-channel audio data and storage medium
CN110908630A (en) * 2019-11-20 2020-03-24 国家广播电视总局中央广播电视发射二台 Audio processing method, processor, audio monitoring device and equipment
WO2020211017A1 (en) * 2019-04-17 2020-10-22 深圳市大疆创新科技有限公司 Audio signal processing method and device, and storage medium
CN112416289A (en) * 2020-11-12 2021-02-26 北京字节跳动网络技术有限公司 Audio synchronization method, device, equipment and storage medium
CN112770222A (en) * 2020-12-25 2021-05-07 苏州思必驰信息科技有限公司 Audio processing method and device
CN114237544A (en) * 2021-12-15 2022-03-25 北京百度网讯科技有限公司 Audio input method and device, electronic equipment and storage medium

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH11298999A (en) * 1998-04-14 1999-10-29 Hitachi Denshi Ltd Multi-channel pcm sound signal transmitting system
CN2857377Y (en) * 2005-12-31 2007-01-10 康佳集团股份有限公司 Audio, video digital signal mixing transmission circuit
CN101840701A (en) * 2009-03-18 2010-09-22 数维科技(北京)有限公司 Hierarchical audio coding frame structure
CN102065231A (en) * 2010-11-26 2011-05-18 深圳中兴力维技术有限公司 Multipath data fusion device, realization method thereof and multipath audio data processing system
CN105261365A (en) * 2015-09-15 2016-01-20 北京云知声信息技术有限公司 Audio output method and device

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH11298999A (en) * 1998-04-14 1999-10-29 Hitachi Denshi Ltd Multi-channel pcm sound signal transmitting system
CN2857377Y (en) * 2005-12-31 2007-01-10 康佳集团股份有限公司 Audio, video digital signal mixing transmission circuit
CN101840701A (en) * 2009-03-18 2010-09-22 数维科技(北京)有限公司 Hierarchical audio coding frame structure
CN102065231A (en) * 2010-11-26 2011-05-18 深圳中兴力维技术有限公司 Multipath data fusion device, realization method thereof and multipath audio data processing system
CN105261365A (en) * 2015-09-15 2016-01-20 北京云知声信息技术有限公司 Audio output method and device

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
陈启军等: "《嵌入式系统及其应用 第3版》", 31 December 2015 *

Cited By (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109379674A (en) * 2018-11-09 2019-02-22 福建星网智慧科技股份有限公司 One kind realizing MCVF multichannel voice frequency polyplant and method based on CPLD
CN109379674B (en) * 2018-11-09 2024-02-06 福建星网智慧科技有限公司 Device and method for realizing multipath audio aggregation based on CPLD
CN109709842A (en) * 2018-12-10 2019-05-03 武汉市衡德实业有限公司 A kind of Transmission system and method for injection molding machine floor data
WO2020211017A1 (en) * 2019-04-17 2020-10-22 深圳市大疆创新科技有限公司 Audio signal processing method and device, and storage medium
CN110085241A (en) * 2019-04-28 2019-08-02 北京地平线机器人技术研发有限公司 Data-encoding scheme, device, computer storage medium and data encoding apparatus
CN110085241B (en) * 2019-04-28 2021-10-08 北京地平线机器人技术研发有限公司 Data encoding method, data encoding device, computer storage medium and data encoding equipment
CN110838298A (en) * 2019-11-15 2020-02-25 闻泰科技(无锡)有限公司 Method, device and equipment for processing multi-channel audio data and storage medium
CN110908630A (en) * 2019-11-20 2020-03-24 国家广播电视总局中央广播电视发射二台 Audio processing method, processor, audio monitoring device and equipment
CN112416289A (en) * 2020-11-12 2021-02-26 北京字节跳动网络技术有限公司 Audio synchronization method, device, equipment and storage medium
CN112770222A (en) * 2020-12-25 2021-05-07 苏州思必驰信息科技有限公司 Audio processing method and device
CN114237544A (en) * 2021-12-15 2022-03-25 北京百度网讯科技有限公司 Audio input method and device, electronic equipment and storage medium

Similar Documents

Publication Publication Date Title
CN106782562A (en) Audio-frequency processing method, apparatus and system
CN100370827C (en) FPGA based four way audio-video multiplexing method
CN108845962B (en) High-speed analog-to-digital converter interface protocol-based streaming DMA controller
CN204406122U (en) Audio signal processor
CN106126186A (en) A kind of multi-channel audio signal parallel acquisition device
CN101783969A (en) Comprehensive monitoring device of signal quality of digital television
CN103117065A (en) Average opinion grading phonetic test device, control method thereof and phonetic test method
CN209314031U (en) Audio-frequency multiplex circuit
WO2022160312A1 (en) Data transmission method and apparatus, and electronic device and storage medium
CN106406174A (en) Multi-module multi-channel acquisition synchronization system and the working method thereof
CN103607611A (en) Voice control method and system of intelligent television
CN101383786B (en) Method for implementing data interchange between optical network terminal and customer terminal using household gateway
CN108809311A (en) A kind of realization device and implementation method of audio A/D conversion chip array analog sampling synchronization
CN206332831U (en) USB microphone array multichannel harvester based on XMOS platforms
CN106021025A (en) Oversampling data clock recovery FPGA realizing system and method
CN103078667A (en) Low voltage differential signaling (LVDS) high-speed data transmission method based on cat-5
CN109379674B (en) Device and method for realizing multipath audio aggregation based on CPLD
CN101567183B (en) Digital camera audio processor
CN101119419B (en) Method for implementing conference telephone
CN115932910A (en) Dual-mode Beidou time service and distribution device and method based on localization platform
CN206209693U (en) A kind of multi-channel audio signal parallel acquisition device
CN104539290A (en) Automatic data aligning system for multiple paths of A/D converters
CN209105381U (en) A kind of voice signal acquisition device for microphone array
CN107993668A (en) A kind of method of the multi-path digital sound mixing based on McASP interfaces
CN101150339A (en) A TD-SCDMA trunk amplifier using network modulation synchronization mode

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20170531

RJ01 Rejection of invention patent application after publication