CN102231868A - High-order-recording-way-based three-dimensional (3D) sound reproducing system - Google Patents
High-order-recording-way-based three-dimensional (3D) sound reproducing system Download PDFInfo
- Publication number
- CN102231868A CN102231868A CN2011101279441A CN201110127944A CN102231868A CN 102231868 A CN102231868 A CN 102231868A CN 2011101279441 A CN2011101279441 A CN 2011101279441A CN 201110127944 A CN201110127944 A CN 201110127944A CN 102231868 A CN102231868 A CN 102231868A
- Authority
- CN
- China
- Prior art keywords
- module
- array
- data
- recording
- sound field
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Abstract
The invention discloses a high-order-recording-way-based three-dimensional (3D) sound reproducing system, which comprises a recording module, a preprocessing module, a transmission module, a receiving module, an encoding and decoding module and an array reproducing module, wherein the recording module comprises a high-order spherical microphone array and virtual instruments of national instruments (NI); the virtual instruments of the NI comprise a data acquisition system and labview software; the preprocessing module comprises an analogue-to-digital (AD) converter, a computer and a digital signal processor (DSP); the transmission module is arranged on the preprocessing module; the receiving module is arranged on the encoding and decoding module; and the array reproducing module comprises a synchronization unit, a multiplier unit, a digital-to-analogue (D/A) converter unit and a linear loudspeaker array. The system acquires high-order sound field information by the recording module to improve the spatial division degree of a sound field, improves the real-time performance of data transmission by the transmission module and the receiving module, and creates a target sound field in form of wave beams by the array reproducing module to reproduce an original sound field environment.
Description
Technical field
What the present invention relates to is a kind of 3D audio frequency repeater system of recording mode based on high-order.
Background technology
Along with the development of Digital Signal Processing and people continuous pursuit to audio, the sense of reality of audio frequency more and more is subject to people's attention, people wish by device reproduction target sound field, allow and listen the acoustic information that the hearer can experience the target sound field truly by this virtual sound field, make sound effect near real environment.Therefore the audio frequency repeater system is widely used in the middle of the technology of virtual reality world, and many about scientific research that can listening technology.
The audio frequency repeater system mainly comprises two parts, is respectively that audio recording and audio frequency are retransmitted, and wherein audio recording is the sound field collection of microphone, and it is to carry out sound field by loud speaker to reproduce that audio frequency is retransmitted.Traditional audio recording mode all is to grow up on the basis of two 8 font mike techniques, for example British patent prospectus (patent No. is 394325) disclose this audio recording mode (Blumlein, A. Improvements in and relating to Sound-transmission Sound recording and Sound reproducing Systems[P]. British Patent Application 394325. 1931.).But the sound field information that microphone is gathered in this audio frequency repeater system is limited, can not build with the target sound field and similarly retransmit sound field.People proposed acoustic holographic system (Holophony) and wave field synthesis system (WFS) again afterwards, the former has broad zone of audibility, be suitable for the shared sound reproduction requirement of many people, but be subjected to the restriction of spatial sampling theorem, Holophony needs a large amount of loud speakers and DSP to handle path, is not easy to realize; The latter is mainly used in the repeating transmission purposes of horizontal planar field, is subjected to the restriction of spatial sampling theorem equally and needs a large amount of hardware devices such as loud speaker, also is not easy to realize.
The another kind of system that can build the target sound field is the Ambisonic system, and this system makes sound field be decomposed and reconstruct by a series of spheric harmonic functions.Spheric harmonic function is to be used for the function that the space sound field is decomposed, and can build sound field characteristic with it, and spheric harmonic function spatially has identical center.Like this, the Ambisonic system is not subjected to the constraint of spatial sampling theorem, no matter its exponent number how, can reconstruct accurate sound field at the center of Ambisonic system speaker array.Michael Gerzon(Michael A.Gerzon, Periphony with height sound reproduction[J]. In AES Journal, volume 21, pages 2 – 10. AES, 1973) the Ambisonic system on 1 rank proposed the earliest.According to the principle of 1 rank Ambisonic system, Britain's Soundfield corporate system is produced the microphone that meets above requirement that can be used for actual recording that model is STS250.This Ambisonic system adopts 4 microphones with spatial distribution to record sound field, space audio is sampled, and still, the fine degree of the spatial information of sampling gained is still not enough, the space segmentation degree of sound field is careful inadequately, and the reconstruct sound field precision that audio frequency obtains when retransmitting thus is not high.In the wiring complexity of retransmitting the end loud speaker, configuration is high, for example Doby 5.1,7.1, must be when sound field is reproduced by the principle of sound field reconstruct, loud speaker is arranged in whole tin of domain space, otherwise will makes the target sound field distortion of construction, and the distributed architecture of loud speaker is very loaded down with trivial details, just sound source being fictionalized directivity when retransmitting, might not be exactly real Sounnd source direction.Therefore, above-mentioned Ambisonic system is not suitable for open occasion such as convention and mega-exhibition.
Summary of the invention
Technical problem to be solved by this invention is to provide a kind of 3D audio frequency repeater system of recording mode based on high-order, this system can obtain the spheric microphone array of sound field order of information and record sound field, retransmits the original sound field environment of reproduction by the line style loudspeaker array that one group of line style loud speaker SP-i arranges.
For solving the problems of the technologies described above, the present invention adopts following technical proposal,
A kind of 3D audio frequency repeater system of recording mode based on high-order, this system comprises and records module, pretreatment module, sending module, receiver module, coding/decoding module and array retransmit module, record module, pretreatment module, sending module, receiver module, coding/decoding module, array retransmit module 6 and connect successively, it is characterized in that:
The above-mentioned module of recording, this module comprises the virtual instrument of high-order spheric microphone array, NI, the virtual instrument of NI comprises data acquisition system and labview software, wherein, high-order spheric microphone array is used to gather voice data, the voice data of gathering sends pretreatment module to by serial line interface again after the storage of NI virtual instrument;
Above-mentioned pretreatment module, this module comprises AD converter, computer and dsp processor, AD converter is used for carrying out analog-to-digital conversion from recording the voice data that module transmits, storage after will changing then on computers, computer links to each other with dsp processor by jtag interface, and the data after the conversion are formed the audio classification data by algorithm process;
Above-mentioned sending module, this module is installed on the pretreatment module, and the audio classification data transaction of pretreatment module being handled the back acquisition according to the agreement of transfer of data becomes the Various types of data bag, through network packet is carried out remote transmission to sending module;
Above-mentioned receiver module, this module is installed on the coding/decoding module, receives the packet that sending module that network transmits sends, and packet is done reverse transformation obtain the audio classification data, passes on coding/decoding module;
Above-mentioned coding/decoding module, this module is used for the encoding and decoding to the audio classification data, and the audio classification data that receiver module transmits are changed in real time, is sent to the array retransmit module;
Above-mentioned array retransmit module, this module comprises lock unit, multiplier unit, D/A converter unit, line style loudspeaker array, lock unit, multiplier unit, D/A converter unit, line style loudspeaker array connect successively, lock unit adopts the parallel transmission mode to receive the audio classification data that coding/decoding module transmits, build the target sound field by the line style loudspeaker array with the form of wave beam, reproduce original sound field environment.
Of the present inventionly a kind ofly record the beneficial effect that the 3D audio frequency repeater system of mode has compared with prior art based on high-order and be: this system improves the space segmentation degree of sound field by the high-order spheric microphone array recording module and adopt and the virtual instrument image data of NI; Can support the remote transmission of data by sending module and receiver module, improve real time of data transmission; One group of line style loud speaker SP-i by the array retransmit module builds the target sound field with the form of wave beam output, reproduces original sound field environment, is applicable to open occasion such as convention and mega-exhibition, and the market range of application is wide.
Description of drawings
Fig. 1 is a kind of structural representation of recording the 3D audio frequency repeater system of mode based on high-order of the present invention;
Fig. 2 is a structural representation of recording module 1 of the present invention;
Fig. 3 is the structural representation of high-order spheric microphone array 11 of the present invention;
Fig. 4 is the schematic diagram of pretreatment module 2 of the present invention;
Fig. 5 is the structural representation of array retransmit module 6 of the present invention.
Embodiment
Below will be further described 3D audio frequency repeater system of the present invention.
Consult Fig. 1, a kind of 3D audio frequency repeater system of recording mode based on high-order of the present invention, this system comprises and records module 1, pretreatment module 2, sending module 3, receiver module 4, coding/decoding module 5 and array retransmit module 6, record module 1, pretreatment module 2, sending module 3, receiver module 4, coding/decoding module 5, array retransmit module 6 and connect successively, wherein:
As Fig. 2, shown in, the described module 1 of recording comprises high-order spheric microphone array 11, the virtual instrument 12 of NI, the virtual instrument 12 of NI comprises data acquisition system 121 and labview software 122, high-order spheric microphone array 11 is used to gather voice data, voice data is after NI virtual instrument storage 12, send pretreatment module 2 to by serial line interface again, described high-order spheric microphone array 11 is made up of 25 microphone MC-i, wherein, i=1 to 12, be distributed on the rigid ball spherical shell by equidistant mode, the microphone distance is got 10cm, and the exponent number of spherical array is 3 rank.As shown in Figure 3, among the figure, dot is represented microphone MC-i, and the distance between the adjacent dot is 10cm.On the expansion slot of the virtual instrument 12 of NI, open up 25 acquisition channel NIX-i, wherein, i=1 to 25, each passage connects a microphone respectively, gather voice data, through data acquisition system 121 samplings, it is 45kHz that sample rate is set, read and online storage by labview software 122, the voice data of storing is transferred to pretreatment module 2 by serial line interface.
As shown in Figure 4, described pretreatment module 2 comprises A/D converter 21, computer 22 and dsp processor 23, carry out analog-to-digital conversion by recording the voice data that module 1 transmits by A/D converter 21, then by USB interface with storage on computer 22, computer 22 links to each other with dsp processor 23 by jtag interface, voice data is downloaded to dsp processor 23 from computer 22, in dsp processor 23, audio frequency is classified by algorithm process, form the audio classification data, the audio classification data comprise voice class, background classes, noise class and sound bearing class.
Described sending module 3, this module are installed on the pretreatment module 2, and the audio classification data transaction of pretreatment module 2 being handled the back acquisition according to the agreement of transfer of data becomes the Various types of data bag, through network packet is carried out remote transmission to sending module 2 then.
Described receiver module 4, this module is installed on the coding/decoding module 5, receive the packet of sending module 3 transmissions that network transmits, packet is done reverse transformation obtain the audio classification data, pass on coding/decoding module 5, receiver module 4 plays the effect of metadata cache, when network blockage, prevent losing of packet, messaging parameters such as IP address are set respectively on sending module 3 and receiver module 4, connect the both sides of communication.
Described coding/decoding module 5, this module is used for the encoding and decoding to the audio classification data, the audio classification data that reception pretreatment module 2 transmits are changed in real time, adopted spatial parameter coding techniques audio compressed data, extract spatial parameter, parallel convey is to array retransmit module 5.
With reference to figure 5, described array retransmit module 6, this module comprises one group of lock unit 61, one group of multiplier unit 62, one group of D/A converter unit 63, one group of line style loudspeaker array 64, one group of lock unit 61, one group of multiplier unit 62, one group of D/A converter unit 63, one group of line style loudspeaker array 64 connects respectively successively, voice data is from coding/decoding module 5 parallel transmission to group lock units 61, one group of lock unit 61 adopts the parallel transmission modes to receive the audio classification data that coding/decoding module 5 transmits and does Synchronous Processing, and the audio classification data sync is play.One group of lock unit 61 is provided with a buffer unit 611, links to each other with computer 612 by data wire, and the of short duration storage of voice data back is downloaded in real time and preserved for computer 612.One group of multiplier unit 62 is made up of 12 multiplier MU-i respectively, wherein, i=1 to 12, multiplier MU-i is used for voice data is converted to digital electric signal, carries out power amplification.One group of D/A converter unit 63 is made up of 12 D/A converter D/A-i respectively, wherein, i=1 to 12, D/A converter D/A-i are used for that digital electric signal is changed into analog electrical signal and retransmit for line style loudspeaker array 64, one group of multiplier MU-i and one group of corresponding successively connection of D/A converter D/A-i.One group of line style loudspeaker array 64 is made up of 12 Renkus-HeinzPN102LA loud speaker SP-i respectively, wherein, i=1 to 12, the distance between the loud speaker SP-i is 30cm, one group of loud speaker SP-i is that line style is arranged, one group of loud speaker SP-i and one group of corresponding successively connection of D/A converter D/A-i.One group of line style loud speaker SP-i builds the target sound field with the form of wave beam output, reproduces original sound field environment.
Claims (1)
1. 3D audio frequency repeater system of recording mode based on high-order, this system comprises and records module (1), pretreatment module (2), sending module (3), receiver module (4), coding/decoding module (5) and array retransmit module (6), record module (1), pretreatment module (2), sending module (3), receiver module (4), coding/decoding module (5), array retransmit module (6) and connect successively, it is characterized in that:
The above-mentioned module (1) of recording, this module comprises the virtual instrument (12) of high-order spheric microphone array (11), NI, the virtual instrument of NI (12) comprises data acquisition system (121) and labview software (122), wherein, high-order spheric microphone array (11) is used to gather voice data, the voice data of gathering sends pretreatment module (2) to by serial line interface again after NI virtual instrument (12) storage;
Above-mentioned pretreatment module (2), this module comprises AD converter (21), computer (22) and dsp processor (23), AD converter is used for carrying out analog-to-digital conversion from recording the voice data that module (1) transmits, storage after will changing then is on computer (22), computer links to each other with dsp processor (23) by jtag interface, and the data after the conversion are formed the audio classification data by algorithm process;
Above-mentioned sending module (3), this module is installed on the pretreatment module (2), the audio classification data transaction of pretreatment module (2) being handled the back acquisition according to the agreement of transfer of data becomes the Various types of data bag, through network packet is carried out remote transmission to sending module (2);
Above-mentioned receiver module (4), this module are installed on the coding/decoding module (5), receive the packet that sending module (3) that network transmits sends, and packet is done reverse transformation obtain the audio classification data, pass on coding/decoding module (5);
Above-mentioned coding/decoding module (5), this module is used for the encoding and decoding to the audio classification data, and the audio classification data that receiver module (4) transmits are changed in real time, is sent to array retransmit module (6);
Above-mentioned array retransmit module (6), this module comprises lock unit (61), multiplier unit (62), D/A converter unit (63), line style loudspeaker array (64), lock unit (61), multiplier unit (62), D/A converter unit (63), line style loudspeaker array (64) connect successively, lock unit (61) adopts the parallel transmission mode to receive the audio classification data that coding/decoding module (5) transmits, build the target sound field by line style loudspeaker array (64) with the form of wave beam, reproduce original sound field environment.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2011101279441A CN102231868A (en) | 2011-05-18 | 2011-05-18 | High-order-recording-way-based three-dimensional (3D) sound reproducing system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2011101279441A CN102231868A (en) | 2011-05-18 | 2011-05-18 | High-order-recording-way-based three-dimensional (3D) sound reproducing system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN102231868A true CN102231868A (en) | 2011-11-02 |
Family
ID=44844392
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2011101279441A Pending CN102231868A (en) | 2011-05-18 | 2011-05-18 | High-order-recording-way-based three-dimensional (3D) sound reproducing system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN102231868A (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105447244A (en) * | 2015-11-18 | 2016-03-30 | 北京大学 | Method for distributing spherical microphone array of 3D recording system |
| CN110708647A (en) * | 2019-10-29 | 2020-01-17 | 扆亮海 | Spherical distribution guided data matching stereo field reconstruction method |
| CN113196274A (en) * | 2018-09-10 | 2021-07-30 | 西门子工业软件有限公司 | Computer-aided design of custom cellular lattice nuclei based on material properties |
| CN115017095A (en) * | 2022-08-05 | 2022-09-06 | 微传智能科技（常州）有限公司 | Current output type AK protocol wheel speed chip communication system and method |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1230331A (en) * | 1996-08-13 | 1999-09-29 | L·G·芬斯特尔 | Recording and play-back two-channel system for providing holophonic reproduction of sounds |
| WO2001047319A2 (en) * | 1999-12-22 | 2001-06-28 | Boxart Ag | Method and arrangement for recording and playing back sounds |
| DE10215775A1 (en) * | 2002-04-10 | 2003-10-30 | Inst Rundfunktechnik Gmbh | Method for spatial representation of sources of sound uses an array of loudspeakers fitted alongside each other and operated with coherent signals. |
| US20040247134A1 (en) * | 2003-03-18 | 2004-12-09 | Miller Robert E. | System and method for compatible 2D/3D (full sphere with height) surround sound reproduction |
| JP2007028066A (en) * | 2005-07-14 | 2007-02-01 | Victor Co Of Japan Ltd | Audio reproducing system |
| CN101001485A (en) * | 2006-10-23 | 2007-07-18 | 中国传媒大学 | Finite sound source multi-channel sound field system and sound field analogy method |
| CN101150687A (en) * | 2007-02-06 | 2008-03-26 | 南京Lg新港显示有限公司 | Image signal audio frequency signal output method and broadcast receiver using same |
| CN101162904A (en) * | 2007-11-06 | 2008-04-16 | 武汉大学 | Space parameter stereo coding/decoding method and device thereof |
-
2011
- 2011-05-18 CN CN2011101279441A patent/CN102231868A/en active Pending
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1230331A (en) * | 1996-08-13 | 1999-09-29 | L·G·芬斯特尔 | Recording and play-back two-channel system for providing holophonic reproduction of sounds |
| WO2001047319A2 (en) * | 1999-12-22 | 2001-06-28 | Boxart Ag | Method and arrangement for recording and playing back sounds |
| DE10215775A1 (en) * | 2002-04-10 | 2003-10-30 | Inst Rundfunktechnik Gmbh | Method for spatial representation of sources of sound uses an array of loudspeakers fitted alongside each other and operated with coherent signals. |
| US20040247134A1 (en) * | 2003-03-18 | 2004-12-09 | Miller Robert E. | System and method for compatible 2D/3D (full sphere with height) surround sound reproduction |
| JP2007028066A (en) * | 2005-07-14 | 2007-02-01 | Victor Co Of Japan Ltd | Audio reproducing system |
| CN101001485A (en) * | 2006-10-23 | 2007-07-18 | 中国传媒大学 | Finite sound source multi-channel sound field system and sound field analogy method |
| CN101150687A (en) * | 2007-02-06 | 2008-03-26 | 南京Lg新港显示有限公司 | Image signal audio frequency signal output method and broadcast receiver using same |
| CN101162904A (en) * | 2007-11-06 | 2008-04-16 | 武汉大学 | Space parameter stereo coding/decoding method and device thereof |
Non-Patent Citations (6)
| Title |
|---|
| 《信号处理》 20100525 汤永清，等 基于球傅里叶变换的声源三维空间定位 第26卷, 第05期 * |
| JIANG LI-HONG，ET AL: "Robustness Design Using Diagonal Loading Method in Sound System Rendered by Multiple Loudspeakers", 《2010 SECOND INTERNATIONAL CONFERENCE ON MULTIMEDIA AND INFORMATION TECHNOLOGY》 * |
| 汤永清，等: "一种局部线性嵌入的空间听觉重建方法", 《上海大学学报（自然科学版）》 * |
| 汤永清，等: "基于球傅里叶变换的声源三维空间定位", 《信号处理》 * |
| 黄青华，等: "Source localization with minimum variance distortionless response for spherical microphone arrays", 《JOURNAL OF SHANGHAI UNIVERSITY(ENGLISH EDITION)》 * |
| 黎泽清，等: "基于DSP与TLV320AIC23B的音频处理系统", 《自动化与仪表》 * |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN105447244A (en) * | 2015-11-18 | 2016-03-30 | 北京大学 | Method for distributing spherical microphone array of 3D recording system |
| CN105447244B (en) * | 2015-11-18 | 2018-06-19 | 北京大学 | A kind of 3D recording systems spherical surface microphone array location mode |
| CN113196274A (en) * | 2018-09-10 | 2021-07-30 | 西门子工业软件有限公司 | Computer-aided design of custom cellular lattice nuclei based on material properties |
| CN110708647A (en) * | 2019-10-29 | 2020-01-17 | 扆亮海 | Spherical distribution guided data matching stereo field reconstruction method |
| CN110708647B (en) * | 2019-10-29 | 2020-12-25 | 扆亮海 | Spherical distribution guided data matching stereo field reconstruction method |
| CN115017095A (en) * | 2022-08-05 | 2022-09-06 | 微传智能科技（常州）有限公司 | Current output type AK protocol wheel speed chip communication system and method |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104424953B (en) | Audio signal processing method and device | |
| CN101511047B (en) | Three-dimensional sound effect processing method for double track stereo based on loudspeaker box and earphone separately | |
| CN101001485A (en) | Finite sound source multi-channel sound field system and sound field analogy method | |
| Daniel et al. | Further investigations of high-order ambisonics and wavefield synthesis for holophonic sound imaging | |
| Davis et al. | High order spatial audio capture and its binaural head-tracked playback over headphones with HRTF cues | |
| US8755922B2 (en) | Apparatus and method for controlling a wave field synthesis renderer means with audio objects | |
| CN1277532A (en) | Multiple-channel audio frequency replaying apparatus and method | |
| CN102480671A (en) | Audio processing method and device in video communication | |
| Farina et al. | Ambiophonic principles for the recording and reproduction of surround sound for music | |
| CN104737557A (en) | Multi-dimensional parametric audio system and method | |
| KR20160018710A (en) | Sound processing method and terminal device | |
| CN105208189B (en) | Audio-frequency processing method and mobile terminal | |
| CN102231868A (en) | High-order-recording-way-based three-dimensional (3D) sound reproducing system | |
| JP2012509632A (en) | Converter and method for converting audio signals. | |
| CN101924317A (en) | Dual-channel processing device, method and sound playing system thereof | |
| CN102760437A (en) | Audio decoding device of control conversion of real-time audio track | |
| CN103636237B (en) | Method for processing an audio signal for improved restitution | |
| CN103167376B (en) | Directional loudspeaker and signal processing method thereof | |
| CN112468931B (en) | Sound field reconstruction optimization method and system based on spherical harmonic selection | |
| CN110890100A (en) | Voice enhancement method, multimedia data acquisition method, multimedia data playing method, device and monitoring system | |
| CN102695116B (en) | Sound acquisition, processing and recurrence method | |
| TW201325268A (en) | Virtual reality sound source localization apparatus | |
| JP2013009112A (en) | Sound acquisition and reproduction device, program and sound acquisition and reproduction method | |
| JPH02114799A (en) | Stereoscopic sound image pickup and reproducing device, transmission method for stereoscopic sound image and reproducing device, and recording method for stereoscopic sound information and reproducing device | |
| Horbach et al. | Practical implementation of a data-based wave field reproduction system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C02 | Deemed withdrawal of patent application after publication (patent law 2001) | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20111102 |