WO2018032587A1 - Bluetooth-based holographic sound field recording communication device and system - Google Patents
Bluetooth-based holographic sound field recording communication device and system Download PDFInfo
- Publication number
- WO2018032587A1 WO2018032587A1 PCT/CN2016/100754 CN2016100754W WO2018032587A1 WO 2018032587 A1 WO2018032587 A1 WO 2018032587A1 CN 2016100754 W CN2016100754 W CN 2016100754W WO 2018032587 A1 WO2018032587 A1 WO 2018032587A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- sound field
- holographic sound
- holographic
- signal
- communication device
- Prior art date
Links
- 238000004891 communication Methods 0.000 title claims abstract description 63
- 238000012545 processing Methods 0.000 claims description 50
- 238000000034 method Methods 0.000 claims description 7
- 238000012544 monitoring process Methods 0.000 claims description 7
- 238000012937 correction Methods 0.000 claims description 6
- 210000000613 ear canal Anatomy 0.000 claims description 3
- 238000001093 holography Methods 0.000 claims 2
- 230000005540 biological transmission Effects 0.000 abstract description 9
- 238000010586 diagram Methods 0.000 description 2
- 230000008447 perception Effects 0.000 description 2
- 230000001360 synchronised effect Effects 0.000 description 2
- 238000004148 unit process Methods 0.000 description 2
- 230000007547 defect Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 210000005069 ears Anatomy 0.000 description 1
- 230000008054 signal transmission Effects 0.000 description 1
- 238000011144 upstream manufacturing Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/16—Sound input; Sound output
- G06F3/162—Interface to dedicated audio devices, e.g. audio drivers, interface to CODECs
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04B—TRANSMISSION
- H04B5/00—Near-field transmission systems, e.g. inductive loop type
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
- H04R5/00—Stereophonic arrangements
- H04R5/04—Circuit arrangements, e.g. for selective connection of amplifier inputs/outputs to loudspeakers, for loudspeaker detection, or for adaptation of settings to personal preferences or hearing impairments
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04S—STEREOPHONIC SYSTEMS
- H04S3/00—Systems employing more than two channels, e.g. quadraphonic
Definitions
- the invention belongs to the field of electroacoustics, and particularly relates to a holographic sound field recording and communication device based on Bluetooth.
- Single mic recording is the easiest, but the sound field is also the most monotonous.
- the original intention of stereo recording is to create a richer stereo field.
- There are various ways to configure the microphone which are all trying to simulate the perception of the human ear. For example, delay, amplitude difference, phase, etc., but it is difficult to achieve the real human ear perception by simply placing the position of the microphone.
- the present invention provides a Bluetooth-based holographic sound field recording and communication device, by which a holographic sound field signal can be recorded, and the holographic sound field signal can be further reproduced by the device, thereby giving the user a true hearing.
- a Bluetooth-based holographic sound field recording and communication device by which a holographic sound field signal can be recorded, and the holographic sound field signal can be further reproduced by the device, thereby giving the user a true hearing.
- using the Bluetooth uplink transmission method suitable for the holographic sound field signal transmission to ensure high-fidelity transmission of the signal, effectively improving the recording, sharing and communication capabilities of the holographic sound field signal.
- a holographic sound field recording communication device which comprises two microphone units located near the left and right ear canals for collecting three-dimensional sound field signals, and the acquisition signal processing unit processes the collected signals and converts them into digital signals, and the digital signals are input to the hologram.
- a sound field signal processing unit the holographic sound field signal processing unit processes the sound field signal, and the processed signal is encoded and compressed by the coding unit, and then the holographic sound field signal is uplinked to the external terminal through the Bluetooth transmitting unit, and the signal is recorded by the external terminal, wherein The holographic sound field signal is transmitted upstream using the Bluetooth RFCOMM channel.
- the device further includes a speaker unit for playing back the holographic sound field signal, wherein the external terminal transmits the holographic sound field signal to the holographic sound field recording communication device through the Bluetooth transmitting unit, and the Bluetooth receiving unit of the holographic sound field recording communication device receives the signal and the signal After being decoded by the decoding unit, the holographic sound field signal processing unit is input, and the holographic sound field signal processing unit outputs a signal to the playback signal processing unit, and further performs playback of the holographic sound field through the speaker unit.
- the external terminal transmits the holographic sound field signal to the holographic sound field recording communication device through the Bluetooth transmitting unit
- the Bluetooth receiving unit of the holographic sound field recording communication device receives the signal and the signal
- the holographic sound field signal processing unit is input, and the holographic sound field signal processing unit outputs a signal to the playback signal processing unit, and further performs playback of the holographic sound field through the speaker unit.
- the two speaker units are respectively integrated into the earplugs with the two microphone units; the speaker unit can also be used as a part of the speaker.
- the microphone unit collects the holographic sound field signal, and after collecting the signal processing unit to the holographic sound field signal processing unit, the holographic sound field signal processing unit sends the signal to the playback signal processing unit, and then the holographic sound field signal is reproduced by the speaker to realize the monitoring. Loopback.
- the holographic sound field signal processing unit can perform one or more processing of gain control, equalization, noise reduction, speech enhancement, and hearing correction on the holographic sound field signal.
- the device can operate in a recording mode, a playback mode, and a listening mode, and the device is provided with a mode control button, wherein the holographic audio recording and playback device can work in the recording mode and the listening mode at the same time.
- a holographic sound field recording communication system which includes the above holographic sound field recording communication device and external terminal at both ends of the network.
- the holographic sound field recording and communication device at one end of the network collects the holographic sound field signal, and transmits the holographic sound field signal to the outside through the Bluetooth RFCOMM channel.
- the external terminal transmits the holographic sound field signal to the external terminal at the other end of the network by the network, and then the holographic sound field signal is downlinked to the holographic sound field recording device at the other end of the network by the external terminal, and the hologram is holographic at the other end
- the sound field recording device reproduces the holographic sound field signal; likewise, the holographic sound field recording communication device at the other end of the network and the external terminal can also perform reverse communication via the network.
- an external terminal which comprises a Bluetooth transceiver unit, an audio processing unit, a memory, and a communication module, and is characterized in that: an application program is also provided, which is used in conjunction with the holographic sound field recording communication device or the holographic sound field recording communication system or both.
- the recording, playback, monitoring, and communication control of the holographic sound field can be realized through the Bluetooth transceiver unit, the audio processing unit, the memory, and the communication module of the external terminal, and the audio processing unit is controlled to perform gain control, equalization, and noise reduction on the holographic sound field signal. , one or more of speech enhancement, hearing correction.
- FIG. 1 is a system block diagram of a holographic sound field recording communication device of the present invention and an external terminal connected thereto
- FIG. 2 is a schematic diagram of communication using the holographic sound field recording communication device of the present invention.
- the holographic sound field recording communication device 1 of the present invention comprises two microphone units 11 and a holographic sound field signal processing unit 13, and two microphone units 11 are respectively located near the left and right ear canals for collecting three-dimensional sound field signals.
- the acquisition signal processing unit 12 processes the acquired signal and converts it into a digital signal.
- the digital signal is input to the holographic sound field signal processing unit 13, and the holographic sound field signal processing unit 13 processes the sound field signal, and the processed signal is encoded and compressed by the encoding unit 14. Thereafter, the holographic sound field signal is uplinked to the external terminal 2 through the Bluetooth transmitting unit 15, and the signal is recorded by the external terminal 2, wherein the holographic sound field signal is uplinked using the Bluetooth RFCOMM channel.
- the holographic sound field recording and communication device 1 further includes a speaker unit 19 for playing back the holographic sound field signal, wherein the external terminal 2 transmits the holographic sound field signal to the holographic sound field recording and communication device 1 through the Bluetooth transmitting unit 21, and the holographic sound field recording communication
- the Bluetooth receiving unit 16 of the device 1 receives a signal, which is decoded by the decoding unit 17 and input to the holographic sound field signal processing unit 13, and the holographic sound field signal processing unit 13 outputs a signal to the playback signal processing unit 18, and performs a holographic sound field through the speaker unit 19. Replay.
- the two speaker units 19 are respectively assembled into the earplugs with two microphone units 11 (shown in FIG. 2). After the user wears the ears, the two microphone units 11 are collected. The holographic sound field signal is reproduced by the two speaker units 19; the speaker unit 19 can also be used as part of the speaker.
- the holographic sound field recording communication device 1 can also perform synchronous monitoring, the microphone unit 11 collects the holographic sound field signal, and the collected signal processing unit 12 to the holographic sound field signal processing unit 13, the holographic sound field signal processing unit 13 sends the signal to the playback signal.
- the processing unit 18 further reproduces the holographic sound field signal by the speaker 19 to implement a monitoring loop.
- the holographic sound field signal processing unit 13 can perform processing such as gain control, equalization, noise reduction, speech enhancement, and hearing correction on the holographic sound field signal.
- the holographic sound field recording communication device 1 can operate in a recording mode, a playback mode, and a listening mode, and the holographic sound field recording communication device 1 is provided with a mode control button.
- the holographic audio recording and playback device can work in the recording mode and the listening mode at the same time, and those skilled in the art should know that synchronous monitoring while binaural recording can enable the recorder to grasp the real sound field environment changes in real time, in the face of possible In the event of an emergency, you can react quickly and improve the security and reliability of the recording.
- another embodiment of the present invention provides a holographic audio communication system, including a holographic sound field recording and communication device 1 on a network side, which collects a holographic sound field signal, and transmits a holographic sound field signal to an external terminal through a Bluetooth RFCOMM channel.
- the external terminal 2 transmits the holographic sound field signal to the external terminal 2 on the other side of the network through the network, and then the holographic sound field signal is downlinked by the external terminal 2 to the holographic sound field recording communication device 1 on the other side of the network, and The holographic sound field recording device 1 at the other end reproduces the holographic sound field signal; likewise, the holographic sound field recording communication device 1 and the external terminal 2 on the other side of the network can also perform reverse communication through the network, thereby realizing the holographic sound field of the present invention. communication.
- the external terminal 2 has an application 24 for use with the holographic sound field recording communication device 1 and the holographic sound field recording communication system, which can pass through the Bluetooth transceiver units 21, 22 of the external terminal 2, the audio processing unit 23, and the memory (not shown in the figure)
- the communication module (not shown) realizes recording, playback, monitoring, sharing, and communication control of the holographic sound field signal; similarly, the audio processing unit 23 can also be controlled to perform gain control, equalization, noise reduction, and voice on the holographic sound field signal. Enhancement, hearing correction, etc.
- the audio codec mode adopts one of SBC, OPUS, Apt-X, and AAC to realize low-latency, full-band and multi-channel of uplink transmission.
- Transmission greatly improving the fidelity of the uplink signal; specifically, the Bluetooth transmission of the present invention can be implemented based on the CSR platform, wherein the protocol stack processing unit (stack) of the CSR platform.
- the RFCOMM channel data is sent to the DSP for processing, and after processing, it returns to the protocol stack processing unit (stack), and then transmits.
Abstract
Disclosed in the present invention are a holographic sound field recording communication device (1) and system. The holographic sound field recording communication device (1) is used to collect and replay a holographic sound field signal, and the holographic sound field recording communication device (1) and an external terminal (2) connected thereto by means of Bluetooth are used for holographic sound field communication, thereby bringing a real auditory and communication experience to a user. At the same time, a Bluetooth uplink transmission means suitable for transmission of the holographic sound field signal ensures high-fidelity transmission of the signal and effectively enhances holographic sound field signal recording, sharing and communicating capabilities.
Description
本发明属于电声领域，特别涉及一种基于蓝牙的全息声场录音通讯装置。The invention belongs to the field of electroacoustics, and particularly relates to a holographic sound field recording and communication device based on Bluetooth.
传统录音方法包括单麦克录音、立体声录音(AB、XY、MS、ORTF)。单麦克录音最为简便，但是声场也最为单调；立体声录音的初衷是营造更为丰富的立体声场，在麦克风配置上出现了多种多样的方式，都是试图模拟人的两耳对声音的感知特性，比如延时、幅度差异、相位等，然而只是靠麦克风摆放位置是难以达到模拟真正的人耳感知的。Traditional recording methods include single mic recording, stereo recording (AB, XY, MS, ORTF). Single-microphone recording is the easiest, but the sound field is also the most monotonous. The original intention of stereo recording is to create a richer stereo field. There are various ways to configure the microphone, which are all trying to simulate the perception of the human ear. For example, delay, amplitude difference, phase, etc., but it is difficult to achieve the real human ear perception by simply placing the position of the microphone.
另一方面，移动宽带的迅猛发展，普通消费者的手机、平板电脑等常用工具除了打电话之外都有了音频视频录制能力，以及很多的数码产品诸如录音笔、可摄像的相机等大多数情况下这些设备都是基于内部麦克风来录制声音的，这些内置麦克风一方面音质比较差，同时声场展现能力也非常差。On the other hand, with the rapid development of mobile broadband, ordinary consumers' mobile phones, tablets and other common tools have audio and video recording capabilities in addition to making calls, as well as many digital products such as voice recorders and camera cameras. In the case of these devices, the sound is recorded based on an internal microphone. On the one hand, the built-in microphones have poor sound quality and the sound field display capability is also very poor.
目前也出现了一些为手机等设备提供立体声录音的接口设备，这些设备接口离上述专业立体声麦克风还有很大距离，更谈不上浸入式三维声场。在视频监控、在线教育、网络音视频通讯等领域，要么压根没有音频能力，有的是简单的单声道音频，有的是普通的立体声，总之，听觉体验远远达不到身临其境的需求。At present, there are also some interface devices for providing stereo recording for mobile phones and other devices. These device interfaces are far away from the above professional stereo microphones, let alone the immersive three-dimensional sound field. In the fields of video surveillance, online education, network audio and video communication, etc., there is no audio capability at all, some are simple mono audio, some are ordinary stereo, in short, the auditory experience is far from the immersive needs.
发明内容Summary of the invention
为了克服现有技术的缺陷，本发明提出一种基于蓝牙的全息声场录音通讯装置，通过该装置可录制全息声场信号，进一步也可通过该装置重放全息声场信号，给用户带来真实的听觉体验，同时，采用适合该全息声场信号传输的蓝牙上行传输手段保证信号的高保真传输，有效提升了全息声场信号的记录、分享及通讯能力。In order to overcome the defects of the prior art, the present invention provides a Bluetooth-based holographic sound field recording and communication device, by which a holographic sound field signal can be recorded, and the holographic sound field signal can be further reproduced by the device, thereby giving the user a true hearing. Experience, at the same time, using the Bluetooth uplink transmission method suitable for the holographic sound field signal transmission to ensure high-fidelity transmission of the signal, effectively improving the recording, sharing and communication capabilities of the holographic sound field signal.
提出一种全息声场录音通讯装置，包括两个传声器单元分别位于左、右耳道附近用于采集三维声场信号，采集信号处理单元对采集信号进行处理并转换成数字信号，前述数字信号输入至全息声场信号处理单元，全息声场信号处理单元对声场信号进行处理，处理后的信号经编码单元编码压缩后，通过蓝牙发送单元将全息声场信号上行发送至外部终端，由外部终端记录该信号，其中，采用蓝牙RFCOMM通道将全息声场信号进行上行发送。A holographic sound field recording communication device is proposed, which comprises two microphone units located near the left and right ear canals for collecting three-dimensional sound field signals, and the acquisition signal processing unit processes the collected signals and converts them into digital signals, and the digital signals are input to the hologram. a sound field signal processing unit, the holographic sound field signal processing unit processes the sound field signal, and the processed signal is encoded and compressed by the coding unit, and then the holographic sound field signal is uplinked to the external terminal through the Bluetooth transmitting unit, and the signal is recorded by the external terminal, wherein The holographic sound field signal is transmitted upstream using the Bluetooth RFCOMM channel.
进一步的，该装置还包括扬声器单元，用于重放全息声场信号，其中，外部终端通过蓝牙发送单元向全息声场录音通讯装置发送全息声场信号，全息声场录音通讯装置的蓝牙接收单元接收信号，信号经解码单元解码后输入全息声场信号处理单元，全息声场信号处理单元输出信号至重放信号处理单元，进一步通过扬声器单元进行全息声场的重放。Further, the device further includes a speaker unit for playing back the holographic sound field signal, wherein the external terminal transmits the holographic sound field signal to the holographic sound field recording communication device through the Bluetooth transmitting unit, and the Bluetooth receiving unit of the holographic sound field recording communication device receives the signal and the signal After being decoded by the decoding unit, the holographic sound field signal processing unit is input, and the holographic sound field signal processing unit outputs a signal to the playback signal processing unit, and further performs playback of the holographic sound field through the speaker unit.
进一步的，扬声器单元为两个，该两个扬声器单元分别与两个传声器单元集合进耳塞中；扬声器单元也可作为音箱的一部分。Further, there are two speaker units, and the two speaker units are respectively integrated into the earplugs with the two microphone units; the speaker unit can also be used as a part of the speaker.
进一步的，传声器单元采集全息声场信号，经采集信号处理单元至全息声场信号处理单元，全息声场信号处理单元将信号发送至重放信号处理单元，再由扬声器将全息声场信号进行重放从而实现监听回环。Further, the microphone unit collects the holographic sound field signal, and after collecting the signal processing unit to the holographic sound field signal processing unit, the holographic sound field signal processing unit sends the signal to the playback signal processing unit, and then the holographic sound field signal is reproduced by the speaker to realize the monitoring. Loopback.
另外，全息声场信号处理单元可对全息声场信号进行增益控制、均衡、降噪、语音增强、听力校正中的一项或多项处理。In addition, the holographic sound field signal processing unit can perform one or more processing of gain control, equalization, noise reduction, speech enhancement, and hearing correction on the holographic sound field signal.
进一步的，该装置可工作在录制模式、重放模式、监听模式下，该装置上设有模式控制按钮，其中，全息音频录制重放装置可同时工作在录制模式和监听模式。Further, the device can operate in a recording mode, a playback mode, and a listening mode, and the device is provided with a mode control button, wherein the holographic audio recording and playback device can work in the recording mode and the listening mode at the same time.
并提出一种全息声场录音通讯系统，包括在网络两端上述全息声场录音通讯装置、外部终端，网络一端的全息声场录音通讯装置采集全息声场信号，通过蓝牙RFCOMM通道将全息声场信号上行传输到外部终端，外部终端藉由网络将全息声场信号发送至在网络另一端的外部终端，再由该外部终端将全息声场信号下行发送至网络另一端的全息声场录音通装置，并由该另一端的全息声场录音通装置重放全息声场信号；同样，网络另一端的全息声场录音通讯装置及外部终端也可藉由网络进行反向通讯。
A holographic sound field recording communication system is proposed, which includes the above holographic sound field recording communication device and external terminal at both ends of the network. The holographic sound field recording and communication device at one end of the network collects the holographic sound field signal, and transmits the holographic sound field signal to the outside through the Bluetooth RFCOMM channel. a terminal, the external terminal transmits the holographic sound field signal to the external terminal at the other end of the network by the network, and then the holographic sound field signal is downlinked to the holographic sound field recording device at the other end of the network by the external terminal, and the hologram is holographic at the other end The sound field recording device reproduces the holographic sound field signal; likewise, the holographic sound field recording communication device at the other end of the network and the external terminal can also perform reverse communication via the network.
最后提出一种外部终端，其包括蓝牙收发单元、音频处理单元、存储器、通讯模块，特征在于：还具有配合上述全息声场录音通讯装置或全息声场录音通讯系统或上述两者使用的应用程序，其可通过外部终端的蓝牙收发单元、音频处理单元、存储器、通讯模块实现对全息声场的录制、重放、监听、通讯的控制，以及控制音频处理单元对全息声场信号进行增益控制、均衡、降噪、语音增强、听力校正中的一项或多项处理。Finally, an external terminal is provided, which comprises a Bluetooth transceiver unit, an audio processing unit, a memory, and a communication module, and is characterized in that: an application program is also provided, which is used in conjunction with the holographic sound field recording communication device or the holographic sound field recording communication system or both. The recording, playback, monitoring, and communication control of the holographic sound field can be realized through the Bluetooth transceiver unit, the audio processing unit, the memory, and the communication module of the external terminal, and the audio processing unit is controlled to perform gain control, equalization, and noise reduction on the holographic sound field signal. , one or more of speech enhancement, hearing correction.
图1为本发明的全息声场录音通讯装置及与其连接的外部终端的系统框图1 is a system block diagram of a holographic sound field recording communication device of the present invention and an external terminal connected thereto
图2为利用本发明的全息声场录音通讯装置进行通讯的示意图2 is a schematic diagram of communication using the holographic sound field recording communication device of the present invention.
结合附图1，本发明的全息声场录音通讯装置1包括两个传声器单元11、全息声场信号处理单元13，两个传声器单元11分别位于左、右耳道附近用于采集三维声场信号。采集信号处理单元12对采集信号进行处理并转换成数字信号，前述数字信号输入至全息声场信号处理单元13，全息声场信号处理单元13对声场信号进行处理，处理后的信号经编码单元14编码压缩后，通过蓝牙发送单元15将全息声场信号上行发送至外部终端2，由外部终端2记录该信号，其中，采用蓝牙RFCOMM通道将全息声场信号进行上行发送。1 , the holographic sound field recording communication device 1 of the present invention comprises two microphone units 11 and a holographic sound field signal processing unit 13, and two microphone units 11 are respectively located near the left and right ear canals for collecting three-dimensional sound field signals. The acquisition signal processing unit 12 processes the acquired signal and converts it into a digital signal. The digital signal is input to the holographic sound field signal processing unit 13, and the holographic sound field signal processing unit 13 processes the sound field signal, and the processed signal is encoded and compressed by the encoding unit 14. Thereafter, the holographic sound field signal is uplinked to the external terminal 2 through the Bluetooth transmitting unit 15, and the signal is recorded by the external terminal 2, wherein the holographic sound field signal is uplinked using the Bluetooth RFCOMM channel.
进一步的，该全息声场录音通讯装置1还包括扬声器单元19，用于重放全息声场信号，其中，外部终端2通过蓝牙发送单元21向全息声场录音通讯装置1发送全息声场信号，全息声场录音通讯装置1的蓝牙接收单元16接收信号，信号经解码单元17解码后输入全息声场信号处理单元13，全息声场信号处理单元13输出信号至重放信号处理单元18，并通过扬声器单元19进行全息声场的重放。Further, the holographic sound field recording and communication device 1 further includes a speaker unit 19 for playing back the holographic sound field signal, wherein the external terminal 2 transmits the holographic sound field signal to the holographic sound field recording and communication device 1 through the Bluetooth transmitting unit 21, and the holographic sound field recording communication The Bluetooth receiving unit 16 of the device 1 receives a signal, which is decoded by the decoding unit 17 and input to the holographic sound field signal processing unit 13, and the holographic sound field signal processing unit 13 outputs a signal to the playback signal processing unit 18, and performs a holographic sound field through the speaker unit 19. Replay.
进一步的，扬声器单元19为两个，该两个扬声器单元19分别与两个传声器单元11集合进耳塞中(附图2所示)，用户佩戴至双耳后，则由两个传声器单元11采集全息声场信号，由两个扬声器单元19重放全息声场信号；扬声器单元19也可作为音箱的一部分。Further, there are two speaker units 19, and the two speaker units 19 are respectively assembled into the earplugs with two microphone units 11 (shown in FIG. 2). After the user wears the ears, the two microphone units 11 are collected. The holographic sound field signal is reproduced by the two speaker units 19; the speaker unit 19 can also be used as part of the speaker.
进一步的，全息声场录音通讯装置1还可进行同步监听，传声器单元11采集全息声场信号，经采集信号处理单元12至全息声场信号处理单元13，全息声场信号处理单元13将信号发送至重放信号处理单元18，再由扬声器19将全息声场信号进行重放从而实现监听回环；其中，全息声场信号处理单元13可对全息声场信号进行增益控制、均衡、降噪、语音增强、听力校正等处理。Further, the holographic sound field recording communication device 1 can also perform synchronous monitoring, the microphone unit 11 collects the holographic sound field signal, and the collected signal processing unit 12 to the holographic sound field signal processing unit 13, the holographic sound field signal processing unit 13 sends the signal to the playback signal. The processing unit 18 further reproduces the holographic sound field signal by the speaker 19 to implement a monitoring loop. The holographic sound field signal processing unit 13 can perform processing such as gain control, equalization, noise reduction, speech enhancement, and hearing correction on the holographic sound field signal.
全息声场录音通讯装置1可工作在录制模式、重放模式、监听模式，全息声场录音通讯装置1上设有模式控制按钮。全息音频录制重放装置可以同时工作在录制模式和监听模式，本领域技术人员应知晓，在双耳录音的同时进行同步监听，可以使录音者实时的掌握真实声场环境的变化，在面对可能的突发事件时，可以快速做出反应，提高录音时的安全性与可靠性。The holographic sound field recording communication device 1 can operate in a recording mode, a playback mode, and a listening mode, and the holographic sound field recording communication device 1 is provided with a mode control button. The holographic audio recording and playback device can work in the recording mode and the listening mode at the same time, and those skilled in the art should know that synchronous monitoring while binaural recording can enable the recorder to grasp the real sound field environment changes in real time, in the face of possible In the event of an emergency, you can react quickly and improve the security and reliability of the recording.
结合附图2，本发明的另一实施例提供了一种全息音频通讯系统，包括网络一侧的全息声场录音通讯装置1采集全息声场信号，通过蓝牙RFCOMM通道将全息声场信号上行传输到外部终端2，外部终端2藉由网络将全息声场信号发送至网络另一侧的外部终端2，再由该外部终端2将全息声场信号下行发送至网络另一侧的全息声场录音通讯装置1，并由该另一端的全息声场录音通装置1重放全息声场信号；同样，网络另一侧的全息声场录音通讯装置1及外部终端2也可藉由网络进行反向通讯，从而实现本发明的全息声场通讯。2, another embodiment of the present invention provides a holographic audio communication system, including a holographic sound field recording and communication device 1 on a network side, which collects a holographic sound field signal, and transmits a holographic sound field signal to an external terminal through a Bluetooth RFCOMM channel. 2. The external terminal 2 transmits the holographic sound field signal to the external terminal 2 on the other side of the network through the network, and then the holographic sound field signal is downlinked by the external terminal 2 to the holographic sound field recording communication device 1 on the other side of the network, and The holographic sound field recording device 1 at the other end reproduces the holographic sound field signal; likewise, the holographic sound field recording communication device 1 and the external terminal 2 on the other side of the network can also perform reverse communication through the network, thereby realizing the holographic sound field of the present invention. communication.
外部终端2中具有配合全息声场录音通讯装置1及全息声场录音通讯系统使用的应用程序24，其可通过外部终端2的蓝牙收发单元21、22、音频处理单元23、存储器(图中未示出)、通讯模块(未示出)实现对全息声场信号的录制、重放、监听、分享、通讯控制；同样，也可控制音频处理单元23对全息声场信号进行增益控制、均衡、降噪、语音增强、听力校正等处理。The external terminal 2 has an application 24 for use with the holographic sound field recording communication device 1 and the holographic sound field recording communication system, which can pass through the Bluetooth transceiver units 21, 22 of the external terminal 2, the audio processing unit 23, and the memory (not shown in the figure) The communication module (not shown) realizes recording, playback, monitoring, sharing, and communication control of the holographic sound field signal; similarly, the audio processing unit 23 can also be controlled to perform gain control, equalization, noise reduction, and voice on the holographic sound field signal. Enhancement, hearing correction, etc.
作为本发明的基于蓝牙RFCOMM通道的全息声场信号的上行传输的进一步改进，音频编解码方式采用SBC、OPUS、Apt-X、AAC之一，以实现上行传输的低延时、全频带及多通道传输，大大提升上行信号的保真度；具体的，本发明的蓝牙传输可基于CSR平台实现，其中由CSR平台的协议栈处理单元(stack)
将RFCOMM通道数据发送至DSP进行处理，处理完毕后返回协议栈处理单元(stack)，再进行发送。
As a further improvement of the uplink transmission of the holographic sound field signal based on the Bluetooth RFCOMM channel of the present invention, the audio codec mode adopts one of SBC, OPUS, Apt-X, and AAC to realize low-latency, full-band and multi-channel of uplink transmission. Transmission, greatly improving the fidelity of the uplink signal; specifically, the Bluetooth transmission of the present invention can be implemented based on the CSR platform, wherein the protocol stack processing unit (stack) of the CSR platform
The RFCOMM channel data is sent to the DSP for processing, and after processing, it returns to the protocol stack processing unit (stack), and then transmits.
Claims (10)
- 一种全息声场录音通讯装置(1)，包括两个传声器单元(11)分别位于左、右耳道附近用于采集三维声场信号，采集信号处理单元(12)对采集信号进行处理并转换成数字信号，前述数字信号输入至全息声场信号处理单元(13)，全息声场信号处理单元(13)对声场信号进行处理，处理后的信号经编码单元(14)编码压缩后，通过蓝牙发送单元(15)将全息声场信号上行发送至外部终端(2)，由外部终端(2)记录该信号，其中，采用蓝牙RFCOMM通道将全息声场信号进行上行发送。A holographic sound field recording communication device (1) comprises two microphone units (11) located near the left and right ear canals for collecting three-dimensional sound field signals, and the acquisition signal processing unit (12) processes the collected signals and converts them into numbers. a signal, the digital signal is input to the holographic sound field signal processing unit (13), and the holographic sound field signal processing unit (13) processes the sound field signal, and the processed signal is encoded and compressed by the encoding unit (14), and then transmitted through the Bluetooth transmitting unit (15). The holographic sound field signal is uplinked to the external terminal (2), and the signal is recorded by the external terminal (2), wherein the holographic sound field signal is uplinked using the Bluetooth RFCOMM channel.
- 如权利要求1所述的全息声场录音通讯装置(1)，特征在于：包括扬声器单元(19)，用于重放全息声场信号，其中，外部终端(2)通过蓝牙发送单元(21)向全息声场录音通讯装置(1)发送全息声场信号，全息声场录音通讯装置(1)的蓝牙接收单元(16)接收信号，信号经解码单元(17)解码后输入全息声场信号处理单元(13)，全息声场信号处理单元(13)输出信号至重放信号处理单元(18)，进一步通过扬声器单元(19)进行全息声场的重放。A holographic sound field recording communication device (1) according to claim 1, comprising a speaker unit (19) for reproducing a holographic sound field signal, wherein the external terminal (2) is holographically transmitted through the Bluetooth transmitting unit (21) The sound field recording communication device (1) transmits the holographic sound field signal, and the Bluetooth receiving unit (16) of the holographic sound field recording communication device (1) receives the signal, and the signal is decoded by the decoding unit (17) and then input into the holographic sound field signal processing unit (13), holography. The sound field signal processing unit (13) outputs a signal to the playback signal processing unit (18), and further performs playback of the holographic sound field through the speaker unit (19).
- 如权利要求2所述的全息声场录音通讯装置(1)，特征在于：扬声器单元(19)为两个，该两个扬声器单元(19)分别与两个传声器单元(11)集合进耳塞中。A holographic sound field recording communication device (1) according to claim 2, characterized in that there are two speaker units (19), and the two speaker units (19) are respectively integrated into the earplugs with the two microphone units (11).
- 如权利要求2所述的全息声场录音通讯装置(1)，特征在于：扬声器单元(19)作为音箱的一部分。A holographic sound field recording communication device (1) according to claim 2, characterized in that the speaker unit (19) is part of a sound box.
- 如权利要求2-4之一所述的全息声场录音通讯装置(1)，特征在于：传声器单元(11)采集全息声场信号，经采集信号处理单元(12)至全息声场信号处理单元(13)，全息声场信号处理单元(13)将信号发送至重放信号处理单元(18)，再由扬声器(19)将全息声场信号进行重放从而实现监听回环。The holographic sound field recording communication device (1) according to any one of claims 2 to 4, characterized in that the microphone unit (11) collects the holographic sound field signal, and the collected signal processing unit (12) to the holographic sound field signal processing unit (13) The holographic sound field signal processing unit (13) transmits the signal to the playback signal processing unit (18), and the holographic sound field signal is reproduced by the speaker (19) to implement the monitor loopback.
- 如权利要求5所述的全息声场录音通讯装置(1)，特征在于：全息声场信号处理单元(13)可对全息声场信号进行增益控制、均衡、降噪、语音增强、听力校正中的一项或多项处理。The holographic sound field recording communication device (1) according to claim 5, wherein the holographic sound field signal processing unit (13) can perform one of gain control, equalization, noise reduction, speech enhancement, and hearing correction on the holographic sound field signal. Or multiple processing.
- 如权利要求5所述的全息声场录音通讯装置(1)，特征在于：该装置(1)可工作在录制模式、重放模式、监听模式下，该装置(1)上设有模式控制按钮。The holographic sound field recording communication device (1) according to claim 5, characterized in that the device (1) is operable in a recording mode, a playback mode, and a listening mode, and the device (1) is provided with a mode control button.
- 如权利要求5所述的全息声场录音通讯装置(1)，特征在于：全息音频录制重放装置可同时工作在录制模式和监听模式。A holographic sound field recording communication device (1) according to claim 5, wherein the holographic audio recording and reproducing apparatus is operable in both the recording mode and the listening mode.
- 一种全息声场录音通讯系统，包括在网络两端的如权利要求2-8所述的全息声场录音通讯装置(1)、外部终端(2)，网络一端的全息声场录音通讯装置(1)采集全息声场信号，通过蓝牙RFCOMM通道将全息声场信号上行传输到外部终端(2)，外部终端(2)藉由网络将全息声场信号发送至在网络另一端的外部终端(2)，再由该外部终端(2)将全息声场信号下行发送至网络另一端的全息声场录音通装置(1)，并由该另一端的全息声场录音通装置(1)重放全息声场信号；同样，网络另一端的全息声场录音通讯装置(1)及外部终端(2)也可藉由网络进行反向通讯。A holographic sound field recording communication system comprising a holographic sound field recording communication device (1) according to claims 2-8, an external terminal (2) at both ends of the network, and a holographic sound field recording communication device (1) at one end of the network for collecting holography The sound field signal transmits the holographic sound field signal to the external terminal (2) through the Bluetooth RFCOMM channel, and the external terminal (2) transmits the holographic sound field signal to the external terminal (2) at the other end of the network through the network, and then the external terminal (2) transmitting the holographic sound field signal to the holographic sound field recording device (1) at the other end of the network, and reproducing the holographic sound field signal by the holographic sound field recording device (1) at the other end; likewise, the hologram at the other end of the network The sound field recording communication device (1) and the external terminal (2) can also perform reverse communication via the network.
- 一种外部终端(2)，其包括蓝牙收发单元(21、22)、音频处理单元(23)、存储器、通讯模块，特征在于：还包括有配合如权利要求1-8所述的全息声场录音通讯装置(1)或如权利要求9所述的全息声场录音通讯系统或以上两者使用的应用程序(24)，其可通过外部终端的蓝牙收发单元(21、22)、音频处理单元(23)、存储器、通讯模块实现对全息声场的录制、重放、监听、分享、通讯的控制，以及控制音频处理单元(23)对全息声场信号进行增益控制、均衡、降噪、语音增强、听力校正中的一项或多项处理。 An external terminal (2) comprising a Bluetooth transceiver unit (21, 22), an audio processing unit (23), a memory, a communication module, characterized by further comprising a holographic sound field recording according to claims 1-8 Communication device (1) or holographic sound field recording communication system according to claim 9 or an application (24) used by both, which can pass through a Bluetooth transceiver unit (21, 22) of an external terminal, and an audio processing unit (23) , memory, communication module to achieve recording, playback, monitoring, sharing, communication control of the holographic sound field, and control audio processing unit (23) for holographic sound field signal gain control, equalization, noise reduction, speech enhancement, hearing correction One or more of the processing.
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201610685223.5A CN106126185A (en) | 2016-08-18 | 2016-08-18 | A kind of holographic sound field recording communication Apparatus and system based on bluetooth |
| CN201610685223.5 | 2016-08-18 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2018032587A1 true WO2018032587A1 (en) | 2018-02-22 |
Family
ID=57278690
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/CN2016/100754 WO2018032587A1 (en) | 2016-08-18 | 2016-09-29 | Bluetooth-based holographic sound field recording communication device and system |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN106126185A (en) |
| WO (1) | WO2018032587A1 (en) |
Families Citing this family (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106792367A (en) * | 2016-12-15 | 2017-05-31 | 北京塞宾科技有限公司 | A kind of holographic sound field sound pick-up outfit |
| CN106601262A (en) * | 2016-12-15 | 2017-04-26 | 北京塞宾科技有限公司 | High definition Bluetooth audio frequency transmitting and receiving terminal and communication system |
| CN106792349A (en) * | 2016-12-15 | 2017-05-31 | 北京塞宾科技有限公司 | A kind of triple channel holography sound field sound pick-up outfit |
| CN106658250A (en) * | 2017-02-06 | 2017-05-10 | 张德明 | Binaural recording device |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103190158A (en) * | 2010-10-25 | 2013-07-03 | 高通股份有限公司 | Systems, methods, apparatus, and computer-readable media for head tracking based on recorded sound signals |
| CN103634561A (en) * | 2012-08-21 | 2014-03-12 | 徐丙川 | Conference communication device and system |
| CN104168534A (en) * | 2014-09-01 | 2014-11-26 | 北京塞宾科技有限公司 | Holographic audio device and control method |
| CN104217750A (en) * | 2014-09-01 | 2014-12-17 | 北京塞宾科技有限公司 | A holographic audio record and playback method |
| WO2016050298A1 (en) * | 2014-10-01 | 2016-04-07 | Binauric SE | Audio terminal |
-
2016
- 2016-08-18 CN CN201610685223.5A patent/CN106126185A/en active Pending
- 2016-09-29 WO PCT/CN2016/100754 patent/WO2018032587A1/en active Application Filing
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103190158A (en) * | 2010-10-25 | 2013-07-03 | 高通股份有限公司 | Systems, methods, apparatus, and computer-readable media for head tracking based on recorded sound signals |
| CN103634561A (en) * | 2012-08-21 | 2014-03-12 | 徐丙川 | Conference communication device and system |
| CN104168534A (en) * | 2014-09-01 | 2014-11-26 | 北京塞宾科技有限公司 | Holographic audio device and control method |
| CN104217750A (en) * | 2014-09-01 | 2014-12-17 | 北京塞宾科技有限公司 | A holographic audio record and playback method |
| WO2016050298A1 (en) * | 2014-10-01 | 2016-04-07 | Binauric SE | Audio terminal |
Also Published As
| Publication number | Publication date |
|---|---|
| CN106126185A (en) | 2016-11-16 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9071900B2 (en) | Multi-channel recording | |
| AU2008362920B2 (en) | Method of rendering binaural stereo in a hearing aid system and a hearing aid system | |
| WO2018032587A1 (en) | Bluetooth-based holographic sound field recording communication device and system | |
| US20130044884A1 (en) | Apparatus and Method for Multi-Channel Signal Playback | |
| WO2016033919A1 (en) | Holographic audio recording and playback method | |
| CN110602594A (en) | Earphone device with specific environment sound reminding mode | |
| JP2009509185A (en) | Audio data processing apparatus and method for synchronous audio data processing | |
| WO2019191950A1 (en) | Earphones noise reduction method and apparatus, master earphone, slave earphone, and earphones noise reduction system | |
| WO2016033918A1 (en) | Holographic audio device and control method | |
| JP2011512745A (en) | Acoustic system and method for providing sound | |
| US20190019495A1 (en) | Sound output device, sound output method, program, and sound system | |
| EP3228096B1 (en) | Audio terminal | |
| US20220369034A1 (en) | Method and system for switching wireless audio connections during a call | |
| CN106170108B (en) | Earphone device with decibel reminding mode | |
| CN110636402A (en) | Earphone device with local call condition confirmation mode | |
| US20230075802A1 (en) | Capturing and synchronizing data from multiple sensors | |
| JP2010506519A (en) | Processing and apparatus for obtaining, transmitting and playing sound events for the communications field | |
| CN111246331A (en) | Wireless panorama sound mixing sound earphone | |
| WO2016045233A1 (en) | Communication device capable of collecting acoustic field information and communication method | |
| WO2016033920A1 (en) | Video and audio acquisition method | |
| US20220368554A1 (en) | Method and system for processing remote active speech during a call | |
| JP5538249B2 (en) | Stereo headset | |
| JP2023554650A (en) | Sensor management for wireless devices | |
| CN206619124U (en) | A kind of holographic sound field recording communication device, system and exterior terminal based on bluetooth | |
| US20170094412A1 (en) | Wearable recording and playback system |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 16913342 Country of ref document: EP Kind code of ref document: A1 |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| 122 | Ep: pct application non-entry in european phase |
Ref document number: 16913342 Country of ref document: EP Kind code of ref document: A1 |