WO2016033920A1 - Video and audio acquisition method - Google Patents

Video and audio acquisition method Download PDF

Info

Publication number
WO2016033920A1
WO2016033920A1 PCT/CN2015/000559 CN2015000559W WO2016033920A1 WO 2016033920 A1 WO2016033920 A1 WO 2016033920A1 CN 2015000559 W CN2015000559 W CN 2015000559W WO 2016033920 A1 WO2016033920 A1 WO 2016033920A1
Authority
WO
WIPO (PCT)
Prior art keywords
video
signal
holographic
sound field
processing unit
Prior art date
Application number
PCT/CN2015/000559
Other languages
French (fr)
Chinese (zh)
Inventor
张德明
Original Assignee
北京塞宾科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 北京塞宾科技有限公司 filed Critical 北京塞宾科技有限公司
Publication of WO2016033920A1 publication Critical patent/WO2016033920A1/en

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast

Definitions

  • the invention relates to a video audio collecting method.
  • the sound quality of the built-in microphone is generally not high.
  • the external microphone can provide higher quality, but the spatial resolution capability is not good.
  • the spatial surround sound capsule microphone can provide some spatial sound field resolution capabilities for the camera, but overall the spatial resolution is still very weak, and the spatial positioning ability is poor.
  • the mobile devices represented by mobile phones have exploded, and mobile-based video shooting has even reached HD, but the sound quality recorded based on its built-in single-channel or dual-channel microphone is very poor.
  • some mobile phone recording accessories have appeared. Can provide high-quality recording quality, but the spatial resolution is still poor.
  • the sound quality of several typical video capture devices is very poor.
  • Single-microphone recording is the easiest, but the sound field is also the most monotonous.
  • the original intention of stereo recording is to create a richer stereo field.
  • There are various ways to configure the microphone which are all trying to simulate the perception of the human ear. For example, delay, amplitude difference, phase, etc., but it is difficult to achieve the real human ear perception by simply placing the position of the microphone.
  • the simulated head recording can realize the realistic expression of the immersed three-dimensional sound field, but it is still mainly used in some professional laboratories as a testing tool. For a wide range of audio and video recording, it is extremely inconvenient to use and extremely expensive ( The simulation head, recording equipment, processing equipment, etc.
  • the current simulation head is mainly used for the test of communication equipment, not for the purpose of human stereo field perception, its texture and structure. There is still a big difference with the real human head, and these differences will ultimately affect the recorded sound field effect.
  • a video audio collecting method is characterized in that: the holographic audio collecting device comprises a microphone unit, an acquisition signal processing module, a holographic sound field signal processing unit, a source coding module, and the microphone unit collects a three-dimensional sound field signal and acquires a signal.
  • the processing module processes the acquired signal and converts it into a digital signal, and the digital signal is input to the holographic sound field signal processing unit, and the holographic sound field signal processing unit processes the sound field signal, and the processed signal is compressed by the source code and sent to the network through the network to Video capture device.
  • the video collection device comprises a camera unit and a video acquisition signal processing unit, and the signal collected by the camera unit is input to the video acquisition signal processing unit, and the video signal acquisition processing unit receives the signal transmitted by the holographic audio collection device through the network.
  • the holographic audio collection device and the video capture device are integrated, and the source coding module of the holographic audio collection device is connected with the video acquisition signal processing unit of the video capture device, and the signal output by the holographic audio collection device is directly transmitted to the video capture device.
  • the video capture device can transmit the video signal and the holographic sound field signal over a network to a remote device.
  • the video capture device can be a cell phone, a video camera, a surveillance camera, or a lens that can be used for video capture.
  • the invention has a holographic audio collection device, which comprises a microphone unit, an acquisition signal processing module, a holographic sound field signal processing unit and a source coding module, the microphone unit collects a three-dimensional sound field signal, and the holographic sound field signal processing unit processes the sound field signal. After the processed signal is compressed by the source code, it can be sent to the video capture device through the network.
  • the holographic audio capture device and the video capture device can also be integrated, and the signal output by the holographic audio capture device is directly transmitted to the video capture device.
  • the invention collects the holographic sound field signal for the video device through the holographic audio collecting device, thereby effectively improving the audio quality of the video collecting device.
  • the video capture device of the present invention may be a mobile phone, a video camera, a surveillance camera or For glasses for video shooting, the video capture device can transmit the video signal and the holographic sound field signal to the remote device through the network, which is further convenient for the user.
  • FIG. 1 is a circuit block diagram of a holographic audio collection device and a video capture device of the present invention when connected through a network;
  • FIG. 2 is a circuit block diagram of the holographic audio collection device of the present invention integrated with the video capture device according to the present invention
  • Figure 3 is a schematic view showing the working state of the first embodiment
  • Figure 4 is a schematic view showing the working state of the second embodiment
  • Fig. 5 is a schematic view showing the working state of the third embodiment.
  • the holographic audio collection device includes a microphone unit, an acquisition signal processing module, a holographic sound field signal processing unit, and a source coding module.
  • the microphone unit includes an earphone-based or artificial head-based, but is not limited thereto.
  • the microphone unit collects a three-dimensional sound field signal, and the acquisition signal processing module processes the acquired signal and converts it into a digital signal.
  • the digital signal is input to the holographic sound field signal processing unit, and the holographic sound field signal processing unit processes the sound field signal, and the processed signal is processed. After the source code is compressed, it is sent to the video capture device through the network.
  • the video collection device comprises a camera unit and a video acquisition signal processing unit, and the signal collected by the camera unit is input to the video acquisition signal processing unit, and the video signal acquisition processing unit receives the signal transmitted by the holographic audio collection device through the network.
  • the video capture device can transmit the video signal and the holographic sound field signal over a network to a remote device.
  • the holographic audio collection device and the video capture device may be integrated, and the source coding module of the holographic audio collection device is connected with the video acquisition signal processing unit of the video capture device, and the signal output by the holographic audio collection device is directly transmitted to the video. Acquisition device.
  • the video capture device can transmit the video signal and the holographic sound field signal over a network to a remote device.
  • the video capture device can be a cell phone, a video camera, a surveillance camera, or a lens that can be used for video capture.
  • the video capture device is a mobile phone 1.
  • the video recording of the mobile phone does not use the built-in microphone of the mobile phone, but uses a holographic audio recording microphone, that is, the audio track of the video is holographic audio.
  • the holographic audio capture device 2 transmits the holographic sound field signal to the handset via the network.
  • the mobile phone 1 can also take photos with sound field audio information recorded by a holographic audio microphone.
  • the captured video containing the holographic sound field can be stored in the mobile phone 1 or transmitted to the remote user for viewing through the network. When stored in the mobile phone 1, it can be played back through the mobile phone software, allowing the user to enjoy the video with the holographic sound field.
  • the video device is a lens capable of video capturing
  • the microphone 3 capable of collecting a three-dimensional sound field signal
  • the holographic audio collecting device and the video capturing device are integrated.
  • Holographic sound field acquisition is based Performed on the holographic microphone 3 on the temples.
  • the control of the glasses and the storage of the audio and video recordings can be performed either directly on the glasses or via the mobile phone 4.
  • the glasses can also be used without a camera or without a camera. In this case, the sound field can be recorded by means of a holographic sound field microphone.
  • the position A camera When used for video or photo shooting, it can be based on the position A camera (this camera can be on the left or right side, or both sides), or it can be based on the position B camera, or based on The camera in position C is shooting.
  • the captured video or photo containing the holographic sound field can be stored on the glasses or mobile phone, or transmitted to the remote user via the network for real-time or offline viewing.
  • the video capture device is a surveillance camera 5, and the holographic audio capture device and the video capture device are integrated.
  • the video monitoring with the holographic sound field positioning can be performed.
  • the monitoring camera collects the monitoring video, and the holographic sound field microphone 6 synchronously collects the holographic sound field, and then uniformly encodes the video stream to the far end through the network.
  • the pan/tilt rotation function of the surveillance camera 5 requires the holographic sound field microphone 6 to rotate synchronously with the camera.

Abstract

The present invention relates to a video and audio acquisition method; provided is a holographic audio acquisition device; the holographic audio acquisition device comprises a microphone unit, an acquired-signal processing module, a holographic sound field signal processing unit, and a source coding module; the microphone unit acquires a three-dimensional sound field signal; an acquired-signal processing module processes the acquired signal and converts same to a digital signal; said digital signal is inputted to the holographic sound field signal processing unit; the holographic sound field signal processing unit processes the sound field signal; the processed signal is source-coded and compressed, and sent to a video acquisition device by means of a network.

Description

一种视频音频采集方法Video audio collection method 技术领域Technical field
本发明涉及一种视频音频采集方法。The invention relates to a video audio collecting method.
背景技术Background technique
现有技术中，在很多设备视频录制回放中是没有声场的采集回放及控制功能的，导致视频体验整体不佳。通常的情况是，与视频采集相伴的是单声道或者普通立体声采集，虽然视频已经在很多设备上具备了高清的解析度，但声场的解析度远远达不到很高的临场感。In the prior art, in the video recording and playback of many devices, there is no acquisition, playback and control function of the sound field, resulting in a poor overall video experience. Usually, video capture is accompanied by mono or normal stereo capture. Although the video has high-definition resolution on many devices, the resolution of the sound field is far from high.
传统摄像机一般注重高质量视频的拍摄，对于声音的采集，一般情况下其内置的麦克风声音质量不高，外置的麦克风可以提供高一些的质量，但是空间解析能力不行。近来出现的空间环绕声胶囊麦克风可以为摄像机提供一些空间声场解析能力，但整体而言空间解析力还非常弱，空间定位能力较差。Traditional cameras generally focus on high-quality video capture. For sound collection, the sound quality of the built-in microphone is generally not high. The external microphone can provide higher quality, but the spatial resolution capability is not good. Recently, the spatial surround sound capsule microphone can provide some spatial sound field resolution capabilities for the camera, but overall the spatial resolution is still very weak, and the spatial positioning ability is poor.
目前以手机为代表的移动设备爆发增长，基于手机的视频拍摄甚至也到了高清，但基于其内置单通道或者双通道麦克风录制的声音质量非常差，当然，后来也出现了一些手机的录音配件，可以提供高点的录音质量，但是空间解析能力仍然很差。At present, the mobile devices represented by mobile phones have exploded, and mobile-based video shooting has even reached HD, but the sound quality recorded based on its built-in single-channel or dual-channel microphone is very poor. Of course, some mobile phone recording accessories have appeared. Can provide high-quality recording quality, but the spatial resolution is still poor.
在视频监控领域，大都是只有视频没有音频，即使少部分视频监控设备有了音频采集的能力，但是一直没有很好地声音定位能力，而在视频监控领域声音定位能力是十分重要的。In the field of video surveillance, most of the video only has no audio. Even if a small number of video surveillance devices have the ability to collect audio, there is no good sound localization capability, and the sound localization capability in the video surveillance field is very important.
除了手机，近来穿戴式设备也日益流行，其中基于眼镜的视频拍摄也非常流行，其中的音频采集质量也是特别的差。In addition to mobile phones, wearable devices have become increasingly popular recently, and eye-based video capture is also very popular, and the audio capture quality is particularly poor.
综上所述，当前几种典型的视频采集装置的声音质量，特别是空间解析质量很差。In summary, the sound quality of several typical video capture devices, especially the spatial resolution quality, is very poor.
传统录音方法包括单麦克录音、立体声录音(AB、XY、MS、ORTF)。单麦克录音最为简便，但是声场也最为单调；立体声录音的初衷是营造更为丰富的立体声场，在麦克风配置上出现了多种多样的方式，都是试图模拟人的两耳对声音的感知特性，比如延时、幅度差异、相位等，然而只是靠麦克风摆放位置是难以达到模拟真正的人耳感知的。仿真人头录音能够实现浸入式三维声场的逼真体现，但目前主要还是存在于一些专业实验室作为测试工具使用，对于广泛的音频视频录制来说，一是极为不方便使用，同时也是极为昂贵的(包含仿真人头、录音设备、处理设备等一套需要100万欧元左右)，另外，目前的仿真人头主要应用于通信器材的测试，并非为了人耳立体声场感知的目的制作的，它的质地、结构与真实人头还是存在很大的差异，这些差异会最终影响所录制的声场效果。 Traditional recording methods include single mic recording, stereo recording (AB, XY, MS, ORTF). Single-microphone recording is the easiest, but the sound field is also the most monotonous. The original intention of stereo recording is to create a richer stereo field. There are various ways to configure the microphone, which are all trying to simulate the perception of the human ear. For example, delay, amplitude difference, phase, etc., but it is difficult to achieve the real human ear perception by simply placing the position of the microphone. The simulated head recording can realize the realistic expression of the immersed three-dimensional sound field, but it is still mainly used in some professional laboratories as a testing tool. For a wide range of audio and video recording, it is extremely inconvenient to use and extremely expensive ( The simulation head, recording equipment, processing equipment, etc. need about 1 million euros. In addition, the current simulation head is mainly used for the test of communication equipment, not for the purpose of human stereo field perception, its texture and structure. There is still a big difference with the real human head, and these differences will ultimately affect the recorded sound field effect.
另一方面，移动宽带的迅猛发展，普通消费者的手机、平板电脑等常用工具除了打电话之外都有了音频视频录制能力，以及很多的数码产品诸如录音笔、可摄像的相机等大多数情况下这些设备都是基于内部麦克风来录制声音的，这些内置麦克风一方面音质比较差，同时声场展现能力也非常差。On the other hand, with the rapid development of mobile broadband, ordinary consumers' mobile phones, tablets and other common tools have audio and video recording capabilities in addition to making calls, as well as many digital products such as voice recorders and camera cameras. In the case of these devices, the sound is recorded based on an internal microphone. On the one hand, the built-in microphones have poor sound quality and the sound field display capability is also very poor.
目前也出现了一些为手机等设备提供立体声录音的接口设备，这些设备接口离上述专业立体声麦克风还有很大距离，更谈不上浸入式三维声场了。At present, there are also some interface devices that provide stereo recording for mobile phones and other devices. These device interfaces are far away from the above professional stereo microphones, let alone the immersive three-dimensional sound field.
发明内容Summary of the invention
本发明的发明目的在于提供一种视频音频采集方法，能够为视频装置采集全息声场信号。It is an object of the present invention to provide a video and audio collection method capable of acquiring a holographic sound field signal for a video device.
实现本发明目的的技术方案：Technical solution for achieving the object of the present invention:
一种视频音频采集方法，其特征在于：具有全息音频采集装置，全息音频采集装置包括麦克风单元、采集信号处理模块、全息声场信号处理单元、信源编码模块，麦克风单元采集三维声场信号，采集信号处理模块对采集信号进行处理并转换成数字信号，前述数字信号输入至全息声场信号处理单元，全息声场信号处理单元对声场信号进行处理，处理后的信号经信源编码压缩后，通过网络发送至视频采集装置。A video audio collecting method is characterized in that: the holographic audio collecting device comprises a microphone unit, an acquisition signal processing module, a holographic sound field signal processing unit, a source coding module, and the microphone unit collects a three-dimensional sound field signal and acquires a signal. The processing module processes the acquired signal and converts it into a digital signal, and the digital signal is input to the holographic sound field signal processing unit, and the holographic sound field signal processing unit processes the sound field signal, and the processed signal is compressed by the source code and sent to the network through the network to Video capture device.
视频采集装置包括摄像头单元和视频采集信号处理单元，摄像头单元采集的信号输入至视频采集信号处理单元，视频信号采集处理单元通过网络接收全息音频采集装置传送的信号。The video collection device comprises a camera unit and a video acquisition signal processing unit, and the signal collected by the camera unit is input to the video acquisition signal processing unit, and the video signal acquisition processing unit receives the signal transmitted by the holographic audio collection device through the network.
全息音频采集装置和视频采集装置呈一体，全息音频采集装置的信源编码模块与视频采集装置的视频采集信号处理单元连接，全息音频采集装置输出的信号直接传送至视频采集装置。The holographic audio collection device and the video capture device are integrated, and the source coding module of the holographic audio collection device is connected with the video acquisition signal processing unit of the video capture device, and the signal output by the holographic audio collection device is directly transmitted to the video capture device.
视频采集装置可将视频信号和全息声场信号通过网络发送至远端的设备。The video capture device can transmit the video signal and the holographic sound field signal over a network to a remote device.
视频采集装置可以是手机、摄像机、监控摄像头或者是可进行视频拍摄的眼镜。The video capture device can be a cell phone, a video camera, a surveillance camera, or a lens that can be used for video capture.
本发明具有的有益效果：The invention has the beneficial effects:
本发明具有全息音频采集装置，全息音频采集装置包括麦克风单元、采集信号处理模块、全息声场信号处理单元、信源编码模块，麦克风单元采集三维声场信号，全息声场信号处理单元对声场信号进行处理，处理后的信号经信源编码压缩后，可以通过网络发送至视频采集装置。全息音频采集装置和视频采集装置也可以呈一体，全息音频采集装置输出的信号直接传送至视频采集装置。本发明通过全息音频采集装置为视频装置采集全息声场信号，有效提高视频采集装置的音频品质。本发明视频采集装置可以是手机、摄像机、监控摄像头或者是可 进行视频拍摄的眼镜，视频采集装置可将视频信号和全息声场信号通过网络发送至远端的设备，进一步方便用户的使用。The invention has a holographic audio collection device, which comprises a microphone unit, an acquisition signal processing module, a holographic sound field signal processing unit and a source coding module, the microphone unit collects a three-dimensional sound field signal, and the holographic sound field signal processing unit processes the sound field signal. After the processed signal is compressed by the source code, it can be sent to the video capture device through the network. The holographic audio capture device and the video capture device can also be integrated, and the signal output by the holographic audio capture device is directly transmitted to the video capture device. The invention collects the holographic sound field signal for the video device through the holographic audio collecting device, thereby effectively improving the audio quality of the video collecting device. The video capture device of the present invention may be a mobile phone, a video camera, a surveillance camera or For glasses for video shooting, the video capture device can transmit the video signal and the holographic sound field signal to the remote device through the network, which is further convenient for the user.
附图说明DRAWINGS
图1是本发明全息音频采集装置与视频采集装置通过网络连接时的电路原理框图；1 is a circuit block diagram of a holographic audio collection device and a video capture device of the present invention when connected through a network;
图2是本发明本发明全息音频采集装置与视频采集装置呈一体时的电路原理框图；2 is a circuit block diagram of the holographic audio collection device of the present invention integrated with the video capture device according to the present invention;
图3是实施例一的工作状态示意图；Figure 3 is a schematic view showing the working state of the first embodiment;
图4是实施例二的工作状态示意图；Figure 4 is a schematic view showing the working state of the second embodiment;
图5是实施例三的工作状态示意图。Fig. 5 is a schematic view showing the working state of the third embodiment.
具体实施方式detailed description
如图1所示，全息音频采集装置包括麦克风单元、采集信号处理模块、全息声场信号处理单元、信源编码模块，麦克风单元包括基于耳机的或者基于人工头的，但不限于此。麦克风单元采集三维声场信号，采集信号处理模块对采集信号进行处理并转换成数字信号，前述数字信号输入至全息声场信号处理单元，全息声场信号处理单元对声场信号进行处理，处理后的信号经信源编码压缩后，通过网络发送至视频采集装置。视频采集装置包括摄像头单元和视频采集信号处理单元，摄像头单元采集的信号输入至视频采集信号处理单元，视频信号采集处理单元通过网络接收全息音频采集装置传送的信号。视频采集装置可将视频信号和全息声场信号通过网络发送至远端的设备。As shown in FIG. 1, the holographic audio collection device includes a microphone unit, an acquisition signal processing module, a holographic sound field signal processing unit, and a source coding module. The microphone unit includes an earphone-based or artificial head-based, but is not limited thereto. The microphone unit collects a three-dimensional sound field signal, and the acquisition signal processing module processes the acquired signal and converts it into a digital signal. The digital signal is input to the holographic sound field signal processing unit, and the holographic sound field signal processing unit processes the sound field signal, and the processed signal is processed. After the source code is compressed, it is sent to the video capture device through the network. The video collection device comprises a camera unit and a video acquisition signal processing unit, and the signal collected by the camera unit is input to the video acquisition signal processing unit, and the video signal acquisition processing unit receives the signal transmitted by the holographic audio collection device through the network. The video capture device can transmit the video signal and the holographic sound field signal over a network to a remote device.
如图2所示，全息音频采集装置和视频采集装置可以呈一体，全息音频采集装置的信源编码模块与视频采集装置的视频采集信号处理单元连接，全息音频采集装置输出的信号直接传送至视频采集装置。As shown in FIG. 2, the holographic audio collection device and the video capture device may be integrated, and the source coding module of the holographic audio collection device is connected with the video acquisition signal processing unit of the video capture device, and the signal output by the holographic audio collection device is directly transmitted to the video. Acquisition device.
视频采集装置可将视频信号和全息声场信号通过网络发送至远端的设备。The video capture device can transmit the video signal and the holographic sound field signal over a network to a remote device.
视频采集装置可以是手机、摄像机、监控摄像头或者是可进行视频拍摄的眼镜。The video capture device can be a cell phone, a video camera, a surveillance camera, or a lens that can be used for video capture.
实施例一，如图3所示，视频采集装置是手机1。手机的视频录制，不使用手机内置麦克风，而使用全息音频录音麦克风，即视频的音轨是全息音频。全息音频采集装置2通过网络将全息声场信号传送至手机。手机1还可拍摄照片，同时配有全息音频麦克风录制的声场音频信息。所拍摄包含全息声场的视频可以存储于手机1，也可以通过网络传输到远端用户进行欣赏。当存储在手机1时，可以通过手机软件进行回放，让用户欣赏带有包含全息声场的视频。 Embodiment 1 As shown in FIG. 3, the video capture device is a mobile phone 1. The video recording of the mobile phone does not use the built-in microphone of the mobile phone, but uses a holographic audio recording microphone, that is, the audio track of the video is holographic audio. The holographic audio capture device 2 transmits the holographic sound field signal to the handset via the network. The mobile phone 1 can also take photos with sound field audio information recorded by a holographic audio microphone. The captured video containing the holographic sound field can be stored in the mobile phone 1 or transmitted to the remote user for viewing through the network. When stored in the mobile phone 1, it can be played back through the mobile phone software, allowing the user to enjoy the video with the holographic sound field.
实施例二，如图4所示，视频装置是可进行视频拍摄的眼镜，可采集三维声场信号的麦克风3设置于眼镜上，全息音频采集装置和视频采集装置呈一体。全息声场的采集是基 于眼镜腿上的全息麦克风3进行的。对于眼镜的控制及音视频录制的存储既可以在眼镜上直接进行，也可以通过手机4进行。眼镜也可以没有摄像头或者不用摄像头，此时可以借助全息声场麦克风进行声场录制。当用来进行视频或照片的拍摄时，可以基于位置A的摄像头(这个摄像头可以在左边也可以在右边，也可以左右两边都有)进行拍摄，也可以基于位置B的摄像头拍摄，也可以基于位置C的摄像头进行拍摄。所拍摄包含全息声场的视频或照片既可以存储在眼镜或手机上，也可以通过网络传输到远端用户进行实时或离线的欣赏。 Embodiment 2 As shown in FIG. 4, the video device is a lens capable of video capturing, the microphone 3 capable of collecting a three-dimensional sound field signal is disposed on the glasses, and the holographic audio collecting device and the video capturing device are integrated. Holographic sound field acquisition is based Performed on the holographic microphone 3 on the temples. The control of the glasses and the storage of the audio and video recordings can be performed either directly on the glasses or via the mobile phone 4. The glasses can also be used without a camera or without a camera. In this case, the sound field can be recorded by means of a holographic sound field microphone. When used for video or photo shooting, it can be based on the position A camera (this camera can be on the left or right side, or both sides), or it can be based on the position B camera, or based on The camera in position C is shooting. The captured video or photo containing the holographic sound field can be stored on the glasses or mobile phone, or transmitted to the remote user via the network for real-time or offline viewing.
实施例三，如图5所示，视频采集装置是监控摄像头5，全息音频采集装置和视频采集装置呈一体。把全息声场加入传统视频监控之后，就可以进行带有全息声场定位的视频监控了，监控摄像头采集监控视频，全息声场麦克风6同步采集全息声场，然后统一编码成视频流通过网络传输到远端。监控摄像头5所具有的云台转动功能要求全息声场麦克风6与摄像头同步转动。 Embodiment 3 As shown in FIG. 5, the video capture device is a surveillance camera 5, and the holographic audio capture device and the video capture device are integrated. After the holographic sound field is added to the traditional video monitoring, the video monitoring with the holographic sound field positioning can be performed. The monitoring camera collects the monitoring video, and the holographic sound field microphone 6 synchronously collects the holographic sound field, and then uniformly encodes the video stream to the far end through the network. The pan/tilt rotation function of the surveillance camera 5 requires the holographic sound field microphone 6 to rotate synchronously with the camera.

Claims (5)

  1. 一种视频音频采集方法，其特征在于：具有全息音频采集装置，全息音频采集装置包括麦克风单元、采集信号处理模块、全息声场信号处理单元、信源编码模块，麦克风单元采集三维声场信号，采集信号处理模块对采集信号进行处理并转换成数字信号，前述数字信号输入至全息声场信号处理单元，全息声场信号处理单元对声场信号进行处理，处理后的信号经信源编码压缩后，通过网络发送至视频采集装置。A video audio collecting method is characterized in that: the holographic audio collecting device comprises a microphone unit, an acquisition signal processing module, a holographic sound field signal processing unit, a source coding module, and the microphone unit collects a three-dimensional sound field signal and acquires a signal. The processing module processes the acquired signal and converts it into a digital signal, and the digital signal is input to the holographic sound field signal processing unit, and the holographic sound field signal processing unit processes the sound field signal, and the processed signal is compressed by the source code and sent to the network through the network to Video capture device.
  2. 根据权利要求1所述的方法，其特征在于：视频采集装置包括摄像头单元和视频采集信号处理单元，摄像头单元采集的信号输入至视频采集信号处理单元，视频信号采集处理单元通过网络接收全息音频采集装置传送的信号。The method according to claim 1, wherein the video collection device comprises a camera unit and a video acquisition signal processing unit, wherein the signal collected by the camera unit is input to the video acquisition signal processing unit, and the video signal acquisition and processing unit receives the holographic audio collection through the network. The signal transmitted by the device.
  3. 根据权利要求2所述的方法，其特征在于：全息音频采集装置和视频采集装置呈一体，全息音频采集装置的信源编码模块与视频采集装置的视频采集信号处理单元连接，全息音频采集装置输出的信号直接传送至视频采集装置。The method according to claim 2, wherein the holographic audio collection device and the video collection device are integrated, and the source coding module of the holographic audio collection device is connected with the video acquisition signal processing unit of the video capture device, and the holographic audio collection device outputs The signal is sent directly to the video capture device.
  4. 根据权利要求3所述的方法，其特征在于：视频采集装置可将视频信号和全息声场信号通过网络发送至远端的设备。The method of claim 3 wherein the video capture device transmits the video signal and the holographic sound field signal over a network to the remote device.
  5. 根据权利要求1至4任何一项所述的方法，其特征在于：视频采集装置可以是手机、摄像机、监控摄像头或者是可进行视频拍摄的眼镜。 The method according to any one of claims 1 to 4, characterized in that the video capture device can be a mobile phone, a video camera, a surveillance camera or an eyeglass that can perform video capture.
PCT/CN2015/000559 2014-09-01 2015-08-04 Video and audio acquisition method WO2016033920A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201410440366.0 2014-09-01
CN201410440366.0A CN104168465A (en) 2014-09-01 2014-09-01 Video and audio collecting method

Publications (1)

Publication Number Publication Date
WO2016033920A1 true WO2016033920A1 (en) 2016-03-10

Family

ID=51912070

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2015/000559 WO2016033920A1 (en) 2014-09-01 2015-08-04 Video and audio acquisition method

Country Status (2)

Country Link
CN (1) CN104168465A (en)
WO (1) WO2016033920A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112770212A (en) * 2021-01-07 2021-05-07 深圳市天诺泰科技有限公司 Wireless earphone, video recording system and method, and storage medium

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104168465A (en) * 2014-09-01 2014-11-26 北京塞宾科技有限公司 Video and audio collecting method
CN104283697A (en) * 2014-09-28 2015-01-14 北京塞宾科技有限公司 Communication device and method capable of acquiring sound field information

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101237567A (en) * 2007-01-29 2008-08-06 索尼株式会社 Network device, sound data transmission method, monitoring device and camera system
CN101500169A (en) * 2009-03-10 2009-08-05 武汉大学 Multiplex audio/video compression transmission server
CN102082991A (en) * 2010-11-24 2011-06-01 蔡庸成 Method specially designed for earphone audition and used for simulating field holographic audio frequency
CN103501408A (en) * 2013-09-23 2014-01-08 深圳市欧珀通信软件有限公司 Method and system for photographing video clips through mobile terminal
CN104168534A (en) * 2014-09-01 2014-11-26 北京塞宾科技有限公司 Holographic audio device and control method
CN104168465A (en) * 2014-09-01 2014-11-26 北京塞宾科技有限公司 Video and audio collecting method
CN104217750A (en) * 2014-09-01 2014-12-17 北京塞宾科技有限公司 A holographic audio record and playback method
CN104284268A (en) * 2014-09-28 2015-01-14 北京塞宾科技有限公司 Earphone capable of acquiring data information and data acquisition method
CN104283697A (en) * 2014-09-28 2015-01-14 北京塞宾科技有限公司 Communication device and method capable of acquiring sound field information
CN204377136U (en) * 2015-02-16 2015-06-03 北京塞宾科技有限公司 A kind of holographic audio frequency gathers playback reproducer

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101237567A (en) * 2007-01-29 2008-08-06 索尼株式会社 Network device, sound data transmission method, monitoring device and camera system
CN101500169A (en) * 2009-03-10 2009-08-05 武汉大学 Multiplex audio/video compression transmission server
CN102082991A (en) * 2010-11-24 2011-06-01 蔡庸成 Method specially designed for earphone audition and used for simulating field holographic audio frequency
CN103501408A (en) * 2013-09-23 2014-01-08 深圳市欧珀通信软件有限公司 Method and system for photographing video clips through mobile terminal
CN104168534A (en) * 2014-09-01 2014-11-26 北京塞宾科技有限公司 Holographic audio device and control method
CN104168465A (en) * 2014-09-01 2014-11-26 北京塞宾科技有限公司 Video and audio collecting method
CN104217750A (en) * 2014-09-01 2014-12-17 北京塞宾科技有限公司 A holographic audio record and playback method
CN104284268A (en) * 2014-09-28 2015-01-14 北京塞宾科技有限公司 Earphone capable of acquiring data information and data acquisition method
CN104283697A (en) * 2014-09-28 2015-01-14 北京塞宾科技有限公司 Communication device and method capable of acquiring sound field information
CN204377136U (en) * 2015-02-16 2015-06-03 北京塞宾科技有限公司 A kind of holographic audio frequency gathers playback reproducer

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112770212A (en) * 2021-01-07 2021-05-07 深圳市天诺泰科技有限公司 Wireless earphone, video recording system and method, and storage medium
CN112770212B (en) * 2021-01-07 2022-07-22 深圳市天诺泰科技有限公司 Wireless earphone, video recording system and method, and storage medium

Also Published As

Publication number Publication date
CN104168465A (en) 2014-11-26

Similar Documents

Publication Publication Date Title
WO2016033919A1 (en) Holographic audio recording and playback method
WO2016033918A1 (en) Holographic audio device and control method
TWI602437B (en) Video and audio processing devices and video conference system
US20170047076A1 (en) Method and device for achieving object audio recording and electronic apparatus
JP6252849B2 (en) Imaging apparatus and method
KR20120053006A (en) Improved audio/video methods and systems
CN109257559A (en) A kind of image display method, device and the video conferencing system of panoramic video meeting
US10254842B2 (en) Controlling a device based on facial expressions of a user
WO2016088602A1 (en) Information processing device, information processing method, and program
WO2021197020A1 (en) Audio processing method and apparatus, readable medium, and electronic device
CN111970625B (en) Recording method and device, terminal and storage medium
WO2016033920A1 (en) Video and audio acquisition method
US10306142B2 (en) Headset
JPWO2017154411A1 (en) IMAGING DEVICE, ELECTRONIC DEVICE, AND IMAGING SYSTEM
CN104065951A (en) Video shooting method, video playing method and intelligent glasses
US10788888B2 (en) Capturing and rendering information involving a virtual environment
WO2018032587A1 (en) Bluetooth-based holographic sound field recording communication device and system
CN114466283A (en) Audio acquisition method and device, electronic equipment and peripheral component method
JP2023539774A (en) Sound box positioning method, audio rendering method, and device
Maempel et al. The virtual concert hall: a research tool for the experimental investigation of audiovisual room perception
US10856097B2 (en) Generating personalized end user head-related transfer function (HRTV) using panoramic images of ear
US11902754B2 (en) Audio processing method, apparatus, electronic device and storage medium
WO2016045233A1 (en) Communication device capable of collecting acoustic field information and communication method
CN114339582B (en) Dual-channel audio processing method, device and medium for generating direction sensing filter
WO2021129444A1 (en) File clustering method and apparatus, and storage medium and electronic device

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 15838759

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 28/06/2017)

122 Ep: pct application non-entry in european phase

Ref document number: 15838759

Country of ref document: EP

Kind code of ref document: A1