WO2016033920A1 - Procédé d'acquisition de vidéo et d'audio - Google Patents

Procédé d'acquisition de vidéo et d'audio Download PDF

Info

Publication number
WO2016033920A1
WO2016033920A1 PCT/CN2015/000559 CN2015000559W WO2016033920A1 WO 2016033920 A1 WO2016033920 A1 WO 2016033920A1 CN 2015000559 W CN2015000559 W CN 2015000559W WO 2016033920 A1 WO2016033920 A1 WO 2016033920A1
Authority
WO
WIPO (PCT)
Prior art keywords
video
signal
holographic
sound field
processing unit
Prior art date
Application number
PCT/CN2015/000559
Other languages
English (en)
Chinese (zh)
Inventor
张德明
Original Assignee
北京塞宾科技有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 北京塞宾科技有限公司 filed Critical 北京塞宾科技有限公司
Publication of WO2016033920A1 publication Critical patent/WO2016033920A1/fr

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast

Definitions

  • the invention relates to a video audio collecting method.
  • the sound quality of the built-in microphone is generally not high.
  • the external microphone can provide higher quality, but the spatial resolution capability is not good.
  • the spatial surround sound capsule microphone can provide some spatial sound field resolution capabilities for the camera, but overall the spatial resolution is still very weak, and the spatial positioning ability is poor.
  • the mobile devices represented by mobile phones have exploded, and mobile-based video shooting has even reached HD, but the sound quality recorded based on its built-in single-channel or dual-channel microphone is very poor.
  • some mobile phone recording accessories have appeared. Can provide high-quality recording quality, but the spatial resolution is still poor.
  • the sound quality of several typical video capture devices is very poor.
  • Single-microphone recording is the easiest, but the sound field is also the most monotonous.
  • the original intention of stereo recording is to create a richer stereo field.
  • There are various ways to configure the microphone which are all trying to simulate the perception of the human ear. For example, delay, amplitude difference, phase, etc., but it is difficult to achieve the real human ear perception by simply placing the position of the microphone.
  • the simulated head recording can realize the realistic expression of the immersed three-dimensional sound field, but it is still mainly used in some professional laboratories as a testing tool. For a wide range of audio and video recording, it is extremely inconvenient to use and extremely expensive ( The simulation head, recording equipment, processing equipment, etc.
  • the current simulation head is mainly used for the test of communication equipment, not for the purpose of human stereo field perception, its texture and structure. There is still a big difference with the real human head, and these differences will ultimately affect the recorded sound field effect.
  • a video audio collecting method is characterized in that: the holographic audio collecting device comprises a microphone unit, an acquisition signal processing module, a holographic sound field signal processing unit, a source coding module, and the microphone unit collects a three-dimensional sound field signal and acquires a signal.
  • the processing module processes the acquired signal and converts it into a digital signal, and the digital signal is input to the holographic sound field signal processing unit, and the holographic sound field signal processing unit processes the sound field signal, and the processed signal is compressed by the source code and sent to the network through the network to Video capture device.
  • the video collection device comprises a camera unit and a video acquisition signal processing unit, and the signal collected by the camera unit is input to the video acquisition signal processing unit, and the video signal acquisition processing unit receives the signal transmitted by the holographic audio collection device through the network.
  • the holographic audio collection device and the video capture device are integrated, and the source coding module of the holographic audio collection device is connected with the video acquisition signal processing unit of the video capture device, and the signal output by the holographic audio collection device is directly transmitted to the video capture device.
  • the video capture device can transmit the video signal and the holographic sound field signal over a network to a remote device.
  • the video capture device can be a cell phone, a video camera, a surveillance camera, or a lens that can be used for video capture.
  • the invention has a holographic audio collection device, which comprises a microphone unit, an acquisition signal processing module, a holographic sound field signal processing unit and a source coding module, the microphone unit collects a three-dimensional sound field signal, and the holographic sound field signal processing unit processes the sound field signal. After the processed signal is compressed by the source code, it can be sent to the video capture device through the network.
  • the holographic audio capture device and the video capture device can also be integrated, and the signal output by the holographic audio capture device is directly transmitted to the video capture device.
  • the invention collects the holographic sound field signal for the video device through the holographic audio collecting device, thereby effectively improving the audio quality of the video collecting device.
  • the video capture device of the present invention may be a mobile phone, a video camera, a surveillance camera or For glasses for video shooting, the video capture device can transmit the video signal and the holographic sound field signal to the remote device through the network, which is further convenient for the user.
  • FIG. 1 is a circuit block diagram of a holographic audio collection device and a video capture device of the present invention when connected through a network;
  • FIG. 2 is a circuit block diagram of the holographic audio collection device of the present invention integrated with the video capture device according to the present invention
  • Figure 3 is a schematic view showing the working state of the first embodiment
  • Figure 4 is a schematic view showing the working state of the second embodiment
  • Fig. 5 is a schematic view showing the working state of the third embodiment.
  • the holographic audio collection device includes a microphone unit, an acquisition signal processing module, a holographic sound field signal processing unit, and a source coding module.
  • the microphone unit includes an earphone-based or artificial head-based, but is not limited thereto.
  • the microphone unit collects a three-dimensional sound field signal, and the acquisition signal processing module processes the acquired signal and converts it into a digital signal.
  • the digital signal is input to the holographic sound field signal processing unit, and the holographic sound field signal processing unit processes the sound field signal, and the processed signal is processed. After the source code is compressed, it is sent to the video capture device through the network.
  • the video collection device comprises a camera unit and a video acquisition signal processing unit, and the signal collected by the camera unit is input to the video acquisition signal processing unit, and the video signal acquisition processing unit receives the signal transmitted by the holographic audio collection device through the network.
  • the video capture device can transmit the video signal and the holographic sound field signal over a network to a remote device.
  • the holographic audio collection device and the video capture device may be integrated, and the source coding module of the holographic audio collection device is connected with the video acquisition signal processing unit of the video capture device, and the signal output by the holographic audio collection device is directly transmitted to the video. Acquisition device.
  • the video capture device can transmit the video signal and the holographic sound field signal over a network to a remote device.
  • the video capture device can be a cell phone, a video camera, a surveillance camera, or a lens that can be used for video capture.
  • the video capture device is a mobile phone 1.
  • the video recording of the mobile phone does not use the built-in microphone of the mobile phone, but uses a holographic audio recording microphone, that is, the audio track of the video is holographic audio.
  • the holographic audio capture device 2 transmits the holographic sound field signal to the handset via the network.
  • the mobile phone 1 can also take photos with sound field audio information recorded by a holographic audio microphone.
  • the captured video containing the holographic sound field can be stored in the mobile phone 1 or transmitted to the remote user for viewing through the network. When stored in the mobile phone 1, it can be played back through the mobile phone software, allowing the user to enjoy the video with the holographic sound field.
  • the video device is a lens capable of video capturing
  • the microphone 3 capable of collecting a three-dimensional sound field signal
  • the holographic audio collecting device and the video capturing device are integrated.
  • Holographic sound field acquisition is based Performed on the holographic microphone 3 on the temples.
  • the control of the glasses and the storage of the audio and video recordings can be performed either directly on the glasses or via the mobile phone 4.
  • the glasses can also be used without a camera or without a camera. In this case, the sound field can be recorded by means of a holographic sound field microphone.
  • the position A camera When used for video or photo shooting, it can be based on the position A camera (this camera can be on the left or right side, or both sides), or it can be based on the position B camera, or based on The camera in position C is shooting.
  • the captured video or photo containing the holographic sound field can be stored on the glasses or mobile phone, or transmitted to the remote user via the network for real-time or offline viewing.
  • the video capture device is a surveillance camera 5, and the holographic audio capture device and the video capture device are integrated.
  • the video monitoring with the holographic sound field positioning can be performed.
  • the monitoring camera collects the monitoring video, and the holographic sound field microphone 6 synchronously collects the holographic sound field, and then uniformly encodes the video stream to the far end through the network.
  • the pan/tilt rotation function of the surveillance camera 5 requires the holographic sound field microphone 6 to rotate synchronously with the camera.

Abstract

La présente invention concerne un procédé d'acquisition de vidéo et d'audio ; la présente invention concerne également un dispositif d'acquisition d'audio holographique ; le dispositif d'acquisition d'audio holographique comprend une unité de microphone, un module de traitement de signal acquis, une unité de traitement de signal de champ acoustique holographique, et un module de codage de source ; l'unité de microphone acquiert un signal de champ acoustique tridimensionnel ; un module de traitement de signal acquis traite le signal acquis et convertit celui-ci en un signal numérique ; ledit signal numérique est entré dans l'unité de traitement de signal de champ acoustique holographique ; l'unité de traitement de signal de champ acoustique holographique traite le signal de champ acoustique ; le signal traité subit un codage de source et est compressé, et est envoyé à un dispositif d'acquisition de vidéo au moyen d'un réseau.
PCT/CN2015/000559 2014-09-01 2015-08-04 Procédé d'acquisition de vidéo et d'audio WO2016033920A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201410440366.0A CN104168465A (zh) 2014-09-01 2014-09-01 一种视频音频采集方法
CN201410440366.0 2014-09-01

Publications (1)

Publication Number Publication Date
WO2016033920A1 true WO2016033920A1 (fr) 2016-03-10

Family

ID=51912070

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2015/000559 WO2016033920A1 (fr) 2014-09-01 2015-08-04 Procédé d'acquisition de vidéo et d'audio

Country Status (2)

Country Link
CN (1) CN104168465A (fr)
WO (1) WO2016033920A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112770212A (zh) * 2021-01-07 2021-05-07 深圳市天诺泰科技有限公司 一种无线耳机、视频录制系统及方法、存储介质

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104168465A (zh) * 2014-09-01 2014-11-26 北京塞宾科技有限公司 一种视频音频采集方法
CN104283697A (zh) * 2014-09-28 2015-01-14 北京塞宾科技有限公司 一种可采集声场信息的通信装置及通信方法

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101237567A (zh) * 2007-01-29 2008-08-06 索尼株式会社 网络设备、声音数据传输方法、监视设备和摄像机系统
CN101500169A (zh) * 2009-03-10 2009-08-05 武汉大学 多路音视频压缩传输服务器
CN102082991A (zh) * 2010-11-24 2011-06-01 蔡庸成 一种专为耳机试听设计的模拟现场全息音频的方法
CN103501408A (zh) * 2013-09-23 2014-01-08 深圳市欧珀通信软件有限公司 一种使用移动终端拍摄视频短片的方法和系统
CN104168534A (zh) * 2014-09-01 2014-11-26 北京塞宾科技有限公司 一种全息音频装置及控制方法
CN104168465A (zh) * 2014-09-01 2014-11-26 北京塞宾科技有限公司 一种视频音频采集方法
CN104217750A (zh) * 2014-09-01 2014-12-17 北京塞宾科技有限公司 一种全息音频录制回放方法
CN104284268A (zh) * 2014-09-28 2015-01-14 北京塞宾科技有限公司 一种可采集数据信息的耳机及数据采集方法
CN104283697A (zh) * 2014-09-28 2015-01-14 北京塞宾科技有限公司 一种可采集声场信息的通信装置及通信方法
CN204377136U (zh) * 2015-02-16 2015-06-03 北京塞宾科技有限公司 一种全息音频采集回放装置

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101237567A (zh) * 2007-01-29 2008-08-06 索尼株式会社 网络设备、声音数据传输方法、监视设备和摄像机系统
CN101500169A (zh) * 2009-03-10 2009-08-05 武汉大学 多路音视频压缩传输服务器
CN102082991A (zh) * 2010-11-24 2011-06-01 蔡庸成 一种专为耳机试听设计的模拟现场全息音频的方法
CN103501408A (zh) * 2013-09-23 2014-01-08 深圳市欧珀通信软件有限公司 一种使用移动终端拍摄视频短片的方法和系统
CN104168534A (zh) * 2014-09-01 2014-11-26 北京塞宾科技有限公司 一种全息音频装置及控制方法
CN104168465A (zh) * 2014-09-01 2014-11-26 北京塞宾科技有限公司 一种视频音频采集方法
CN104217750A (zh) * 2014-09-01 2014-12-17 北京塞宾科技有限公司 一种全息音频录制回放方法
CN104284268A (zh) * 2014-09-28 2015-01-14 北京塞宾科技有限公司 一种可采集数据信息的耳机及数据采集方法
CN104283697A (zh) * 2014-09-28 2015-01-14 北京塞宾科技有限公司 一种可采集声场信息的通信装置及通信方法
CN204377136U (zh) * 2015-02-16 2015-06-03 北京塞宾科技有限公司 一种全息音频采集回放装置

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112770212A (zh) * 2021-01-07 2021-05-07 深圳市天诺泰科技有限公司 一种无线耳机、视频录制系统及方法、存储介质
CN112770212B (zh) * 2021-01-07 2022-07-22 深圳市天诺泰科技有限公司 一种无线耳机、视频录制系统及方法、存储介质

Also Published As

Publication number Publication date
CN104168465A (zh) 2014-11-26

Similar Documents

Publication Publication Date Title
WO2016033919A1 (fr) Procédé d'enregistrement et de lecture audio holographique
WO2016033918A1 (fr) Dispositif audio holographique et procédé de commande
JP6252849B2 (ja) 撮像装置および方法
KR20120053006A (ko) 개선된 오디오／비디오 방법들 및 시스템들
CN109257559A (zh) 一种全景视频会议的图像显示方法、装置及视频会议系统
US10254842B2 (en) Controlling a device based on facial expressions of a user
WO2016088602A1 (fr) Dispositif de traitement d'informations, procédé de traitement d'informations et programme
WO2021197020A1 (fr) Procédé et appareil de traitement audio, support lisible et dispositif électronique
CN111970625B (zh) 录音方法和装置、终端和存储介质
WO2016033920A1 (fr) Procédé d'acquisition de vidéo et d'audio
US10306142B2 (en) Headset
JPWO2017154411A1 (ja) 撮像装置、電子機器及び撮像システム
CN104065951A (zh) 视频拍摄方法、视频播放方法及智能眼镜
US10788888B2 (en) Capturing and rendering information involving a virtual environment
WO2018032587A1 (fr) Dispositif et système de communication avec enregistrement de champ sonore holographique basé sur bluetooth
CN114466283A (zh) 音频采集方法、装置、电子设备及外设组件方法
JP2023539774A (ja) サウンドボックス位置調整方法、オーディオレンダリング方法、および装置
Maempel The virtual concert hall—A research tool for the experimental investigation of audiovisual room perception
US10856097B2 (en) Generating personalized end user head-related transfer function (HRTV) using panoramic images of ear
US11902754B2 (en) Audio processing method, apparatus, electronic device and storage medium
WO2016045233A1 (fr) Dispositif de communication apte à collecter des informations de champ acoustique, et procédé de communication
CN114339582B (zh) 双通道音频处理、方向感滤波器生成方法、装置以及介质
WO2021129444A1 (fr) Procédé et appareil de regroupement de fichiers, et support de stockage et dispositif électronique
JP2018157314A (ja) 情報処理システム、情報処理方法及びプログラム
US20170094412A1 (en) Wearable recording and playback system

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 15838759

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 28/06/2017)

122 Ep: pct application non-entry in european phase

Ref document number: 15838759

Country of ref document: EP

Kind code of ref document: A1