CN207443024U - Panorama audio and video recording arrangement and system - Google Patents
Panorama audio and video recording arrangement and system Download PDFInfo
- Publication number
- CN207443024U CN207443024U CN201721451902.2U CN201721451902U CN207443024U CN 207443024 U CN207443024 U CN 207443024U CN 201721451902 U CN201721451902 U CN 201721451902U CN 207443024 U CN207443024 U CN 207443024U
- Authority
- CN
- China
- Prior art keywords
- audio
- panorama
- processor
- video
- data
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Abstract
The utility model is related to a kind of panorama audio and video recording arrangement and systems.The equipment includes multiple cameras, multiple microphones, video processor, audio processor and processor.Multiple camera distributions in the horizontal plane, can gather the original video data of different angle.Multiple microphones are distributed in spherome surface, can gather the original audio data of different angle.Multiple cameras are connected respectively with video processor, and multiple microphones are connected respectively with audio processor.Multichannel original video data is spliced into panoramic video data by video processor, and multichannel original audio data is synthesized panorama voice data by audio processor.Video processor and audio processor are connected respectively with processor.Finally, panoramic video data and panorama voice data are carried out real-time recording generation panorama audio, video data by processor again.From vision and acoustically all realize panorama immersive effects truly.
Description
Technical field
The utility model is related to technical field of virtual reality, particularly a kind of panorama audio and video recording arrangement and system.
Background technology
With the development of virtual reality technology, video camera also experienced from single camera normal image and take multi-cam
The technological change of panoramic picture shooting.The panorama camera of existing multiple cameras can realize the shooting of panoramic video, but very
It can accomplish the recording of panorama audio less, the recording technology of panorama audio substantially lags behind the technique for taking of panoramic video.Because it passes
Panorama audio recording is not implemented in the virtual reality scenario of system, records or can not realize so while realizing panoramic video
Panorama immersive effects truly.
Utility model content
Based on this, it is necessary to for above-mentioned technical problem, provide a kind of panorama sound that can realize panorama audio recording and regard
Frequency recording arrangement and system.
A kind of panorama audio and video recording arrangement, including：
The camera of multiple original video datas for being used to gather different angle, the camera distribution is in the horizontal plane；
The microphone of multiple original audio datas for being used to gather different angle, the microphone are distributed in the table of sphere
Face；
For the original video data to be spliced into the video processor of panoramic video data, the video processor point
It is not connected with the multiple camera；
For by the audio processor of original audio data synthesis panorama voice data, the audio processor to be distinguished
It is connected with the multiple microphone；
The panoramic video data and the panorama voice data are carried out with real-time recording generation panorama audio, video data
Processor, the processor are connected respectively with the video processor and the audio processor.
In one of the embodiments, the audio processor uses panorama sound Ambisonic algorithms to original audio number
According to being handled and being synthesized, panorama voice data is obtained.
In one of the embodiments, the processor is compressed the panoramic video data using H.264 standard,
The panorama voice data is compressed using Advanced Audio Coding AAC standard, by compressed panoramic video data and entirely
Scape voice data is put into generation MP4 files in MP4 containers.
In one of the embodiments, the video processor and the audio processor use field programmable gate array
FPGA, the video processor can be one or more, and the audio processor can be one or more.
In one of the embodiments, the FPGA in the video processor by Low Voltage Differential Signal LVDS interface from institute
Multiple camera acquisition multichannel original video datas are stated, and the multichannel original video data is spliced into aphorama frequency in real time
According to the panoramic video data are sent to processor by LVDS interface.
In one of the embodiments, the FPGA in the audio processor passes through secure digital input and output SDIO interfaces
Multi-path audio-frequency data is gathered from the multiple microphone, and the multi-path audio-frequency data is synthesized into panorama voice data, by described in
The panorama voice data is sent to processor by panorama voice data by SDIO interfaces.
In one of the embodiments, the equipment further includes memory, and the memory is used to receive the processor
The panorama audio, video data of output, and the panorama audio, video data is stored.
In one of the embodiments, the processor is DSP or GPU or CPU.
In one of the embodiments, the processor with Xscale frameworks either with ARM frameworks or with X86
Framework.
A kind of panorama audio and video recording system, the system comprises：
The panorama audio and video recording arrangement of progress panorama voice data recording described in above-mentioned any one, the panorama sound
Video recording device is by the panorama audio, video data plug-flow of recording to server；
For receiving the panorama audio, video data by the panorama audio and video recording arrangement plug-flow, and to described complete
Scape audio, video data carries out transcoding processing in real time, and the panorama audio, video data after transcoding is sent to the service of the terminal in real time
Device；
For the panorama audio, video data after obtaining the transcoding in real time from the server, and transcoding described in real-time live broadcast
The terminal of panorama audio, video data afterwards；
It is attached between the panorama audio and video recording arrangement and the server by network, the server and institute
It states and is attached by network between terminal.
Above-mentioned panorama audio and video recording arrangement and system at least have the following advantages：
Panorama audio and video recording arrangement includes multiple cameras, multiple microphones, video processor, audio processor and place
Manage device.Multiple camera distributions in the horizontal plane, can gather the original video data of different angle, thus acquire and be clapped
Take the photograph the panoramic video data of scene.Multiple microphones are distributed in spherome surface, can gather the original audio data of different angle,
Thus acquire the panorama voice data of captured scene.Multiple cameras respectively with for original video data to be spliced into
The video processor connection of panoramic video data, multiple microphones respectively with for original audio data to be synthesized panorama audio number
According to audio processor connect.Multichannel original video data is spliced into panoramic video data, audio processor by video processor
Multichannel original audio data is synthesized into panorama voice data.Video processor and audio processor respectively with to panoramic video data
The processor for panorama voice data record generation panorama audio, video data connects.Finally, processor is again by panoramic video
Data and panorama voice data carry out real-time recording generation panorama audio, video data.From vision and acoustically all realize real meaning
Panorama immersive effects in justice.
Description of the drawings
Fig. 1 is the structure diagram of panorama audio and video recording arrangement in an embodiment；
Fig. 2 is the schematic diagram of panorama audio and video recording arrangement in an embodiment；
Fig. 3 is the structure diagram of panorama audio and video recording arrangement in another embodiment；
Fig. 4 is the structure diagram of panorama audio and video recording system in an embodiment.
Specific embodiment
To enable the above-mentioned purpose of the utility model, feature and advantage more obvious understandable, below in conjunction with the accompanying drawings to this
The specific embodiment of utility model is described in detail.Elaborate many details in order to abundant in the following description
Understand the utility model.But the utility model can be much to implement different from other manner described here, this field
Technical staff can do similar improvement in the case of without prejudice to the utility model connotation, therefore the utility model is from following public affairs
The limitation for the specific implementation opened.
It should be noted that when element is referred to as " being fixed on " another element, it can be directly on another element
Or there may also be elements placed in the middle.When an element is considered as " connection " another element, it can be directly connected to
To another element or it may be simultaneously present centering elements.Term as used herein " vertical ", " horizontal ", " left side ",
For illustrative purposes only, it is unique embodiment to be not offered as " right side " and similar statement.
Unless otherwise defined, all of technologies and scientific terms used here by the article is led with belonging to the technology of the utility model
The normally understood meaning of technical staff in domain is identical.It is simply in the term used in the description of the utility model herein
The purpose of description specific embodiment, it is not intended that in limitation the utility model.Each technical characteristic of above example can be with
Arbitrarily combined, to make description succinct, it is not all possible to each technical characteristic in above-described embodiment combination all into
Row description, as long as however, the combination of these technical characteristics is all considered to be the scope that this specification is recorded there is no contradiction.
Referring to Fig. 1, it is the panorama audio and video recording arrangement 100 in an embodiment.Panorama audio and video recording arrangement 100
Including multiple cameras 102, multiple microphones 104, video processor 106, audio processor 108 and processor 110.It is multiple to take the photograph
It is connected respectively with video processor 106 as first 102, multiple microphones 104 are connected respectively with audio processor 108.Video processing
Device 106 and audio processor 108 are connected respectively with processor 110.
Multiple cameras 102 are respectively distributed on horizontal plane, for gathering the original video of captured scene different angle
Data.Multiple microphones 104 are respectively distributed to spherome surface, can gather the original audio number of captured scene different angle
According to.Also referring to Fig. 2, video processor 106 and audio processor 108 use on-site programmable gate array FPGA.Video
FPGA in processor 106 gathers multichannel original video data by Low Voltage Differential Signal LVDS interface from multiple cameras 102,
And multichannel original video data is spliced into panoramic video data, panoramic video data are sent to processor by LVDS interface
110, can be arm processor.
The process that multichannel original video data is spliced into panoramic video data by the FPGA in video processor 106 is specific
For：Distortion data in original video data is corrected by FPGA by aberration correction algorithm, the video counts after generation correction
According to.Image registration is carried out to the different video data after correction by image registration algorithm again.Finally by Image Fusion
It is merged to having carried out the different images after image registration, the panoramic video data after being merged.
FPGA in audio processor 108 obtains multichannel original audio number by ADC acquisition chips from multiple microphones 104
According to.FPGA in audio processor 108 gathers multichannel sound by secure digital input and output SDIO interfaces from multiple microphones 104
Frequency evidence, and multi-path audio-frequency data is synthesized into panorama voice data, by panorama voice data by SDIO interfaces by panorama audio
Data are sent to processor 110, can be arm processors.FPGA in audio processor 108 uses panorama sound Ambisonic
Algorithm is handled and synthesized to original audio data, obtains panorama voice data.
Video processor 106 and audio processor 108 are different processors, and video processor 106 can be one
Or it is multiple, audio processor 108 can be one or more.Because the data-handling capacity of a processor is limited, in order to keep away
Exempt from traditional same processor and handle Voice and Video data simultaneously, what joining quality caused by substantial amounts of data was difficult to ensure that
Problem.Therefore, video processor and audio processor has been respectively configured for panorama audio and video recording arrangement.Video processor is special
For handling video data, audio processor is dedicated for processing voice data.Reach in multi-path video data and more recording frequencies
In the case of being inputted while data, the real-time splicing of high quality is realized.
Ambisonic systems are to propose that it had used X, tri- difference of Y, Z in 1974 by Michael A.Gerzon
X is directed toward, y, for " 8 " the font directional microphone and 1 W in z-axis direction without directional microphone, composition can pick up sound three-dimensional space
Between information recording system., under spherical coordinates state, this 4 microphone directional properties have strict difinition
W=0.707
Sound reproduction is done using loud speaker that is a certain number of, making to be evenly arranged around listener, and this 4 microphones are picked up
The number of winning the confidence carries out the mixing of different proportion, the surrounding sound effect of reproducible three dimensions.
Specifically, the surface of sphere is evenly distributed on using No. 64 microphones 104 in the present embodiment, 104 sound of microphone
Chamber away from the centre of sphere be directed toward outer surface of spheroid, each microphone 104 be used for gather sound.FPGA passes through ADC (Analog-
To-Digital Converter, analog to digital conversion circuit) acquisition chip acquisition 104 data of microphone.Ambisonic algorithms are matched somebody with somebody
Be set to it is horizontal for 7 ranks, it is vertical be 3 ranks, then FPGA by 104 data of No. 64 microphone collected by Ambisonic algorithms just
Generate the Fuma form panorama voice datas of vertical 3 rank of 7 rank of level.Fuma forms are the audios for collecting microphone 104
A kind of audio format that data generate after Ambsonic algorithm process.Generally, the audio number that microphone 104 is collected
According to after 1 rank Ambisonic algorithm process, 4 tunnel audios are exported；9 tunnels are then exported after 2 rank Ambisonic algorithm process
Audio；16 tunnel audios are then exported after 3 rank Ambisonic algorithm process.I.e. by the audio track of Ambisonic algorithms output
Number is square of (exponent number+1).
Can certainly be 3 rank of level by Ambisonic algorithm configurations, vertical 3 rank, then the 64 tunnel wheats that FPGA will be collected
Gram 104 data of wind just generate the Fuma form panorama voice datas of vertical 3 rank of 3 rank of level by Ambisonic algorithms.Also may be used
Ambisonic algorithms are only configured to 3 rank of level, then FPGA passes through 104 data of No. 64 microphone collected
Ambisonic algorithms just generate the Fuma form panorama voice datas of 3 rank of level.
In the present embodiment, it is that level is 7 ranks, is vertically 3 ranks by Ambisonic algorithm configurations, then FPGA will be collected
104 data of No. 64 microphone the Fuma form panorama audios of vertical 3 rank of 7 rank of level are just generated by Ambisonic algorithms
Data.Ambisonic algorithms can realize that the sound rendering gathered to different microphones 104 is panorama voice data.Panorama
Voice data is synthesized again with panoramic video data, just generates panorama audio, video data, add panorama voice data from
And realize panorama immersive effects truly.
Processor 110 is DSP (Digital Signal Processing, Digital Signal Processing) or GPU (Graphics
Processing Unit, graphics processor) or CPU.DSP is exactly general purpose signal processor, and GPU is the heart of video card, is determined
The class of video card and most of performance.Processor 110 can be with Xscale frameworks either with ARM frameworks or with X86
Framework.
The panoramic video data and audio processor 108 that FPGA of the processor 110 in video processor 106 is received is sent
In FPGA send panorama voice data after, panoramic video data are compressed using H.264 standard, using advanced sound
Frequency coding AAC standard is compressed panorama voice data, and compressed panoramic video data and panorama voice data are put into
The file of MP4 forms is generated in MP4 containers.Certainly, processor 110 can also be by compressed panoramic video data and panorama sound
Frequency is according to the file for generating AVI format.Referring to Fig. 2, panorama audio-video document can be stored in storage by processor 110
In device 112 (such as SD card), panorama audio, video data can also be uploaded to clothes by network (such as Ethernet Ethernets)
Being engaged in, device realization is online to be broadcast live.
Referring to Fig. 3, it is the panorama audio and video recording arrangement 100 in an embodiment.Panorama audio and video recording arrangement 100
Further including memory 112, memory 112 is used to receive the panorama audio, video data of the output of processor 110, and by panorama audio and video
Data are stored.Memory 112 can be SD card or other equipment with store function.
Referring to Fig. 4, for the panorama audio and video recording system in an embodiment, panorama audio and video recording system includes：
Panorama audio and video recording arrangement 100, server 200 and terminal 300.Pass through net between panorama audio and video recording arrangement and server
Network is attached, and is attached between server and terminal by network.
Panorama audio and video recording arrangement 100 is by the panorama audio, video data plug-flow of recording to server 200.Server 200
The panorama audio, video data by 100 plug-flow of panorama audio and video recording arrangement is received, and panorama audio, video data is carried out in real time
Transcoding processing, terminal 300 is sent to by the panorama audio, video data after transcoding in real time.Terminal 300 obtains in real time from server 200
Panorama audio, video data after transcoding, and the panorama audio, video data after real-time live broadcast transcoding.It is achieved thereby that panorama audio and video
Live streaming plug-flow.
Embodiment described above only expresses the several embodiments of the utility model, and description is more specific and detailed,
But therefore it can not be interpreted as the limitation to utility model patent scope.It should be pointed out that the common skill for this field
For art personnel, without departing from the concept of the premise utility, various modifications and improvements can be made, these are belonged to
The scope of protection of the utility model.Therefore, the protection domain of the utility model patent should be determined by the appended claims.
Claims (10)
1. a kind of panorama audio and video recording arrangement, which is characterized in that including：
The camera of multiple original video datas for being used to gather different angle, the camera distribution is in the horizontal plane；
The microphone of multiple original audio datas for being used to gather different angle, the microphone are distributed in the surface of sphere；
For the original video data to be spliced into the video processor of panoramic video data, the video processor respectively with
The multiple camera connection；
For by the original audio data synthesis panorama voice data audio processor, the audio processor respectively with institute
State multiple microphone connections；
The panoramic video data and the panorama voice data are carried out with the processing of real-time recording generation panorama audio, video data
Device, the processor are connected respectively with the video processor and the audio processor.
2. equipment according to claim 1, which is characterized in that the audio processor is calculated using panorama sound Ambisonic
Method is handled and synthesized to original audio data, obtains panorama voice data.
3. equipment according to claim 1, which is characterized in that the processor is using H.264 standard to the aphorama
Frequency is compressed the panorama voice data using Advanced Audio Coding AAC standard according to being compressed, will be compressed complete
Scape video data and panorama voice data are put into generation MP4 files in MP4 containers.
4. equipment according to claim 1, which is characterized in that the video processor and the audio processor are using existing
Field programmable gate array FPGA, the video processor can be one or more, the audio processor can be one or
It is multiple.
5. equipment according to claim 4, which is characterized in that the FPGA in the video processor is believed by low-voltage differential
Number LVDS interface gathers multichannel original video data from the multiple camera, and the multichannel original video data is spelled in real time
Panoramic video data are connected into, the panoramic video data are sent to processor by LVDS interface.
6. equipment according to claim 4, which is characterized in that the FPGA in the audio processor is defeated by secure digital
Enter to export SDIO interfaces and gather multi-path audio-frequency data from the multiple microphone, and the multi-path audio-frequency data is synthesized into panorama sound
The panorama voice data is sent to processor by the panorama voice data by frequency evidence by SDIO interfaces.
7. equipment according to claim 1, which is characterized in that the equipment further includes memory, and the memory is used for
The panorama audio, video data of the processor output is received, and the panorama audio, video data is stored.
8. equipment according to claim 1, which is characterized in that the processor is DSP or GPU or CPU.
9. equipment according to claim 1, which is characterized in that the processor is with Xscale frameworks or with ARM
Framework has X86-based.
10. a kind of panorama audio and video recording system, which is characterized in that the system comprises：
The panorama audio and video recording arrangement of progress panorama voice data recording described in claim 1 to 9 any one is described complete
Scape audio and video recording arrangement is by the panorama audio, video data plug-flow of recording to server；
For receiving the panorama audio, video data by the panorama audio and video recording arrangement plug-flow, and to the panorama sound
Video data carries out transcoding processing in real time, and the panorama audio, video data after transcoding is sent to the server of the terminal in real time；
For the panorama audio, video data after obtaining the transcoding in real time from the server, and after transcoding described in real-time live broadcast
The terminal of panorama audio, video data；
It is attached between the panorama audio and video recording arrangement and the server by network, the server and the end
It is attached between end by network.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201721451902.2U CN207443024U (en) | 2017-11-02 | 2017-11-02 | Panorama audio and video recording arrangement and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201721451902.2U CN207443024U (en) | 2017-11-02 | 2017-11-02 | Panorama audio and video recording arrangement and system |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN207443024U true CN207443024U (en) | 2018-06-01 |
Family
ID=62290788
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201721451902.2U Active CN207443024U (en) | 2017-11-02 | 2017-11-02 | Panorama audio and video recording arrangement and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN207443024U (en) |
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108848392A (en) * | 2018-07-18 | 2018-11-20 | 广州市兰德电子技术有限公司 | Audio, video data acquires in real time and transmission method |
| CN110213683A (en) * | 2019-04-09 | 2019-09-06 | 深圳海岸语音技术有限公司 | The multi-direction independent pickup system of one kind and method |
| CN111372035A (en) * | 2018-12-25 | 2020-07-03 | 杭州海康威视数字技术股份有限公司 | Multimedia data processing method and device, electronic equipment and readable storage medium |
| CN115361543A (en) * | 2022-10-21 | 2022-11-18 | 武汉光谷信息技术股份有限公司 | Heterogeneous data fusion and plug flow method and system based on ARM architecture |
-
2017
- 2017-11-02 CN CN201721451902.2U patent/CN207443024U/en active Active
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108848392A (en) * | 2018-07-18 | 2018-11-20 | 广州市兰德电子技术有限公司 | Audio, video data acquires in real time and transmission method |
| CN111372035A (en) * | 2018-12-25 | 2020-07-03 | 杭州海康威视数字技术股份有限公司 | Multimedia data processing method and device, electronic equipment and readable storage medium |
| CN110213683A (en) * | 2019-04-09 | 2019-09-06 | 深圳海岸语音技术有限公司 | The multi-direction independent pickup system of one kind and method |
| CN115361543A (en) * | 2022-10-21 | 2022-11-18 | 武汉光谷信息技术股份有限公司 | Heterogeneous data fusion and plug flow method and system based on ARM architecture |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN207443024U (en) | Panorama audio and video recording arrangement and system | |
| CN106992959B (en) | 3D panoramic audio and video live broadcast system and audio and video acquisition method | |
| CN106210703B (en) | The utilization of VR environment bust shot camera lenses and display methods and system | |
| US10405126B2 (en) | Mixed-order ambisonics (MOA) audio data for computer-mediated reality systems | |
| US10021301B2 (en) | Omnidirectional camera with multiple processors and/or multiple sensors connected to each processor | |
| CN102098443B (en) | Camera, communication system and corresponding image processing method | |
| CN102752540B (en) | A kind of automated cataloging method based on face recognition technology | |
| CN105611220A (en) | Communication system based on holographic projection technology | |
| CN108989739B (en) | Full-view video conference live broadcasting system and method | |
| CN107578777A (en) | Word-information display method, apparatus and system, audio recognition method and device | |
| WO2018068481A1 (en) | Binocular 720-degree panoramic acquisition system | |
| CN108305308A (en) | It performs under the line of virtual image system and method | |
| US20180048877A1 (en) | File format for indication of video content | |
| CN206117891U (en) | Audio video collecting equipment | |
| CN104580837A (en) | Video director engine based on GPU+CPU+IO architecture and using method thereof | |
| CN109756683A (en) | Panorama audio-video method for recording, device, storage medium and computer equipment | |
| CN106358035A (en) | Image processing method and image processing apparatus | |
| CN107071500A (en) | live broadcast system | |
| CN109873961A (en) | Court's trial data acquisition and processing system | |
| CN105847709A (en) | Cloud program directing station and multi-channel video stitching method | |
| CN207354434U (en) | For providing the system and device of comprehensive view | |
| CN110602523A (en) | VR panoramic live multimedia processing and synthesizing system and method | |
| US10595146B2 (en) | Methods and systems for extracting location-diffused ambient sound from a real-world scene | |
| CN206993282U (en) | A kind of file transfer management systems | |
| CN106961551A (en) | A kind of VR panoramic videos later stage stabilization technology |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| GR01 | Patent grant | ||
| GR01 | Patent grant |