CN117041460B - High-definition camera processing platform capable of being freely switched and supporting high-definition VR manufacture - Google Patents
High-definition camera processing platform capable of being freely switched and supporting high-definition VR manufacture Download PDFInfo
- Publication number
- CN117041460B CN117041460B CN202311059473.4A CN202311059473A CN117041460B CN 117041460 B CN117041460 B CN 117041460B CN 202311059473 A CN202311059473 A CN 202311059473A CN 117041460 B CN117041460 B CN 117041460B
- Authority
- CN
- China
- Prior art keywords
- camera
- resolution
- video
- processing
- signal
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000012545 processing Methods 0.000 title claims abstract description 95
- 238000004519 manufacturing process Methods 0.000 title claims abstract description 29
- 230000000694 effects Effects 0.000 claims description 23
- 238000012937 correction Methods 0.000 claims description 15
- 238000003860 storage Methods 0.000 claims description 13
- 230000005236 sound signal Effects 0.000 claims description 12
- 238000000034 method Methods 0.000 claims description 9
- 230000006835 compression Effects 0.000 claims description 8
- 238000007906 compression Methods 0.000 claims description 8
- 230000008569 process Effects 0.000 claims description 8
- 238000003702 image correction Methods 0.000 claims description 5
- 230000005540 biological transmission Effects 0.000 claims description 4
- 238000006243 chemical reaction Methods 0.000 claims description 4
- 238000005538 encapsulation Methods 0.000 claims description 4
- 238000003786 synthesis reaction Methods 0.000 claims description 3
- 230000002194 synthesizing effect Effects 0.000 claims description 3
- 230000000007 visual effect Effects 0.000 claims description 3
- 206010034960 Photophobia Diseases 0.000 claims description 2
- 230000003321 amplification Effects 0.000 claims description 2
- 208000013469 light sensitivity Diseases 0.000 claims description 2
- 238000003199 nucleic acid amplification method Methods 0.000 claims description 2
- 238000002360 preparation method Methods 0.000 claims description 2
- 238000005498 polishing Methods 0.000 claims 1
- 210000003128 head Anatomy 0.000 description 20
- 238000011161 development Methods 0.000 description 9
- 238000013461 design Methods 0.000 description 6
- 238000005516 engineering process Methods 0.000 description 6
- 230000001360 synchronised effect Effects 0.000 description 6
- 238000010586 diagram Methods 0.000 description 5
- 230000035945 sensitivity Effects 0.000 description 5
- 238000003384 imaging method Methods 0.000 description 3
- 230000009286 beneficial effect Effects 0.000 description 2
- 230000015572 biosynthetic process Effects 0.000 description 2
- 238000004364 calculation method Methods 0.000 description 1
- 238000000227 grinding Methods 0.000 description 1
- 230000010354 integration Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
- H04N5/268—Signal distribution or switching
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/66—Remote control of cameras or camera parts, e.g. by remote control devices
- H04N23/661—Transmitting camera control signals through networks, e.g. control via the Internet
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/015—High-definition television systems
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Abstract
The invention discloses a high-definition camera processing platform capable of freely switching and supporting high-definition VR manufacture, which belongs to the technical field of audio and video manufacture processing.
Description
Technical Field
The invention belongs to the technical field of audio and video production and processing, and particularly relates to a high-definition camera processing platform capable of being freely switched and supporting high-definition VR production.
Background
With the development of 5G network technology and ultra-high definition display technology, the requirements of people on video resolution are higher and higher, and the ultra-high resolution imaging system is greatly promoted. From digital televisions to high-definition, full-high-definition and ultra-high-definition 4K, to 8K at present, display pixels are denser and display images are clearer, requirements on an imaging system are higher and higher, and 8K ultra-high-definition digital video is a new and important technological innovation after the traditional video digitization and high-definition development, and the 8K ultra-high-definition digital video directly drives the collection, production, transmission, demonstration and application of global video images and promotes the development of related technologies in other aspects of the whole industry chain, so that the cultivation and development of the ultra-high-definition digital video technology industry are further promoted.
8K is not only high resolution, but also includes wide color gamut, high data transmission bandwidth, high performance image processing and compression. Acquisition of ultra-high definition image content a short panel of the current 8K video industry plays a vital role in the development of this technology, placing higher demands on imaging devices and image processing, compression and transmission, sony issued 2018, the 8K camera system with UHC-8300 equipped with three 1.25 inch 8K imagers, will be first shown in the country on sony BIRTV2018 stands, UHC-8300 opens the gate of the 8K world, and its outstanding flexibility will bring 8K, 4K shooting technologies and other powerful functions to users.
And the existing Virtual Reality (VR) head display in the market is based on an enhanced brief introduction instruction set processor (Advanced RISC Machine, ARM) framework, can only analyze 4K clear content, when the content definition is higher, the existing hardware is not smooth in operation or the definition is not high, or the obtained content cannot be displayed, in addition, the obtained content is displayed, the sense of Reality is not strong, meanwhile, the processing data volume of an 8K 60P-specification video camera is large, the precision of the live broadcast program production requirement is high, few real-time processing devices with 8K VR professional-level live broadcast are provided, and at home and abroad, the real-time signal processing devices for the video camera which can simultaneously support two high-specification video camera signal processing functions of 8K and 8K VR are not provided at present.
Disclosure of Invention
Aiming at the problems that at present, no video camera real-time signal processing equipment which can simultaneously support two high-specification video camera signal processing functions of 8K and 8K VR and is aimed at the requirements of 8K resolution level, IP interface, professional video and broadcast television exists at home and abroad, and the real-time processing equipment which is provided with 8K VR professional live broadcast is less, the invention provides a high-definition video camera processing platform which can be freely switched and supports high-definition VR manufacture.
In order to solve the problems, the invention adopts the following technical scheme.
High definition camera processing platform that can freely switch and support high definition VR preparation includes: a 2D camera with resolution of 8K and frame rate of 60P, a 3DVR camera with resolution of 8K and frame rate of 60P, a switch, a control processing module, an interface operation module and a storage; the 2D camera and the 3DVR camera are electrically connected with the switch, the switch is electrically connected with the control processing module and the interface operation module, and the control processing module is connected with the storage through wires;
the switch is used for setting a separate IP address for each camera;
the interface operation module is used for providing a platform software interface, searching IP addresses through the platform software interface, identifying a camera accessed by the switch, selecting an equipment address to be accessed, selecting a camera type, completing connection work of the camera and the control processing module, and selectively controlling the resolution, the sensitivity, the shutter speed, the frame rate and the image parameter function of the camera;
the control processing module is used for carrying out H.264/265 compression coding on the IP stream output by the camera, and executing the subsequent flow after decoding and restoring;
the storage is used for locally storing the 8K 2D signals processed by the 2D camera and the 8K VR signals of the 3DVR camera, copying and archiving the signals, and outputting various signals according to the requirements.
Preferably, the subsequent flow is to firstly perform audio/video de-embedding, and to de-embed the packaged audio/video signals into independent audio and video signals for subsequent separate processing;
then video processing is carried out, and distinguishing is carried out according to the characteristics of the 8K signals;
if the input signal is a 3D VR picture with the resolution of 8K of a 3DVR camera, two processing links are needed to be added, the 3D parallax pictures shot by the two fisheye lenses of the camera respectively are subjected to ERP correction, then the overlapping comparison is carried out, whether the vertical and rotation errors exist or not is judged, if the errors exist, the error correction is carried out, then the corrected pictures are combined in parallel, and the final 3D VR image with the resolution of 8K is output;
then, the audio processing part is subjected to delay adjustment, and phase alignment is carried out on the audio processing part and the processed video, so that sound and picture synchronization is ensured;
finally, synthesizing video and audio signals, and re-synthesizing the adjusted video and audio signals.
Further, the distinguishing according to the characteristics of the 8K signal is that if the signal source is 8K 2d, the processing step only needs to execute the image shadow and the special effect; if the signal source is one of 2D VR with resolution of 8K and 3D VR with resolution of 8K, the signal processing link will execute VR ERP image correction first, and the deformed picture shot by the VR camera fisheye lens is ERP processed into a non-deformed picture with normal perspective effect.
Further, the error correction is to perform picture enlargement and alignment so that the same object image in the center portions of the left and right eye pictures is in a horizontally aligned position.
Further, the parallel integration is to synthesize the respective 1:1 images of the left and right eyes into a pair of 2:1 images, namely the 3D VR SBS mode effect, and the images are the 3D VR images with the resolution of 8K which can be output after final adjustment.
Furthermore, the delay adjustment of the audio processing part needs to specially design audio signal processing for the VR camera, and the signal error between the 3D VR binocular heads is independently adjusted, wherein the independent adjustment is to process the error between the binocular heads first, and then to process the overall error of the audio in a unified way.
Preferably, the various types of signal outputs include a 4K live broadcast, a baseband signal output with a resolution of 8K, a frame number of 60P level, and a VR head-display output with a resolution of 8K.
Further, the 4K live broadcast is calculated according to the upper limit of the computational power of the GPU, the camera processor reduces the 8K original signal to 4K resolution, 4K resolution level real-time push streaming is realized, and the push streaming is used for 4K live broadcast of a single channel and supports IP stream coding encapsulation.
Further, the baseband signal output with the resolution of 8K and the frame number of 60P level is realized by directly outputting the video signal with the uncompressed 8K 60P level through an installed 8K SDI baseband signal conversion output card, and the video signal is connected to a broadcasting-level professional 8K video switching station and professional video recorder equipment for manufacturing the high-end field multi-level 8K.
Further, the VR head display output with the resolution of 8K is connected with the VR head display terminal supporting serial line access through the DP2.0 interface of the camera processor, and the VR head display terminal directly connects with the VR head display through the function developed by the camera processor software platform, so that a real-time 3D VR picture with the resolution of 8K is directly seen in the VR head display, and a manufacturer can obtain visual VR effect experience.
The processing platform is connected with the switch through an 8K 602P 2D camera and an 8K 602P 3D VR camera, each camera is provided with an independent IP address, the video camera which is accessed by the switch is searched and identified through the IP address in a software interface of the platform, the equipment address which needs to be accessed is selected, the type of the video camera is selected, the connection work of the video camera and the processor is completed, the resolution, the sensitivity, the shutter speed, the frame rate and the image parameter function of the front end of the video camera are remotely controlled through a video camera control interface of the software, the H.264/265 compression coding is adopted for the IP flow which is output by the video camera, the processing platform firstly carries out decoding and reduction and then carries out subsequent processes, the processing platform designs a local storage function, processed 8K 2D and 8K VR signals are directly stored for copying, various types of signal output can be carried out according to needs, the function design of different video cameras is selected through IP setting, the processing steps and methods for 8K 3D VR images comprise audio and video synchronization adjustment function design, the video camera can be directly accessed to the video camera through the SDI video camera, the video camera can be directly accessed by the SDI, the video camera can be directly and has high-level synchronous video camera output, and video synchronization can be directly, and can not be directly accessed by the video camera, and can be directly accessed by a synchronous, and has the synchronous functions, and can not have the synchronous functions.
Compared with the prior art, the invention has the beneficial effects that:
(1) The invention provides a novel program production tool for high-end new media program production aiming at 5 G+ultra-high definition video content creation application scenes, which is beneficial to greatly improving the rapid production and live broadcast efficiency of 8K-level program content, particularly VR high-quality content, and provides a high-quality solution for high-quality content batch and standardization production;
(2) Aiming at the high-quality 8K camera and the professional signal production development, the invention solves the problem that front-end professional production equipment which supports 8K 60P level signal real-time processing capability is lacking in the market; aiming at the processing of the audio and video signals of the video camera, the parameter adjustment of the processing precision level of the broadcast video camera is used, including the remote control of all front-end camera setting parameters and specialized image correction, thereby greatly improving the accuracy and the specialty of the manufacturing effect; the 8K 3D VR signals are subjected to specialized processing, including various errors, VR picture stitching and other specialized correction functions can be realized, high-quality VR real-time live broadcasting capability is guaranteed, particularly, audio is subjected to refinement processing design, a functional short board for adjusting past VR audio and video is solved, and a specialized manufacturing flow level is embodied;
(3) The invention has the advantages that a set of processor host can support different production such as 8K 2D or 3D VR, a set of system is used for supporting various types of content creation, the cost is reduced, the flexibility and the production efficiency of a production system are improved, the real-time access function of the VR head display terminal is specially designed, the traditional production of VR is fundamentally changed, the actual shooting effect of virtual reality images can be felt in real time by a producer only through a production short plate with a later-stage viewing effect, the production efficiency is improved, the production system is supported to be accessed, the equipped 8K baseband interface can be directly accessed into broadcast-television-level professional production equipment, and high-quality and low-delay professional multi-machine live broadcast is realized.
Drawings
FIG. 1 is a schematic diagram of a platform system according to the present invention;
FIG. 2 is a schematic diagram of the connection of a 2D camera, a 3DVR camera and a switch according to the present invention;
FIG. 3 is a schematic workflow diagram of the present invention;
FIG. 4 is a schematic diagram of the operation steps of the present invention.
Detailed Description
For the purposes of making the objects, technical solutions and advantages of the embodiments of the present application more apparent, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is apparent that the described embodiments are some embodiments of the present application, but not all embodiments, and that the components of the embodiments of the present application generally described and illustrated in the drawings herein may be arranged and designed in various different configurations.
Example 1: as shown in fig. 1 and fig. 4, a high-definition camera processing platform capable of freely switching and supporting high-definition VR manufacturing includes: a 2D camera with resolution of 8K and frame rate of 60P (8K 60P 2D camera for short), a 3DVR camera with resolution of 8K and frame rate of 60P (8K 60P3D VR camera for short), a switch, a control processing module, an interface operation module and a storage; the 2D camera and the 3DVR camera are electrically connected with the switch, the switch is electrically connected with the control processing module and the interface operation module, and the control processing module is connected with the storage through wires;
a switch for setting a separate IP address for each camera;
the interface operation module is used for providing a platform software interface, searching IP addresses through the platform software interface, identifying a camera accessed by the switch, selecting an equipment address to be accessed, selecting a camera type, completing connection work of the camera and the control processing module, and selectively controlling functions of resolution, light sensitivity, shutter speed, frame rate and image parameters of the camera;
the control processing module is used for carrying out H.264/265 compression coding on the IP stream output by the camera, and executing the subsequent flow after decoding and restoring;
and the storage is used for locally storing the 8K 2D signal processed by the 2D camera and the 8K VR signal of the 3DVR camera, copying and archiving the signals at the same time, and outputting various types of signals according to the requirement.
The working main flow is as follows:
connecting an 8K 602P 2D camera and an 8K 60P3D VR camera with a switch, setting an independent IP address for each camera, searching and identifying the camera accessed by the switch through the IP address on a platform software interface of an interface operation module, selecting the equipment address to be accessed, selecting the type of the camera, and completing the connection work of the camera and a processor.
And remotely controlling the functions of resolution, sensitivity, shutter speed, frame rate and image parameters of the front end of the camera through a platform software interface of the interface operation module.
The control processing module adopts H.264/265 compression coding to the IP stream output by the video camera, the processing platform firstly decodes and restores the IP stream and then executes the subsequent flow, the subsequent flow is firstly audio/video de-embedding, and the packed audio/video signals are resolved into independent audio and video signals for subsequent separate processing.
Then video processing is carried out, distinguishing is carried out according to the characteristics of the 8K signal, if the signal source is 8K 2D, the processing step only needs to execute image shadow and special effect; if the signal source is one of 8K 2D VR and 8K 3D VR, the signal processing link will execute VR ERP image correction first, and the deformed picture that the VR camera fisheye lens was shot carries out ERP processing and becomes the non-deformed picture of normal perspective effect.
If the input signal is 8K 3D VR picture, two processing links are needed, after ERP correction is carried out on 3D parallax pictures with 3D parallax pictures shot by two fish-eye lenses of the camera respectively, then, overlapping comparison is carried out, whether vertical and rotation errors exist or not is judged, if the error exists, error correction is carried out, the picture is amplified and aligned, the same object image in the center part of the left and right eye pictures is positioned at a horizontal alignment position, then, the corrected pictures are combined in parallel, 1:1 picture images of the left and right eyes are combined into a pair of 2:1 images, namely, 3D VR SBS mode effect is achieved, and the images are 8K 3D VR images which can be output after final adjustment, and the final 8K 3D VR images are output.
And then the audio processing part is subjected to delay adjustment, phase alignment is carried out on the processed video, sound and picture synchronization is ensured, audio signal processing is needed to be specially designed for the VR camera, and the signal error between the 3D VR binocular heads is independently adjusted, wherein the independent adjustment is to firstly process the error between the binocular heads, and then uniformly process the overall error of the audio.
Finally, synthesizing video and audio signals, and re-synthesizing the adjusted video and audio signals.
The storage directly stores the processed 8K 2D and 8K VR signals locally for copying and archiving, and various types of signal output can be carried out according to the needs, wherein the various types of signal output comprise 4K live broadcast, 8K 60P level baseband signal output and 8K VR head display output.
The 4K live broadcast is calculated according to the upper limit of the computational power of the GPU, the camera processor reduces the 8K original signal to 4K resolution, 4K resolution level real-time push streaming is realized, and the push streaming is used for 4K live broadcast of a single channel and supports IP stream coding encapsulation.
The 8K 60P level baseband signal output is realized by directly outputting uncompressed 8K 60P level video signals through an installed 8K SDI baseband signal conversion output card, and accessing a broadcasting-level professional 8K video switching station, a professional video recorder and other devices for manufacturing the 8K on-site multi-machine-position high-end.
The output of the 8K VR head display is through the DP2.0 interface of the camera processor, the VR head display terminal supporting the serial line access is connected, the function of directly connecting with the VR head display is developed through the software platform of the camera processor, a real-time 8K 3D VR picture is directly seen in the VR head display, and a manufacturer can obtain visual VR effect experience.
As can be seen from the above description, in this example, by connecting the 8K 60p 2d camera and the 8K 60p3d VR camera with the switch, each camera sets an independent IP address, searches and identifies the camera accessed by the switch through the IP address in the software interface of the platform, selects the device address to be accessed, selects the type of the camera, completes the connection work between the camera and the processor, remotely controls the resolution, the sensitivity, the shutter speed, the frame rate and the image parameter function of the front end of the camera through the camera control interface of the software, compression codes the IP stream output by the camera by adopting the h.264/265, performs the subsequent process after decoding and restoring, designs the local storage function by the processing platform, directly stores the processed 8K 2d and 8K VR signals locally for copy archiving, and can also output various types of signals according to the need.
Example 2: as shown in fig. 2 and 3, by one camera control unit (processor), only by changing the access IP address, different types of 8K 2D or 8K 2D/3D VR cameras (the IP interface access type of the camera is custom developed) can be selected, so as to realize remote camera control, 8K signal processing, VR related correction, and various types of signal output or encoding push functions. The workflow diagram 4 is shown.
Step 1, selecting a camera type: in a software interface of a camera processing platform, different cameras (comprising 8K 2D or 8K VR) which are connected to the same switch can be identified through IP address searching, and the equipment addresses which need to be connected are selected, so that the connection work of the camera and a processor can be completed, and mainly different options such as 8K 2D or 8K 3D VR are selected, so that the subsequent camera signal processing flow is influenced.
Step 2, realizing remote control of a camera: the camera connected to the processor can remotely control all functions of the front end of the camera, such as resolution, sensitivity, shutter speed, frame rate, image parameters and the like through a camera control interface of the processor software, and no operation is required by technicians on site.
Step 3, camera signal processing: since the front end of the camera is designed into an IP solution in consideration of the actual scene, the IP flow output by the camera is compressed and encoded by H.264/265, and the processor end needs to perform decoding and restoration before executing the subsequent flow, and the subsequent flow is as follows:
(301) Audio and video de-embedding: and (3) the packed audio and video signals are decomposed into independent audio and video signals for subsequent separate processing.
(302) Video processing: the video processing needs to be distinguished according to the characteristics of 8K signals, if the signal source is 8K 2D, the processing steps only need to execute image tone and special effects (such as adding a skin grinding special effect, overlapping caption special effects and the like); if the signal source is 8K 2D or 3D VR, the signal processing link will execute VR ERP image correction first, and the deformed picture that VR camera fisheye lens was shot carries out ERP (equidistant columnar projection) processing to the non-deformed picture of normal perspective effect.
(303) 3D VR error correction and binocular synthesis: if the input signal is 8K 3D VR picture, two processing links are needed, firstly, the 3D parallax pictures with 3D parallax pictures shot by the two-eye lens of the camera are subjected to ERP correction, then, the two-eye parallax pictures are subjected to repeated comparison, whether the vertical and rotation errors exist or not is judged, and if the vertical and rotation errors exist, picture amplification and alignment are needed through a correction function (the same object image in the center part of the left and right eye pictures is in a horizontal alignment position); and then, the corrected picture, the respective 1:1 picture images of the left eye and the right eye, and the parallel (side by side mode) are collectively called a pair of 2:1 images, namely 3D VR SBS (side by side) mode effect, and the images are finally adjusted and output 8K 3D VR images.
(304) Audio signal processing: according to the amount of data processed by the video end, a certain delay amount (generally about tens to hundreds of ms) can be generated, the audio processing part can carry out phase adjustment on the audio processing part and the processed video through delay adjustment, sound and picture synchronization is ensured (the minimum adjustment value of the adjustment amount of software design is 1ms, the maximum adjustment value is selectable according to the maximum value of a buffer), in addition, the delay adjustment can also carry out independent adjustment on possible signal errors between 3D (firstly processing errors between binocular, and then unifying the processing and the overall error of audio), and the audio processing part is specially designed according to the characteristics of a VR camera.
(305) And (3) video and audio signal synthesis: and then re-synthesizing the adjusted video and audio signals (audio/video embedding). Step 4, storing and outputting: the camera processor is provided with a local storage function, and can directly store the processed 8K 2D or 8K VR signals locally for copying and archiving; various types of signal output may be performed as needed. Mainly comprises three kinds of components:
(401) 4K live broadcast: according to the calculation of the upper limit of the computational power of the GPU, the camera processor can realize real-time push of 4K resolution level (reducing 8K original signals to 4K resolution) for 4K live broadcast use of a single channel (supporting IP stream coding encapsulation);
(402) Baseband signal output of 8k 60p level: through the installed 8K SDI (12G SDIX 4) baseband signal conversion output card, uncompressed 8K 60P-level video signals can be directly output, and equipment such as a broadcasting-level professional 8K video switching station or a professional video recorder (used for manufacturing high-end field multi-level 8K) can be accessed.
(403) 8K VR head display output: through the DP2.0 interface of camera processor, can connect and support the VR head that the serial line inserted like PICO NEO3/4 and show the terminal station, through the camera processor software platform development with the VR head show the direct-connected function, can directly see real-time 8K 3D VR picture in the VR head shows, let the producer obtain the most intuitive VR effect experience.
The customized and developed high-configuration X86 architecture server platform, the special interface card and the customized and developed software integrated platform are combined into a special 8K camera access and processing platform, and the customized and developed high-configuration X86 architecture server platform is used for realizing the functions of remote control, high-precision adjustment of camera parameters, ERP deformation correction of VR images, synchronous specialized adjustment of sound and picture, 8K 60P level signal baseband output and the like of the customized and developed 8K IP interface camera or 8K 2D/3D VR IP interface camera, and can meet the requirements of high-quality broadcast and television level image program production.
The main characteristics are as follows:
(1) 8K IP interface 8K portable camera supporting domestic custom development and 8K 2D/3D VR IP interface camera custom development;
(2) Support the high-quality signal processing such as encoding and decoding, remote control, remote camera high-precision parameter adjustment of 8K 60P camera signal;
(3) Support real-time signal processing and VR figure correction and 3D error adjustment function of 8K 2D/3D VR image;
(4) Aiming at professional manufacturing requirements, the time delay adjustment (the precision can reach ms level) of the accessed video and audio can be carried out separately or integrally;
(5) The 12G SDI baseband output interface supporting the broadcasting and television level can be connected with a synchronous signal, and can be used for seamless access of equipment and signals of a high-end broadcasting and television level large-scale rebroadcasting system.
The foregoing examples have shown only the preferred embodiments of the invention, which are described in more detail and are not to be construed as limiting the scope of the invention. It should be noted that modifications, improvements and substitutions can be made by those skilled in the art without departing from the spirit of the invention, which are all within the scope of the invention.
Claims (2)
1. High definition camera processing platform that can freely switch and support high definition VR preparation, its characterized in that includes: a 2D camera with resolution of 8K and frame rate of 60P, a 3DVR camera with resolution of 8K and frame rate of 60P, a switch, a control processing module, an interface operation module and a storage; the 2D camera and the 3DVR camera are electrically connected with the switch, the switch is electrically connected with the control processing module and the interface operation module, and the control processing module is connected with the storage through wires;
a switch for setting a separate IP address for each camera;
the interface operation module is used for providing a platform software interface, searching IP addresses through the platform software interface, identifying a camera accessed by the switch, selecting an equipment address to be accessed, selecting a camera type, completing connection work of the camera and the control processing module, and selectively controlling functions of resolution, light sensitivity, shutter speed, frame rate and image parameters of the camera;
the control processing module is used for carrying out H.264/265 compression coding on the IP stream output by the camera, and carrying out subsequent flow after decoding and restoring, wherein the subsequent flow is that audio and video de-embedding is carried out firstly, and the packaged audio and video signals are decomposed into independent audio and video signals for subsequent separate processing;
then video processing is carried out, and distinguishing is carried out according to the characteristics of the signals with 8K resolution ratio;
if the signal source is 8K 2D, the processing step only needs to execute image shadow and special effects, wherein the special effects comprise the addition of the special effects of polishing and the superposition of caption stunts;
if the signal source is one of 2D VR with resolution of 8K and 3D VR with resolution of 8K, the signal processing link firstly executes VR ERP image correction, and carries out ERP processing on a deformed picture shot by a fish-eye lens of the VR camera to obtain a non-deformed picture with normal perspective effect;
if the input signal is a 3D VR picture with the resolution of 8K of a 3DVR camera, two processing links are needed to be added, after ERP correction is carried out on 3D parallax pictures shot by each of the two fisheye lenses of the camera, then the two processing links are subjected to repeated comparison, whether vertical and rotation errors exist or not is judged, if the errors exist, the error correction is carried out, then the corrected pictures are combined in parallel, the 1:1 picture images of the left eye and the right eye are combined into a pair of 2:1 images, namely, a 3D VR SBS mode effect is achieved, the images are 3D VR images with the resolution of 8K which can be output after final adjustment, and the final 3D VR images with the resolution of 8K are output;
the audio processing part is subjected to delay adjustment according to the processing data quantity of the video end, the minimum adjustment value of the adjustment quantity is 1ms, the maximum adjustment value is selected and adjusted according to the maximum value of the buffer memory, the adjustment is performed with phase alignment with the processed video to ensure sound-picture synchronization, meanwhile, audio signal processing is specially designed for the VR camera according to the characteristics of the VR camera, and independent adjustment is performed for signal errors between 3D VR binocular heads, wherein the independent adjustment is to firstly process errors between binocular heads, and then uniformly process the errors with the whole audio;
finally, synthesizing video and audio signals, and re-synthesizing the adjusted video and audio signals, wherein the re-synthesis is audio and video embedding;
the storage is used for locally storing the 8K 2D signal processed by the 2D camera and the 8K VR signal of the 3DVR camera, copying and archiving the signals at the same time, and outputting various types of signals according to the requirement, wherein the various types of signals comprise 4K live broadcast, baseband signal output with the resolution of 8K and the frame number of 60P and VR head display output with the resolution of 8K;
the 4K live broadcast is calculated according to the upper limit of the computational power of the GPU, the camera processor reduces the 8K original signal to 4K resolution, 4K resolution level real-time push stream is realized, and the push stream is used for 4K live broadcast of a single channel and supports IP stream coding encapsulation;
the baseband signal output with the resolution of 8K and the frame number of 60P is realized by directly outputting uncompressed 8K 60P-level video signals through an installed 8K SDI baseband signal conversion output card, accessing a broadcasting-level professional 8K video switching station and professional video recorder equipment for manufacturing high-end field multi-machine 8K, wherein the transmission bandwidth of SDI baseband signals is four paths of 12G SDIX4 signals;
the VR head display output with the resolution of 8K is that a VR head display terminal supporting PICO NEO3/4 serial stream line access can be connected through a DP2.0 interface of a camera processor, a direct connection function with the VR head display is developed through a software platform of the camera processor, a real-time 3D VR picture with the resolution of 8K is directly seen in the VR head display, and a manufacturer can obtain visual VR effect experience;
the customized and developed 8K IP interface camera or 8K 2D/3D VR IP interface camera is remotely controlled, camera parameters are adjusted with high precision, VR images are corrected by ERP deformation, sound and picture synchronization specialized adjustment and 8K 60P level signal baseband output are realized by combining the customized and developed high-configuration X86 architecture server platform, the special interface card and the software integrated platform into a special 8K camera access and processing platform.
2. The high-definition camera processing platform capable of freely switching and supporting high-definition VR manufacturing as set forth in claim 1, wherein: the error correction is to perform picture amplification and alignment so that the same object image in the center part of the left and right eye pictures is in a horizontal alignment position.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311059473.4A CN117041460B (en) | 2023-08-22 | 2023-08-22 | High-definition camera processing platform capable of being freely switched and supporting high-definition VR manufacture |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311059473.4A CN117041460B (en) | 2023-08-22 | 2023-08-22 | High-definition camera processing platform capable of being freely switched and supporting high-definition VR manufacture |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN117041460A CN117041460A (en) | 2023-11-10 |
| CN117041460B true CN117041460B (en) | 2024-02-27 |
Family
ID=88642912
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202311059473.4A Active CN117041460B (en) | 2023-08-22 | 2023-08-22 | High-definition camera processing platform capable of being freely switched and supporting high-definition VR manufacture |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN117041460B (en) |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114286022A (en) * | 2021-12-31 | 2022-04-05 | 北京中联合超高清协同技术中心有限公司 | Support direct broadcast of 5G's 8K super high definition video full service rebroadcasting car |
| CN115567756A (en) * | 2022-08-24 | 2023-01-03 | 北京博雅睿视科技有限公司 | View-angle-based VR video system and processing method |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8675138B2 (en) * | 2010-07-15 | 2014-03-18 | Broadcom Corporation | Method and apparatus for fast source switching and/or automatic source switching |
-
2023
- 2023-08-22 CN CN202311059473.4A patent/CN117041460B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114286022A (en) * | 2021-12-31 | 2022-04-05 | 北京中联合超高清协同技术中心有限公司 | Support direct broadcast of 5G's 8K super high definition video full service rebroadcasting car |
| CN115567756A (en) * | 2022-08-24 | 2023-01-03 | 北京博雅睿视科技有限公司 | View-angle-based VR video system and processing method |
Also Published As
| Publication number | Publication date |
|---|---|
| CN117041460A (en) | 2023-11-10 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10469873B2 (en) | Encoding and decoding virtual reality video | |
| WO2021083176A1 (en) | Data interaction method and system, interaction terminal and readable storage medium | |
| US6704042B2 (en) | Video processing apparatus, control method therefor, and storage medium | |
| CN102761702B (en) | For method and the imaging system of the image overlap in mobile communication equipment | |
| US20180098090A1 (en) | Method and Apparatus for Rearranging VR Video Format and Constrained Encoding Parameters | |
| US20220394226A1 (en) | Free viewpoint video generation and interaction method based on deep convolutional neural network | |
| US20100238264A1 (en) | Three dimensional video communication terminal, system, and method | |
| CN105264876A (en) | Method and system for low cost television production | |
| CN108848354B (en) | VR content camera system and working method thereof | |
| CN1209248A (en) | Image conversion and encoding techniques | |
| WO2021083178A1 (en) | Data processing method and system, server and storage medium | |
| CN107426491B (en) | Implementation method of 360-degree panoramic video | |
| CN108234933A (en) | The method and system of real-time splicing panorama image based on multiway images signal processing | |
| WO2021083174A1 (en) | Virtual viewpoint image generation method, system, electronic device, and storage medium | |
| CN103905668A (en) | Telephone set with video function and video meeting method thereof | |
| CN106210525A (en) | For realizing camera and the method for net cast | |
| JP2019514313A (en) | Method, apparatus and stream for formatting immersive video for legacy and immersive rendering devices | |
| CN114071116A (en) | Video processing method and device, electronic equipment and storage medium | |
| CN101106717B (en) | Video player circuit and video display method | |
| JP2012522285A (en) | System and format for encoding data and 3D rendering | |
| TWI524730B (en) | Method and system for utilizing depth information as an enhancement layer | |
| CN117041460B (en) | High-definition camera processing platform capable of being freely switched and supporting high-definition VR manufacture | |
| JPWO2011099254A1 (en) | Data processing apparatus and data encoding apparatus | |
| CN111406404B (en) | Compression method, decompression method, system and storage medium for obtaining video file | |
| US20130120530A1 (en) | Image processing apparatus and method and program |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |