CN114003331A - LED circular screen virtual reality synthesis method and device, storage medium and electronic equipment - Google Patents
LED circular screen virtual reality synthesis method and device, storage medium and electronic equipment Download PDFInfo
- Publication number
- CN114003331A CN114003331A CN202111327053.0A CN202111327053A CN114003331A CN 114003331 A CN114003331 A CN 114003331A CN 202111327053 A CN202111327053 A CN 202111327053A CN 114003331 A CN114003331 A CN 114003331A
- Authority
- CN
- China
- Prior art keywords
- virtual
- host
- camera
- picture
- circular screen
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G06F9/451—Execution arrangements for user interfaces
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
- G03B15/00—Special procedures for taking photographs; Apparatus therefor
- G03B15/08—Trick photography
- G03B15/10—Trick photography using back-projection, i.e. blending artificial background with real foreground
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T11/00—2D [Two Dimensional] image generation
- G06T11/20—Drawing from basic elements, e.g. lines or circles
- G06T11/206—Drawing of charts or graphs
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/30—Image reproducers
- H04N13/363—Image reproducers using image projection screens
Abstract
The invention provides a method, a device, a storage medium and electronic equipment for synthesizing LED circular screen virtual reality, and relates to the technical field of virtual film production.
Description
Technical Field
The invention relates to the technical field of virtual film production, in particular to a method and a device for synthesizing LED circular screen virtual reality, a storage medium and electronic equipment.
Background
Because the green screen shooting environment is mature at present, the current video synthesis method is mostly realized by green screen shooting and later-stage image matting.
The method adopts a green curtain shooting environment to produce the film, and needs post production, so that the scene of shooting can not see the picture which is finally required to be presented, the problem of poor real-time performance exists, actors need to perform according to director description when shooting, the director guides actors to perform according to feeling, the post production needs to be performed according to actor performance content, and the presentation of the final effect can be influenced if the feedback of two-side communication is poor.
Disclosure of Invention
The invention aims to solve the problems in the background art and provides a method, a device, a storage medium and electronic equipment for synthesizing LED circular screen virtual reality.
In order to achieve the above object, the present invention firstly provides a method for synthesizing an LED circular screen virtual reality, comprising the following steps:
projecting a scene in a first host illusion engine to an LED circular screen;
acquiring real camera position data and transmitting the real camera position data to a second host;
generating a virtual camera in a ghost engine of a second host according to the real camera position data;
acquiring a real camera picture and accessing the real camera picture into a ghost engine of a second host;
acquiring a virtual camera picture in a second host machine virtual engine;
and synthesizing the real camera picture and the virtual camera picture to obtain an LED circular screen virtual reality synthesized picture.
Optionally, according to each frame of real camera image, the first host transfers the real camera position data into the second host buffer pool in real time.
Optionally, the second host updates the real camera position data from the cache pool according to a preset time interval.
Optionally, the virtual camera pictures include a first virtual camera picture and a second virtual camera picture, the first virtual camera picture is a special effect picture, and the second virtual camera picture is a matting picture.
Optionally, the virtual objects in the second host virtual engine are rendered according to different levels, which are created to classify the virtual objects in the second host virtual engine, to generate the virtual camera view.
Optionally, the matting the ground in the real camera image includes the following steps:
acquiring position data of an LED circular screen model in a virtual engine;
and scratching the real camera video picture according to the LED circular screen model position data.
The invention also provides an LED circular screen virtual reality synthesis device, which comprises:
a projection module configured to project a scene in a first host fantasy engine to an LED ringscreen;
a location module configured to acquire real camera location data and transmit the real camera location data to a second host;
a camera module configured to generate a virtual camera in a ghost engine of a second host according to the real camera position data;
an access module configured to acquire a real camera view and access the real camera view into a ghost engine of a second host;
a virtual module configured to acquire a virtual camera view in a second host ghost engine;
and the synthesis module is configured to synthesize the real camera picture and the virtual camera picture to obtain an LED circular screen virtual reality synthesis picture.
The invention also provides a computer readable storage medium, on which a computer program is stored, which when executed by a processor implements the above-mentioned LED circular screen virtual reality synthesizing method.
The invention also proposes an electronic device comprising: one or more processors; a storage device for storing one or more programs, which when executed by the one or more processors, cause the one or more processors to implement the above-mentioned LED ringscreen virtual reality composition method.
The invention has the beneficial effects that:
according to the LED circular screen virtual reality synthesis method provided by the embodiment of the invention, the two hosts are adopted to respectively perform real-time synthesis of the real camera picture and the virtual camera picture on the basis of back scene projection and virtual film production, wherein the picture presentation in the real camera is influenced by adjusting the scene in the first host virtual engine, the second host controls virtual and real objects and special effects to be synthesized, the color tone of the finally presented picture and the like, the two hosts do not interfere with each other during the LED circular screen virtual reality synthesis, the flexibility of picture processing in the virtual reality synthesis process is very high, and the advantage of real-time preview of the final picture effect is achieved.
The features and advantages of the present invention will be described in detail by embodiments in conjunction with the accompanying drawings.
Drawings
Fig. 1 is a schematic flow chart of a method for synthesizing an LED circular screen virtual reality according to an embodiment of the present invention;
FIG. 2 is a schematic flow chart of the present invention for matting the LED circular screen in the real camera image;
fig. 3 is a block diagram of a structure of an LED circular screen virtual reality synthesizer according to an embodiment of the present invention.
Detailed Description
The present invention will be described in further detail below with reference to specific examples in order to facilitate understanding by those skilled in the art.
Fig. 1 schematically shows a flow diagram of an LED circular screen virtual reality synthesis method according to an embodiment of the present invention. As shown in fig. 1, the virtual reality scene implementation method includes steps S10 to S60:
s10, projecting the scene in the first host illusion engine to an LED circular screen;
s20, acquiring real camera position data and transmitting the real camera position data to a second host;
s30, generating a virtual camera in a ghost engine of the second host according to the real camera position data;
s40, acquiring a real camera picture and accessing the real camera picture into a ghost engine of a second host;
s50, acquiring a virtual camera picture in the second host machine illusion engine;
and S60, synthesizing the real camera picture and the virtual camera picture to obtain an LED circular screen virtual reality synthesized picture.
In the LED circular screen virtual reality synthesis method provided by the embodiment of the invention, two hosts are adopted to respectively perform projection of a background and real-time synthesis of a real camera picture and a virtual camera picture on the basis of virtual film production, wherein the picture presentation in a real camera is influenced by adjusting the scene in the first host virtual engine, a virtual object and a special effect which need to be synthesized, the color tone of a finally presented picture and the like are controlled by the second host, the two hosts do not interfere with each other when performing LED circular screen virtual reality synthesis, the flexibility of picture processing in the virtual reality synthesis process is high, and the LED circular screen virtual reality synthesis method has the advantage of being capable of previewing the final picture effect in real time.
The following describes, in more detail, steps of the LED circular screen virtual reality synthesizing method according to an embodiment of the present invention with reference to the accompanying drawings and the embodiment.
In step S10, the scene in the first host ghost engine is projected to the LED ringscreen.
In one embodiment of the invention, the first host projects the scene picture in the illusion engine to the LED circular screen by utilizing an NDisplay technology.
It should be noted that the illusion engine is widely applied in the field of game production, and the illusion editor (unrealized) is an operation tool with the idea of "what you see is what you get" as a design concept, and can be well applied in game development. For example, the data attribute editing tool can enable a level designer to freely set an object in a game or directly perform optimized setting by a programmer in a script writing mode; the map editing tool can enable the art developers of the games to freely adjust the height of the terrain in a lifting mode; the graphical material editing tool can enable developers to freely mediate colors, alpha channels and chartlet coordinates in the material to define the required material content.
The illusion Engine can be an unregeal Engine, a Unity 3D Engine or an Engine developed by itself.
Step S20, acquiring real camera position data and transmitting the real camera position data to the second host.
In an embodiment, when a first host projects a scene onto an LED screen, the first host receives real camera position data sent by a positioning device bound to a real camera, and according to each frame of real camera image, the first host transmits the real camera position data to a cache pool of a second host through a UDP protocol in real time, and the second host updates the real camera position data from the cache pool according to a preset time interval. The data in the buffer pool can be regarded as a group of queues which are arranged according to the entering time, and the first host machine delays for several frames to obtain the real camera position data from the buffer pool and assigns the real camera position data to a virtual camera in a ghost engine of the second host machine by adjusting the preset time interval.
In the embodiment, the problem of tearing of the virtual camera picture and the real shooting picture caused by delay is solved by setting the data cache pool and adjusting the interval time difference, so that improvement is realized on the original basis.
Step S30, generating a virtual camera in the illusion engine of the second host according to the real camera position data.
In one embodiment, the camera is calibrated to enable a real camera picture and a virtual camera picture to present a correct perspective relation, so that a better effect is obtained when a subsequent real camera picture and a virtual camera picture are synthesized.
Step S40, acquiring a real camera picture and accessing the real camera picture into the illusion engine of the second host.
In an embodiment, the second host is installed with a video capture card, the second host accesses a real camera picture by using the video capture card, and then accesses the real camera picture into the illusion engine as a MediaTexture picture through a corresponding plug-in, it should be noted that the MediaTexture picture is used as a carrier for guiding an external video into the illusion engine, and is substantially a map, which can be understood as rendering each frame of a real camera video onto the map, and in addition, the illusion engine encapsulates different plug-ins for two video capture cards, and the function of the plug-ins is to guide the picture captured by the capture cards into the illusion engine.
In step S50, a virtual camera screen in the second host ghost engine is obtained.
Before the virtual camera picture is rendered, a virtual scene object needs to be created in the second host virtual engine in advance. Virtual scene objects, such as Photoshop, Substance Painter, etc., can be created by mapping software and then imported into the virtual engine.
In the virtual production of the LED circular screen, a scene picture in a ghost engine needs to be projected onto the LED circular screen as a background, and then a real prop is replaced by superimposing other elements, such as a CG special effect and a virtual scene object, and then a real object or an actor is photographed to realize the virtual production process of the entire LED circular screen.
In order to realize real-time synthesis by taking a picture shot by a real camera as a background and taking a picture of a virtual camera as a foreground, in an embodiment, the virtual camera picture comprises a first virtual camera picture and a second virtual camera picture, wherein the first virtual camera picture is a special-effect picture, and the second virtual camera picture is a matting picture. Specifically, virtual objects in the second host virtual engine are rendered according to different levels, which are created to classify the virtual objects in the second host virtual engine, to generate a virtual camera view.
The method comprises the steps that a special effect made in a ghost engine is independently placed in a level for rendering to obtain a special effect picture, and the scratched picture needs to create a model which is restored by one to one with a scratched real object and is placed in a scene at the same position, such as an LED (light emitting diode) circular screen model.
Because in the virtual film-making of LED ring curtain, LED ring curtain includes top curtain and ring curtain, and ground links to each other with the ring curtain, so ground can be shot to real camera, need to dig the image to LED ring curtain in the real camera picture.
Fig. 2 schematically illustrates a flow chart of matting an LED circular screen in a real camera picture in an embodiment of the present invention.
Referring to fig. 2, the matting of the ground in the real camera image includes the following steps:
and step S70, acquiring the position data of the LED circular screen model in the virtual engine.
And step S80, matting the real camera video picture according to the LED circular screen model position data.
By acquiring the position data of the LED circular screen model in the virtual engine and then using the composition frame provided by the illusion engine as a layer of mask, the mask can scratch the floor in the real picture and close the virtual picture, thereby solving the problem that the virtual reality is synthesized when the real camera shoots the floor.
And step S60, synthesizing the real camera picture and the virtual camera picture to obtain an LED circular screen virtual reality synthesized picture.
In one embodiment, the second host superimposes the real camera picture, the matting picture and the special-effect picture together by using a composition frame to form a final LED circular screen virtual reality composite picture, and finally outputs the picture through an acquisition card so as to synthesize the picture in real time.
Based on the above LED circular screen virtual reality synthesis method, an embodiment of the present invention further provides an LED circular screen virtual reality synthesis method apparatus, as shown in fig. 3, the apparatus includes the following modules:
a projection module 15 configured to project a scene in the first host ghost engine to the LED ring screen;
a position module 25 configured to acquire real camera position data and transmit the real camera position data to a second host;
a camera module 35 configured to generate a virtual camera in a ghost engine of the second host from the real camera position data;
an access module 45 configured to acquire a real camera view and access the real camera view into a ghost engine of the second host;
a virtual module 55 configured to acquire a virtual camera screen in the second host ghost engine;
and a synthesizing module 65 configured to synthesize the real camera picture and the virtual camera picture to obtain an LED circular screen virtual reality synthesized picture.
In summary, the LED circular screen virtual reality synthesizing apparatus according to the embodiment of the present invention can be implemented in a program form and run on a computer device. The memory of the computer device may store various program modules constituting the LED circular screen virtual reality synthesizing apparatus, such as the projection module 15, the position module 25, the camera module 35, the access module 45, the virtual module 55, and the synthesizing module 65 shown in fig. 3. The program modules constitute a program that causes a processor to execute the steps in the LED circular screen virtual reality synthesis method according to the embodiments of the present application described in the present specification.
Embodiments of the present invention further provide a computer-readable storage medium, on which a computer program is stored, where the computer program, when executed by a processor, implements steps in an LED circular screen virtual reality synthesis method according to various embodiments of the present application.
An embodiment of the present invention further provides an electronic device, including: one or more processors; a storage device, configured to store one or more programs, which when executed by the one or more processors, cause the one or more processors to implement the steps in an LED circular screen virtual reality synthesis method according to various embodiments of the present application.
The technical features of the embodiments may be arbitrarily combined, and for the sake of brevity, all possible combinations of the technical features in the embodiments are not described, but should be considered as the scope of the present specification as long as there is no contradiction between the combinations of the technical features.
The above embodiments are illustrative of the present invention, and are not intended to limit the present invention, and any simple modifications of the present invention are within the scope of the present invention. The above description is only a preferred embodiment of the present invention, and the protection scope of the present invention is not limited to the above embodiments, and all technical solutions belonging to the idea of the present invention belong to the protection scope of the present invention. It should be noted that modifications and embellishments within the scope of the invention may occur to those skilled in the art without departing from the principle of the invention, and are considered to be within the scope of the invention.
Claims (9)
1. An LED circular screen virtual reality synthesis method is characterized by comprising the following steps:
projecting a scene in a first host illusion engine to an LED circular screen;
acquiring real camera position data and transmitting the real camera position data to a second host;
generating a virtual camera in a ghost engine of a second host according to the real camera position data;
acquiring a real camera picture and accessing the real camera picture into a ghost engine of a second host;
acquiring a virtual camera picture in a second host machine virtual engine;
and synthesizing the real camera picture and the virtual camera picture to obtain an LED circular screen virtual reality synthesized picture.
2. The method for synthesizing the LED circular screen virtual reality as claimed in claim 1, wherein the real camera position data is transmitted to the second host buffer pool by the first host in real time according to each frame of real camera picture.
3. The LED circular screen virtual reality synthesis method according to claim 2, wherein the second host updates the real camera position data from the buffer pool according to a preset time interval.
4. The method for synthesizing the LED circular screen virtual reality as claimed in claim 1, wherein the virtual camera frames include a first virtual camera frame and a second virtual camera frame, the first virtual camera frame is a special effect frame, and the second virtual camera frame is a matting frame.
5. The LED ringscreen virtual reality synthesis method of claim 4, wherein the virtual objects in the second host virtual engine are rendered according to different levels, which are created to classify the virtual objects in the second host virtual engine, to generate the virtual camera view.
6. The LED circular screen virtual reality synthesis method according to claim 4, wherein the matting the ground in the real camera picture comprises the following steps:
acquiring position data of an LED circular screen model in a virtual engine;
and scratching the real camera video picture according to the LED circular screen model position data.
7. The utility model provides a LED encircles curtain virtual reality synthesizer which characterized in that includes:
a projection module configured to project a scene in a first host fantasy engine to an LED ringscreen;
a location module configured to acquire real camera location data and transmit the real camera location data to a second host;
a camera module configured to generate a virtual camera in a ghost engine of a second host according to the real camera position data;
an access module configured to acquire a real camera view and access the real camera view into a ghost engine of a second host;
a virtual module configured to acquire a virtual camera view in a second host ghost engine;
and the synthesis module is configured to synthesize the real camera picture and the virtual camera picture to obtain an LED circular screen virtual reality synthesis picture.
8. A computer-readable storage medium, on which a computer program is stored, which when executed by a processor, implements the LED circular screen virtual reality synthesizing method according to any one of claims 1 to 6.
9. An electronic device, comprising:
one or more processors;
a storage device for storing one or more programs which, when executed by the one or more processors, cause the one or more processors to implement the LED ringscreen virtual reality synthesis method of any one of claims 1 to 6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111327053.0A CN114003331A (en) | 2021-11-10 | 2021-11-10 | LED circular screen virtual reality synthesis method and device, storage medium and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111327053.0A CN114003331A (en) | 2021-11-10 | 2021-11-10 | LED circular screen virtual reality synthesis method and device, storage medium and electronic equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114003331A true CN114003331A (en) | 2022-02-01 |
Family
ID=79928716
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111327053.0A Pending CN114003331A (en) | 2021-11-10 | 2021-11-10 | LED circular screen virtual reality synthesis method and device, storage medium and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114003331A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116843819A (en) * | 2023-07-10 | 2023-10-03 | 上海随幻智能科技有限公司 | Green curtain infinite extension method based on illusion engine |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN211531171U (en) * | 2020-03-26 | 2020-09-18 | 连云港斯克斯机器人科技有限公司 | Virtual studio synchronizing signal separation system |
| CN112040092A (en) * | 2020-09-08 | 2020-12-04 | 杭州时光坐标影视传媒股份有限公司 | Real-time virtual scene LED shooting system and method |
| CN112866507A (en) * | 2021-01-13 | 2021-05-28 | 中国传媒大学 | Intelligent panoramic video synthesis method and system, electronic device and medium |
| CN113347373A (en) * | 2021-06-16 | 2021-09-03 | 潍坊幻视软件科技有限公司 | Image processing method for making special-effect video in real time through AR space positioning |
-
2021
- 2021-11-10 CN CN202111327053.0A patent/CN114003331A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN211531171U (en) * | 2020-03-26 | 2020-09-18 | 连云港斯克斯机器人科技有限公司 | Virtual studio synchronizing signal separation system |
| CN112040092A (en) * | 2020-09-08 | 2020-12-04 | 杭州时光坐标影视传媒股份有限公司 | Real-time virtual scene LED shooting system and method |
| CN112866507A (en) * | 2021-01-13 | 2021-05-28 | 中国传媒大学 | Intelligent panoramic video synthesis method and system, electronic device and medium |
| CN113347373A (en) * | 2021-06-16 | 2021-09-03 | 潍坊幻视软件科技有限公司 | Image processing method for making special-effect video in real time through AR space positioning |
Non-Patent Citations (1)
| Title |
|---|
| 赵建军;陈俊良;黄竣鹏;: "电影虚拟化制作中的虚拟角色交互控制方法及实现", 现代电影技术, no. 12, pages 8 - 14 * |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116843819A (en) * | 2023-07-10 | 2023-10-03 | 上海随幻智能科技有限公司 | Green curtain infinite extension method based on illusion engine |
| CN116843819B (en) * | 2023-07-10 | 2024-02-02 | 上海随幻智能科技有限公司 | Green curtain infinite extension method based on illusion engine |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9554123B2 (en) | Cooperative photography | |
| US11425283B1 (en) | Blending real and virtual focus in a virtual display environment | |
| CN112929627B (en) | Virtual reality scene implementation method and device, storage medium and electronic equipment | |
| CN110866978A (en) | Camera synchronization method in real-time mixed reality video shooting | |
| CN106027855A (en) | Method and terminal for realizing virtual rocker arm | |
| US11232628B1 (en) | Method for processing image data to provide for soft shadow effects using shadow depth information | |
| US11176716B2 (en) | Multi-source image data synchronization | |
| US11615755B1 (en) | Increasing resolution and luminance of a display | |
| WO2023207452A1 (en) | Virtual reality-based video generation method and apparatus, device, and medium | |
| CN114003331A (en) | LED circular screen virtual reality synthesis method and device, storage medium and electronic equipment | |
| CN111598983A (en) | Animation system, animation method, storage medium, and program product | |
| CN102625130A (en) | Computer virtual three-dimensional scenario library-based synthetic shooting system | |
| WO2023236656A1 (en) | Method and apparatus for rendering interactive picture, and device, storage medium and program product | |
| CN108184054B (en) | Preprocessing method and preprocessing device for images shot by intelligent terminal | |
| US20240096035A1 (en) | Latency reduction for immersive content production systems | |
| US11677928B1 (en) | Method for image processing of image data for varying image quality levels on a two-dimensional display wall | |
| US11605171B1 (en) | Method and apparatus for processing reference inputs for video compositing with replacement | |
| US11450054B2 (en) | Method for operating a character rig in an image-generation system using constraints on reference nodes | |
| CN111179388B (en) | Cartoon editing method and terminal based on 3D scene | |
| CN114461165B (en) | Virtual-real camera picture synchronization method, device and storage medium | |
| CN114007017A (en) | Video generation method and device and storage medium | |
| CN117788647A (en) | Method, apparatus and computer readable medium for producing track animation | |
| WO2001020902A1 (en) | Method and system for producing animation |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |