CN115396603A - Virtual film production focusing synchronization system and method, storage medium and electronic equipment - Google Patents
Virtual film production focusing synchronization system and method, storage medium and electronic equipment Download PDFInfo
- Publication number
- CN115396603A CN115396603A CN202211012602.XA CN202211012602A CN115396603A CN 115396603 A CN115396603 A CN 115396603A CN 202211012602 A CN202211012602 A CN 202211012602A CN 115396603 A CN115396603 A CN 115396603A
- Authority
- CN
- China
- Prior art keywords
- rotation angle
- camera
- virtual
- optical function
- lens
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01B—MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
- G01B7/00—Measuring arrangements characterised by the use of electric or magnetic techniques
- G01B7/30—Measuring arrangements characterised by the use of electric or magnetic techniques for measuring angles or tapers; for testing the alignment of axes
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
- G03B13/00—Viewfinders; Focusing aids for cameras; Means for focusing for cameras; Autofocus systems for cameras
- G03B13/32—Means for focusing
- G03B13/34—Power focusing
- G03B13/36—Autofocus systems
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/12—Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
- H04L67/125—Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks involving control of end-device applications over a network
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/04—Synchronising
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Landscapes
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Health & Medical Sciences (AREA)
- Computing Systems (AREA)
- General Health & Medical Sciences (AREA)
- Medical Informatics (AREA)
- Computer Networks & Wireless Communication (AREA)
- Studio Devices (AREA)
Abstract
The invention discloses a virtual film-making focusing synchronization system and method, a storage medium and electronic equipment, and relates to the technical field of virtual film-making. When detecting the torsion of a zoom ring, a focusing ring and an aperture of the camera, the camera acquisition module sends real-time camera data to the virtual film-making server; the mapping unit is used for matching a target optical function in an optical function database according to the lens model and mapping real-time data of the camera into a focal length, a focal length pair and an aperture value; the illusion engine controls the virtual movie camera lens according to the focal length, the focusing distance and the aperture value. The real-time camera data in the real movie lens are collected, converted into a data format which can be identified by computer software according to different lens optical function characteristics and transmitted synchronously in real time, so that the synchronous control of the real and virtual cameras is realized, real shooting and virtual scenes are fused synchronously in real time to reach movie production standards, the creation flexibility is improved, and the production and realization of high-level movie lens languages can be carried out.
Description
Technical Field
The invention relates to the technical field of virtual film production, in particular to a virtual film production focusing synchronization system, a virtual film production focusing synchronization method, a storage medium and electronic equipment.
Background
Movies were produced more than 200 years ago as technology developed. Movie growth in technology also promotes new technology generation. The transition from the traditional film age to the digital photography age.
The virtual production technology is an important support technology in digital photography. Virtual film-making carries out film and television digital filming with the mode that virtual (background) reality (prospect) combine, lets the creation possess more possibilities, can't monitor the picture effect in real time when traditional green screen shoots, and to a great extent has influenced the film and television creation effect. And the virtual film production uses a space positioning system to acquire the position and the rotating scene of the camera in real time, synchronizes the data with the virtual camera in the virtual space by the virtual engine (UE 4, UE 5) and renders the corresponding background in real time for synthesis and output, thereby realizing a novel shooting mode which can be seen in real time.
However, the existing virtual production technology cannot realize real-time synchronous control of the data of the film camera lens and the virtual film camera of the illusion engines (UE 4 and UE 5) in the computer, which greatly affects the flexibility of creation, and causes the production and implementation of high-level film lens languages.
Disclosure of Invention
The present invention is directed to solve the problems of the background art, and provides a virtual film-making focusing synchronization system, a virtual film-making focusing synchronization method, a storage medium, and an electronic device.
The purpose of the invention can be realized by the following technical scheme:
in a first aspect of the embodiments of the present invention, a virtual production focusing synchronization system is provided, including a camera acquisition module and a virtual production server; the virtual production server comprises a mapping unit, an optical function database and a ghost engine; wherein:
the camera acquisition module is used for sending camera real-time data to the virtual production server when detecting that a zoom ring, a focusing ring and an aperture of the camera are twisted; the real-time camera data comprise a first rotation angle of a zoom ring, a second rotation angle of a focus ring, a third rotation angle of a diaphragm and a lens model of the camera;
the mapping unit is used for matching a target optical function corresponding to the lens model in the optical function database according to the lens model, and mapping the first rotation angle, the second rotation angle and the third rotation angle into a focal length, a focal length pair and an aperture value by using the target optical function; the preset optical function database stores optical functions of lenses of different models;
and the illusion engine is used for controlling the virtual film camera lens in the three-dimensional scene of the illusion engine according to the focal length, the focusing distance and the aperture value.
Optionally, the camera acquisition module comprises an angle sensor and a data transmission module;
the angle sensor is used for acquiring the first rotation angle, the second rotation angle and the third rotation angle;
and the data transmission module is used for packaging the first rotation angle, the second rotation angle, the third rotation angle and the lens model as the real-time data of the camera and sending the real-time data to the virtual production server.
Optionally, the target optical function includes a target module model corresponding to the lens model; the target module model is pre-trained according to historical measured data and is used for mapping the input first rotation angle, the input second rotation angle and the input third rotation angle into a focal length, a focusing distance and an aperture value.
Optionally, the illusion engine includes a depth of field calculation module and an image adjustment module; the target optical function also comprises a target circle of confusion parameter corresponding to the lens model;
the depth-of-field calculation module is used for calculating the current depth of field of the camera:
wherein Δ L, Δ L 1 And Δ L 2 The depth of field, the front depth of field and the rear depth of field are respectively, and delta, F, l and G are respectively the target circle of confusion parameter, the focal length, the focusing distance and the aperture value;
and the image adjusting module is used for adjusting the focus of an image picture according to the focal length and the depth of field to realize the control of the virtual movie camera lens in the three-dimensional scene of the illusion engine.
In a second aspect of the embodiments of the present invention, a virtual production focusing synchronization method is further provided, where the method is applied to a virtual production server, and the method includes:
receiving real-time camera data sent by a camera acquisition module; the camera real-time data is data acquired by the camera acquisition module when the camera acquisition module detects that a zoom ring, a focus ring and an aperture of the camera twist, and comprises a first rotation angle of the zoom ring, a second rotation angle of the focus ring, a third rotation angle of the aperture and a lens model of the camera;
matching a target optical function corresponding to the lens model in a preset optical function database according to the lens model, and mapping the first rotation angle, the second rotation angle and the third rotation angle into a focal length, a focusing distance and an aperture value by using the target optical function; the preset optical function database stores optical functions of lenses of different models;
and controlling the virtual movie camera lens in the three-dimensional scene of the illusion engine according to the focal length, the focusing distance and the aperture value.
Optionally, the target optical function includes a target module model corresponding to the lens model; the target module model is pre-trained according to historical measured data and is used for mapping the input first rotation angle, the input second rotation angle and the input third rotation angle into a focal length, a focusing distance and an aperture value.
Optionally, the target optical function further includes a target circle of confusion parameter corresponding to the lens model;
according to the focal length, the focusing length and the aperture value, the control of the virtual film camera lens in the virtual engine three-dimensional scene comprises the following steps:
calculating the current depth of field of the camera:
wherein Δ L, Δ L 1 And Δ L 2 The depth of field, the front depth of field and the rear depth of field are respectively, and delta, F, l and G are respectively the target circle of confusion parameter, the focal length, the focus-to-focus distance and the aperture value;
and adjusting the focus of an image picture according to the focal length and the depth of field to realize the control of the virtual film camera lens in the three-dimensional scene of the illusion engine.
In a third aspect of the embodiments of the present invention, a virtual production focusing synchronization method is further provided, where the method is applied to a camera acquisition module, and the method includes:
acquiring a first rotation angle of a zoom ring, a second rotation angle of a focus ring and a third rotation angle of a diaphragm of the camera through an angle sensor;
packaging the first rotation angle, the second rotation angle, the third rotation angle and the lens model of the camera to be used as real-time data of the camera, and sending the real-time data of the camera to a virtual production server; enabling the virtual production server to match a target optical function corresponding to the lens model in a preset optical function database according to the lens model, mapping the first rotation angle, the second rotation angle and the third rotation angle into a focal length, a focusing distance and an aperture value by using the target optical function, and controlling a virtual movie camera lens in a virtual engine three-dimensional scene according to the focal length, the focusing distance and the aperture value; the preset optical function database stores optical functions of lenses of different models.
The embodiment of the invention also provides a computer-readable storage medium, wherein a computer program is stored in the computer-readable storage medium, and when being executed by a processor, the computer program realizes any one of the virtual production focusing synchronization methods.
The embodiment of the invention also provides electronic equipment which comprises a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory are communicated with each other through the communication bus;
a memory for storing a computer program;
and the processor is used for realizing any one of the virtual production focusing synchronization methods when executing the program stored in the memory.
The embodiment of the invention provides a virtual film-making focusing synchronization system, which comprises a camera acquisition module and a virtual film-making server; the virtual production server comprises a mapping unit, an optical function database and a ghost engine; wherein: the camera acquisition module is used for sending camera real-time data to the virtual film-making server when detecting that a zoom ring, a focusing ring and an aperture of the camera are twisted; the real-time data of the camera comprises a first rotating angle of a zoom ring, a second rotating angle of a focusing ring, a third rotating angle of a diaphragm and the model of a lens of the camera; the mapping unit is used for matching a target optical function corresponding to the lens model in the optical function database according to the lens model and mapping the first rotating angle, the second rotating angle and the third rotating angle into a focal length, a focusing distance and an aperture value by using the target optical function; the preset optical function database stores optical functions of lenses of different models; and the illusion engine is used for controlling the virtual film camera lens in the three-dimensional scene of the illusion engine according to the focal length, the focusing distance and the aperture value. The real-time camera data in the real movie lens are collected, converted into a data format which can be recognized by computer software according to different lens optical function characteristics and synchronously transmitted in real time, so that the synchronous control of the real camera and the virtual camera is realized, real shooting and virtual scenes are synchronously fused in real time to reach movie production standards, the creation flexibility is improved, and the production and implementation of high-level movie lens languages can be carried out.
Drawings
The invention is further described below with reference to the accompanying drawings.
Fig. 1 is a system block diagram of a virtual film-making focusing synchronization system according to an embodiment of the present invention;
fig. 2 is a flowchart of a virtual production focusing synchronization method applied to a virtual production server according to an embodiment of the present invention;
fig. 3 is a schematic structural diagram of an electronic device according to an embodiment of the present invention.
Detailed Description
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
The embodiment of the invention provides a virtual film-making focusing synchronization system. Referring to fig. 1, fig. 1 is a system block diagram of a virtual production focusing synchronization system according to an embodiment of the present invention. The system comprises a camera acquisition module and a virtual production server; the virtual film production server comprises a mapping unit, an optical function database and a virtual engine; wherein:
the camera acquisition module is used for sending camera real-time data to the virtual film-making server when detecting that a zoom ring, a focusing ring and an aperture of the camera are twisted; the real-time camera data comprise a first rotation angle of the zoom ring, a second rotation angle of the focus ring, a third rotation angle of the diaphragm and the lens model of the camera;
the mapping unit is used for matching a target optical function corresponding to the lens model in the optical function database according to the lens model and mapping the first rotating angle, the second rotating angle and the third rotating angle into a focal length, a focusing distance and an aperture value by using the target optical function; the preset optical function database stores optical functions of lenses of different models;
and the illusion engine is used for controlling the virtual film camera lens in the three-dimensional scene of the illusion engine according to the focal length, the focusing distance and the aperture value.
The virtual film-making focusing synchronization system provided by the embodiment of the invention realizes the synchronous control of the real and virtual cameras by acquiring the real-time data of the camera in the real movie lens, converting the real-time data into the data format which can be identified by computer software according to the optical function characteristics of different lenses and synchronously transmitting the data format in real time, so that real shooting and virtual scenes are synchronously fused in real time to reach the movie production standard, the creation flexibility is improved, and the production and implementation of high-level movie lens languages can be carried out.
In one implementation, in reality, the camera can adjust the lens frame through the zoom ring, the focus ring and the aperture. The zoom ring is used for changing the focal length of the lens, and the visual angle of the picture, the size of the shot body and the perspective relation among all bodies are changed by adjusting the zoom ring. The focusing ring is used for changing the distance from the clearest plane to the lens, and is adjusted to ensure that the subject is clear. The film lens generally uses an electrodeless diaphragm, when the diaphragm is twisted, the aperture value is small, the aperture is large, the light incoming quantity is large, the aperture value is large, the aperture is small, the light incoming quantity is small, and the brightness of the lens picture can be controlled by adjusting the aperture value.
In one embodiment, the camera acquisition module includes an angle sensor and a data transmission module;
the angle sensor is used for acquiring a first rotating angle, a second rotating angle and a third rotating angle;
and the data transmission module is used for packaging the first rotation angle, the second rotation angle, the third rotation angle and the lens model as real-time data of the camera and sending the real-time data to the virtual production server.
In one embodiment, the angle sensor is any one of a P3015 type angle sensor or a P3022 type angle sensor.
In one implementation, the P3015 or P3022 type angle sensor may convert an angle into an electrical signal through the principle of electromagnetic induction, and when the object to be measured transmits the rotation angle to the sensor rotation shaft, the sensor outputs an electrical signal proportional to the rotation angle. The two devices can acquire the rotation angles of the zoom ring, the focusing ring and the aperture, and provide main data support for a real-time synchronization system.
In one embodiment, the target optical function includes a target module model corresponding to the lens model; the target module model is trained in advance according to historical measured data and is used for mapping the input first rotation angle, second rotation angle and third rotation angle into a focal length, a focal length pair and an aperture value.
In one embodiment, the illusion engine includes a depth of field calculation module and an image adjustment module; the target optical function also comprises a target circle of confusion parameter corresponding to the lens model;
the depth-of-field calculation module is used for calculating the current depth of field of the camera:
wherein Δ L, Δ L 1 And Δ L 2 The depth of field, the front depth of field and the rear depth of field are respectively, and delta, F, l and G are respectively a target circle of confusion parameter, a focal length, a focusing distance and an aperture value;
and the image adjusting module is used for adjusting the focus of an image picture according to the focal length and the depth of field and realizing the control of the virtual film camera lens in the three-dimensional scene of the illusion engine.
In one implementation, the depth of field is controlled by a zoom ring, an aperture, and a focus ring.
The embodiment of the invention also provides a virtual production focusing synchronization method based on the same inventive concept, and the method is applied to a virtual production server. Referring to fig. 2, fig. 2 is a flowchart of a virtual production focusing synchronization method applied to a virtual production server according to an embodiment of the present invention. The method may comprise the steps of:
s201, receiving real-time camera data sent by a camera acquisition module.
And S202, matching a target optical function corresponding to the lens model in a preset optical function database according to the lens model, and mapping the first rotation angle, the second rotation angle and the third rotation angle into a focal length, a focusing distance and an aperture value by using the target optical function.
And S203, controlling the virtual movie camera lens in the three-dimensional scene of the illusion engine according to the focal length, the focusing distance and the aperture value.
The camera real-time data is data collected by the camera when the zoom ring, the focus ring and the aperture twist are detected, and comprises a first rotation angle of the zoom ring, a second rotation angle of the focus ring, a third rotation angle of the aperture and a lens model of the camera. The preset optical function database stores optical functions of lenses of different models.
The virtual film production focusing synchronization method provided by the embodiment of the invention realizes the synchronous control of the real and virtual cameras by acquiring the real-time data of the camera in the real movie lens, converting the real-time data into the data format which can be identified by computer software according to the optical function characteristics of different lenses and synchronously transmitting the data format in real time, so that the real shooting and the virtual scene are synchronously fused in real time to reach the movie production standard, the creation flexibility is improved, and the production and implementation of high-level movie lens languages can be carried out.
In an implementation mode, due to the fact that a focal distance aperture corresponding to a lens of each camera and a focusing distance (different angles are needed for rotation), a user can set data of cameras of different models in a menu of an oled in a single chip microcomputer in advance, a specific operation process is that 6-8 groups of angles and corresponding positions are set in a new model setting interface, the single chip microcomputer stores the data into an EEPROM after the data are processed through a mapping function, when the user starts to use a camera of a certain model, a screen such as a rotary focal distance aperture can display the focal distance of the current camera of the model in real time (a specific operation method is that the current angle value read after the processing of the mapping function can be directly converted into a needed focal distance equivalent value), and the displayed data can be stored into an SD card in real time and directly output to a computer through a serial port.
In one embodiment, the target optical function includes a target module model corresponding to the lens model; the target module model is trained in advance according to historical measured data and is used for mapping the input first rotation angle, second rotation angle and third rotation angle into a focal length, a focal length pair and an aperture value.
In one embodiment, the target optical function further includes a target circle of confusion parameter corresponding to the lens model;
step S203 includes:
step one, calculating the current depth of field of the camera:
wherein Δ L, Δ L 1 And Δ L 2 Respectively depth of field, front depth of field and back depth of field, delta, F, l and G respectively being a target circle of confusion parameter, a focal length, a focusing distance and an aperture value;
and step two, adjusting the focus of the image picture according to the focal length and the depth of field, and realizing the control of the virtual film camera lens in the virtual engine three-dimensional scene.
The embodiment of the invention also provides a virtual film-making focusing synchronization method based on the same inventive concept, and the method is applied to a camera acquisition module. The method may comprise the steps of:
the method comprises the steps that firstly, a first rotating angle of a zooming ring, a second rotating angle of a focusing ring and a third rotating angle of an aperture of a camera are collected through an angle sensor.
And step two, packaging the first rotation angle, the second rotation angle, the third rotation angle and the lens model as camera real-time data and sending the camera real-time data to a virtual production server, so that the virtual production server matches a target optical function corresponding to the lens model in a preset optical function database according to the lens model, maps the first rotation angle, the second rotation angle and the third rotation angle into a focal length, a focusing distance and an aperture value by using the target optical function, and controls the virtual movie camera lens in the three-dimensional scene of the virtual engine according to the focal length, the focusing distance and the aperture value.
The preset optical function database stores optical functions of lenses of different models.
The virtual film production focusing synchronization method provided by the embodiment of the invention realizes the synchronous control of the real and virtual cameras by acquiring the real-time data of the camera in the real movie lens, converting the real-time data into the data format which can be identified by computer software according to the optical function characteristics of different lenses and synchronously transmitting the data format in real time, so that the real shooting and the virtual scene are synchronously fused in real time to reach the movie production standard, the creation flexibility is improved, and the production and implementation of high-level movie lens languages can be carried out.
In one implementation, when the camera is turned on, the angle sensor may acquire a current position of the zoom ring as a zero position angle, and when the camera zoom ring rotates, the real-time position of the zoom ring is read, and the first rotation angle is determined by comparing the real-time position with the zero position.
In one implementation, an angle change profile is recorded as the camera zoom ring is rotated. During the rotation, if the change of the angle is within 360 degrees, the angle change curve graph is continuous, if the angle is increased continuously, the angle is recalculated after the limit of 360 degrees is exceeded, and then the angle change curve graph has a breakpoint. The first rotation angle mode can be determined and calculated through the angle change graph and the angles read last two times (the angle of the last first time is a first angle, and the angle of the last second time is a second angle).
When the angle change curve graph continuously has no breakpoint, judging that the current rotation angle is smaller than 360 degrees, if the first angle is larger than the second angle, directly subtracting the first angle from the second angle to obtain a third angle as the first rotation angle, and if the first angle is smaller than the second angle, adding the 360 degrees from the first angle to subtract a zero angle to obtain a fourth angle as the first rotation angle.
When a breakpoint exists in the angle change curve graph, it is judged that the current rotation angle is greater than 360 degrees, and the third angle plus N times of 360 degrees is taken as a first rotation angle, or the fourth angle plus N times of 360 degrees is taken as a first rotation angle. N is the number of breakpoints of the angle change curve graph
In another method, a positive rotation direction is specified (rotation angle increases in the positive rotation direction and rotation angle decreases in the direction opposite to the positive rotation direction), and when the camera zoom ring is rotated, high-frequency angle sampling is performed and angle increments are recorded for each rotation (rotation angle increment in the positive rotation direction is positive and rotation angle increment in the direction opposite to the positive rotation direction is negative). Calculating the increment sum of the current position relative to the zero angle, wherein if the increment sum is greater than 0, the increment sum is a first rotating angle; if the incremental sum is less than 0, the incremental sum 360 DEG is a first rotation angle.
In one implementation, the second rotation angle and the third rotation angle of the focus ring and the diaphragm are measured and calculated by using the same method steps as those for measuring and calculating the first rotation angle of the zoom ring, and the specific steps refer to the above description.
The embodiment of the present invention further provides an electronic device, as shown in fig. 3, which includes a processor 301, a communication interface 302, a memory 303, and a communication bus 304, where the processor 301, the communication interface 302, and the memory 303 complete mutual communication through the communication bus 304,
a memory 303 for storing a computer program;
the processor 301 is configured to implement the virtual production focusing synchronization method described in any of the above embodiments when executing the program stored in the memory 303.
The communication bus mentioned in the electronic device may be a Peripheral Component Interconnect (PCI) bus, an Extended Industry Standard Architecture (EISA) bus, or the like. The communication bus may be divided into an address bus, a data bus, a control bus, etc. For ease of illustration, only one thick line is shown, but this is not intended to represent only one bus or type of bus.
The communication interface is used for communication between the electronic equipment and other equipment.
The Memory may include a Random Access Memory (RAM) or a Non-Volatile Memory (NVM), such as at least one disk Memory. Alternatively, the memory may be at least one memory device located remotely from the processor.
The Processor may be a general-purpose Processor, including a Central Processing Unit (CPU), a Network Processor (NP), and the like; but also Digital Signal Processors (DSPs), application Specific Integrated Circuits (ASICs), field Programmable Gate Arrays (FPGAs) or other Programmable logic devices, discrete Gate or transistor logic devices, discrete hardware components.
In another embodiment of the present invention, a computer-readable storage medium is further provided, where a computer program is stored in the computer-readable storage medium, and when executed by a processor, the computer program implements any of the steps of the virtual production focus synchronization method.
In yet another embodiment provided by the present invention, there is also provided a computer program product containing instructions that, when run on a computer, cause the computer to perform any of the virtual production focus synchronization methods of the above embodiments.
In the above embodiments, the implementation may be wholly or partially realized by software, hardware, firmware, or any combination thereof. When implemented in software, it may be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When loaded and executed on a computer, cause the processes or functions described in accordance with the embodiments of the invention to be performed in whole or in part. The computer may be a general purpose computer, a special purpose computer, a network of computers, or other programmable device. The computer instructions may be stored in a computer readable storage medium or transmitted from one computer readable storage medium to another computer readable storage medium, for example, the computer instructions may be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, digital Subscriber Line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device, such as a server, a data center, etc., that includes one or more available media. The usable medium may be a magnetic medium (e.g., floppy Disk, hard Disk, magnetic tape), an optical medium (e.g., DVD), or a semiconductor medium (e.g., solid State Disk (SSD)), among others.
It is noted that, herein, relational terms such as first and second, and the like may be used solely to distinguish one entity or action from another entity or action without necessarily requiring or implying any actual such relationship or order between such entities or actions. Also, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrases "comprising a," "8230," "8230," or "comprising" does not exclude the presence of additional like elements in a process, method, article, or apparatus that comprises the element.
All the embodiments in the present specification are described in a related manner, and the same and similar parts among the embodiments may be referred to each other, and each embodiment focuses on the differences from the other embodiments. In particular, as for the electronic device and the storage medium, since they are substantially similar to the system and method embodiments, the description is simple, and the relevant points can be referred to the partial description of the method embodiments.
The above description is only for the preferred embodiment of the present invention, and is not intended to limit the scope of the present invention. Any modification, equivalent replacement, or improvement made within the spirit and principle of the present invention shall fall within the protection scope of the present invention.
Claims (9)
1. A virtual film-making focusing synchronization system is characterized by comprising a camera acquisition module and a virtual film-making server; the virtual film production server comprises a mapping unit, an optical function database and a ghost engine; wherein:
the camera acquisition module is used for sending real-time camera data to the virtual film-making server when detecting the torsion of a zoom ring, a focusing ring and an aperture of the camera; the real-time camera data comprise a first rotation angle of a zoom ring, a second rotation angle of a focus ring, a third rotation angle of a diaphragm and a lens model of the camera;
the mapping unit is used for matching a target optical function corresponding to the lens model in the optical function database according to the lens model, and mapping the first rotation angle, the second rotation angle and the third rotation angle into a focal length, a focusing distance and an aperture value by using the target optical function; the preset optical function database stores optical functions of lenses of different models;
and the virtual engine is used for controlling the virtual film camera lens in the three-dimensional scene of the virtual engine according to the focal length, the focusing distance and the aperture value.
2. The virtual production focusing synchronization system of claim 1, wherein the camera acquisition module comprises an angle sensor and a data transmission module;
the angle sensor is used for acquiring the first rotation angle, the second rotation angle and the third rotation angle;
and the data transmission module is used for packaging the first rotation angle, the second rotation angle, the third rotation angle and the lens model as real-time camera data and sending the real-time camera data to the virtual production server.
The target optical function comprises a target module model corresponding to the lens model; the target module model is pre-trained according to historical measured data and is used for mapping the input first rotation angle, the input second rotation angle and the input third rotation angle into a focal length, a focusing distance and an aperture value.
3. The virtual production focusing synchronization system of claim 2, wherein the illusion engine comprises a depth of field calculation module and an image adjustment module; the target optical function also comprises a target circle of confusion parameter corresponding to the lens model;
the depth-of-field calculation module is used for calculating the current depth of field of the camera:
wherein Δ L, Δ L 1 And Δ L 2 The depth of field, the front depth of field and the rear depth of field are respectively, and delta, F, l and G are respectively the target circle of confusion parameter, the focal length, the focus-to-focus distance and the aperture value;
and the image adjusting module is used for adjusting the focus of an image picture according to the focal length and the depth of field so as to control the virtual film camera lens in the virtual engine three-dimensional scene.
4. A virtual production focusing synchronization method is applied to a virtual production server, and comprises the following steps:
receiving real-time camera data sent by a camera acquisition module; the camera real-time data is data acquired by the camera acquisition module when the camera acquisition module detects that a zoom ring, a focus ring and an aperture of the camera twist, and comprises a first rotation angle of the zoom ring, a second rotation angle of the focus ring, a third rotation angle of the aperture and a lens model of the camera;
matching a target optical function corresponding to the lens model in a preset optical function database according to the lens model, and mapping the first rotation angle, the second rotation angle and the third rotation angle into a focal length, a focusing distance and an aperture value by using the target optical function; the preset optical function database stores optical functions of lenses of different models;
and controlling the virtual movie camera lens in the three-dimensional scene of the illusion engine according to the focal length, the focusing distance and the aperture value.
5. The virtual production focusing synchronization method according to claim 4, wherein the target optical function includes a target module model corresponding to the lens model; the target module model is pre-trained according to historical measured data and is used for mapping the input first rotation angle, the input second rotation angle and the input third rotation angle into a focal length, a focal length pair and an aperture value.
6. The virtual production focusing synchronization method of claim 5, wherein the target optical function further comprises a target circle of confusion parameter corresponding to the lens model;
controlling a virtual movie camera lens in the three-dimensional scene of the illusion engine according to the focal length, the focal length pair and the aperture value, wherein the step of controlling the virtual movie camera lens in the three-dimensional scene of the illusion engine comprises the following steps:
calculating the current depth of field of the camera:
wherein Δ L, Δ L 1 And Δ L 2 The depth of field, the front depth of field and the rear depth of field are respectively, and delta, F, l and G are respectively the target circle of confusion parameter, the focal length, the focusing distance and the aperture value;
and adjusting the focus of an image picture according to the focal length and the depth of field to realize the control of the virtual film camera lens in the three-dimensional scene of the illusion engine.
7. A virtual film production focusing synchronization method is applied to a camera acquisition module and comprises the following steps:
acquiring a first rotation angle of a zoom ring, a second rotation angle of a focus ring and a third rotation angle of a diaphragm of the camera through an angle sensor;
packaging the first rotation angle, the second rotation angle, the third rotation angle and the lens model of the camera to be used as real-time data of the camera, and sending the real-time data of the camera to a virtual production server; enabling the virtual production server to match a target optical function corresponding to the lens model in a preset optical function database according to the lens model, mapping the first rotation angle, the second rotation angle and the third rotation angle into a focal length, a focusing distance and an aperture value by using the target optical function, and controlling a virtual movie camera lens in a virtual engine three-dimensional scene according to the focal length, the focusing distance and the aperture value; the preset optical function database stores optical functions of lenses of different models.
8. A computer-readable storage medium, characterized in that a computer program is stored in the computer-readable storage medium, which computer program, when being executed by a processor, carries out the method steps of any one of the claims 4-6, 7.
9. An electronic device is characterized by comprising a processor, a communication interface, a memory and a communication bus, wherein the processor and the communication interface are used for realizing mutual communication by the memory through the communication bus;
a memory for storing a computer program;
a processor for implementing the method steps of any of claims 4-6, 7 when executing a program stored in the memory.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211012602.XA CN115396603B (en) | 2022-08-23 | 2022-08-23 | Virtual film-making focusing synchronization system, method, storage medium and electronic equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211012602.XA CN115396603B (en) | 2022-08-23 | 2022-08-23 | Virtual film-making focusing synchronization system, method, storage medium and electronic equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN115396603A true CN115396603A (en) | 2022-11-25 |
| CN115396603B CN115396603B (en) | 2023-05-16 |
Family
ID=84120349
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202211012602.XA Active CN115396603B (en) | 2022-08-23 | 2022-08-23 | Virtual film-making focusing synchronization system, method, storage medium and electronic equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115396603B (en) |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20150078621A1 (en) * | 2013-09-13 | 2015-03-19 | Electronics And Telecommunications Research Institute | Apparatus and method for providing content experience service |
| CN108259780A (en) * | 2018-04-17 | 2018-07-06 | 北京艾沃次世代文化传媒有限公司 | For the anti-interference special efficacy audio video synchronization display methods of virtual film studio |
| CN108540731A (en) * | 2018-04-17 | 2018-09-14 | 北京艾沃次世代文化传媒有限公司 | Real scene shooting video camera and virtual scene real-time synchronization display methods |
| CN109765798A (en) * | 2018-12-21 | 2019-05-17 | 北京电影学院 | A kind of semi-matter simulating system of film and tv photography |
| CN112116663A (en) * | 2020-08-20 | 2020-12-22 | 太仓中科信息技术研究院 | Offline programming method and system for camera robot and electronic equipment |
| CN114040090A (en) * | 2021-08-25 | 2022-02-11 | 先壤影视制作(上海)有限公司 | Method, device, equipment, storage medium, acquisition part and system for synchronizing virtuality and reality |
-
2022
- 2022-08-23 CN CN202211012602.XA patent/CN115396603B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20150078621A1 (en) * | 2013-09-13 | 2015-03-19 | Electronics And Telecommunications Research Institute | Apparatus and method for providing content experience service |
| CN108259780A (en) * | 2018-04-17 | 2018-07-06 | 北京艾沃次世代文化传媒有限公司 | For the anti-interference special efficacy audio video synchronization display methods of virtual film studio |
| CN108540731A (en) * | 2018-04-17 | 2018-09-14 | 北京艾沃次世代文化传媒有限公司 | Real scene shooting video camera and virtual scene real-time synchronization display methods |
| CN109765798A (en) * | 2018-12-21 | 2019-05-17 | 北京电影学院 | A kind of semi-matter simulating system of film and tv photography |
| CN112116663A (en) * | 2020-08-20 | 2020-12-22 | 太仓中科信息技术研究院 | Offline programming method and system for camera robot and electronic equipment |
| CN114040090A (en) * | 2021-08-25 | 2022-02-11 | 先壤影视制作(上海)有限公司 | Method, device, equipment, storage medium, acquisition part and system for synchronizing virtuality and reality |
Non-Patent Citations (1)
| Title |
|---|
| 方荣国;: "电影虚拟拍摄的应用和展望" * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN115396603B (en) | 2023-05-16 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111457886B (en) | Distance determination method, device and system | |
| CN109218627B (en) | Image processing method, image processing device, electronic equipment and storage medium | |
| CN107223330B (en) | Depth information acquisition method and device and image acquisition equipment | |
| US8072503B2 (en) | Methods, apparatuses, systems, and computer program products for real-time high dynamic range imaging | |
| CN107920211A (en) | A kind of photographic method, terminal and computer-readable recording medium | |
| CN105227857B (en) | A kind of method and apparatus of automatic exposure | |
| CN101577795A (en) | Method and device for realizing real-time viewing of panoramic picture | |
| WO2018210318A1 (en) | Blurring method and apparatus for image, storage medium, and electronic device | |
| CN109194882A (en) | Image processing method, device, electronic equipment and storage medium | |
| CN110035228A (en) | Camera stabilization system, method, electronic equipment and computer readable storage medium | |
| WO2021136078A1 (en) | Image processing method, image processing system, computer readable medium, and electronic apparatus | |
| WO2019119986A1 (en) | Image processing method and device, computer readable storage medium, and electronic apparatus | |
| CN106303267B (en) | Image capture device and method | |
| WO2021035524A1 (en) | Image processing method and apparatus, electronic device, and computer-readable storage medium | |
| CN112470192A (en) | Dual-camera calibration method, electronic device and computer-readable storage medium | |
| CN111340737A (en) | Image rectification method, device and electronic system | |
| US20140118606A1 (en) | Smart cameras | |
| CN114363522A (en) | Photographing method and related device | |
| CN110826414A (en) | Display control method and device of mobile terminal, terminal and medium | |
| CN112351209B (en) | External lens for mobile terminal, method for controlling lens, mobile terminal and storage medium | |
| CN114040090A (en) | Method, device, equipment, storage medium, acquisition part and system for synchronizing virtuality and reality | |
| CN115396603B (en) | Virtual film-making focusing synchronization system, method, storage medium and electronic equipment | |
| US20220141374A1 (en) | Intelligent flash intensity control systems and methods | |
| CN109191396B (en) | Portrait processing method and device, electronic equipment and computer readable storage medium | |
| CN112887619A (en) | Shooting method and device and electronic equipment |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |