CN111756956A - Virtual light control method and device, medium and equipment in virtual studio - Google Patents
Virtual light control method and device, medium and equipment in virtual studio Download PDFInfo
- Publication number
- CN111756956A CN111756956A CN202010584442.0A CN202010584442A CN111756956A CN 111756956 A CN111756956 A CN 111756956A CN 202010584442 A CN202010584442 A CN 202010584442A CN 111756956 A CN111756956 A CN 111756956A
- Authority
- CN
- China
- Prior art keywords
- virtual
- light
- studio
- control
- virtual light
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/2224—Studio circuitry; Studio devices; Studio equipment related to virtual studio applications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F30/00—Computer-aided design [CAD]
- G06F30/20—Design optimisation, verification or simulation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T19/00—Manipulating 3D models or images for computer graphics
- G06T19/20—Editing of 3D images, e.g. changing shapes or colours, aligning objects or positioning parts
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
- H04N5/265—Mixing
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02B—CLIMATE CHANGE MITIGATION TECHNOLOGIES RELATED TO BUILDINGS, e.g. HOUSING, HOUSE APPLIANCES OR RELATED END-USER APPLICATIONS
- Y02B20/00—Energy efficient lighting technologies, e.g. halogen lamps or gas discharge lamps
- Y02B20/40—Control techniques providing energy savings, e.g. smart controller or presence detection
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Geometry (AREA)
- Software Systems (AREA)
- Computer Graphics (AREA)
- Computer Hardware Design (AREA)
- General Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Evolutionary Computation (AREA)
- Architecture (AREA)
- Circuit Arrangement For Electric Light Sources In General (AREA)
- Non-Portable Lighting Devices Or Systems Thereof (AREA)
Abstract
The disclosure provides a method and a device for controlling virtual light in a virtual studio, electronic equipment and a computer-readable storage medium, and relates to the technical field of computers. The virtual light control method in the virtual studio comprises the following steps: acquiring light emitting state information of virtual light required by the virtual studio, and generating corresponding virtual light according to the light emitting state information; and receiving a trigger instruction, acquiring control information corresponding to the trigger instruction, and controlling the virtual light according to the control information. The method and the device can realize real-time change, editing and broadcasting guide control of the virtual light, and make the effect of the virtual light richer.
Description
Technical Field
The present disclosure relates to the field of computer technologies, and in particular, to a method for controlling virtual lighting in a virtual studio, a device for controlling virtual lighting in a virtual studio, a computer-readable storage medium, and an electronic device.
Background
With the continuous maturity of computer technologies, virtual studio technologies are also increasingly applied to the production of television programs and the like. The virtual studio can digitally synthesize the virtual three-dimensional scene made by the computer and the live character moving images shot by the television camera in real time, so that the characters and the virtual background synchronously change, and further, a great deal of expenses caused by scene construction and the like can be saved while rich program effects are realized.
The generation and control of virtual lighting plays an important role in realizing a virtual studio. Therefore, the control method of the virtual light is provided, and the real-time change, editing and broadcasting guide control of the virtual light are realized, so that the control method has an important promoting effect on the development of the virtual studio technology.
It is to be noted that the information disclosed in the above background section is only for enhancement of understanding of the background of the present disclosure, and thus may include information that does not constitute prior art known to those of ordinary skill in the art.
Disclosure of Invention
An object of the embodiments of the present disclosure is to provide a method for controlling virtual lighting in a virtual studio, a device for controlling virtual lighting in a virtual studio, an electronic device, and a computer-readable storage medium, so as to implement real-time change, editing, and director control of virtual lighting, thereby enriching the effect of virtual lighting.
According to a first aspect of the present disclosure, there is provided a virtual light control method in a virtual studio, including:
acquiring light emitting state information of virtual light required by the virtual studio, and generating corresponding virtual light according to the light emitting state information;
and receiving a trigger instruction, acquiring control information corresponding to the trigger instruction, and controlling the virtual light according to the control information.
In an exemplary embodiment of the present disclosure, before generating the corresponding virtual light according to the lighting state information, the method further includes:
and acquiring a light design scheme required by the virtual studio, wherein the light design scheme comprises one or more of light layout, lamp types, lamp quantity and light effect scenes.
In an exemplary embodiment of the present disclosure, after obtaining the light design solution required by the virtual studio, the method further includes:
acquiring a lamp model file required by the light design scheme, and connecting the lamp model file with a scene component in a three-dimensional engine based on a node;
and adjusting the position state of the lamp model in the three-dimensional engine in response to the movement operation of the lamp model in the lamp model file.
In an exemplary embodiment of the present disclosure, the acquiring lighting state information of the virtual lighting required by the virtual studio includes:
responding to selection operation of virtual light assemblies in the three-dimensional engine, and connecting the virtual light assemblies on the basis of nodes;
receiving editing operation aiming at the virtual light assembly, and obtaining attribute parameters of the light-emitting state information according to the editing operation;
the virtual lighting assembly comprises a type assembly, a material assembly and a composite assembly.
In an exemplary embodiment of the present disclosure, the generating the corresponding virtual light according to the lighting state information includes:
and generating the corresponding virtual light according to the attribute parameters.
In an exemplary embodiment of the present disclosure, the obtaining of the control information corresponding to the trigger instruction includes:
acquiring a time axis corresponding to the trigger instruction, and effect parameters and function values corresponding to all moments on the time axis;
the function value is used for controlling switching among multiple virtual light, the effect parameter is used for controlling effect change of the virtual light, and the effect parameter comprises a key frame value, light attribute information and an operation curve.
According to a second aspect of the present disclosure, there is provided a method for implementing a virtual studio, including:
acquiring an actual scene picture shot by an entity camera, and picking a foreground picture from the actual scene picture;
acquiring a virtual scene picture shot by a virtual camera, wherein the virtual scene picture is a virtual scene picture containing the virtual light controlled according to the light control method;
and synthesizing the foreground picture and the virtual scene picture to generate a target picture.
According to a third aspect of the present disclosure, there is provided a virtual light control device in a virtual studio, comprising:
the generating module is used for acquiring the light-emitting state information of the virtual light required by the virtual studio and generating the corresponding virtual light according to the light-emitting state information;
and the control module is used for receiving a trigger instruction, acquiring control information corresponding to the trigger instruction and controlling the virtual light according to the control information.
According to a fourth aspect of the present disclosure, there is provided an electronic device comprising: a processor; and a memory for storing executable instructions of the processor; wherein the processor is configured to perform the method of any one of the above via execution of the executable instructions.
According to a fifth aspect of the present disclosure, there is provided a computer readable storage medium having stored thereon a computer program which, when executed by a processor, implements the method of any one of the above.
Exemplary embodiments of the present disclosure may have some or all of the following benefits:
in the implementation method of the virtual studio provided by the exemplary embodiment of the present disclosure, light emitting state information of virtual lights required by the virtual studio is obtained; generating corresponding virtual light according to the light-emitting state information; and receiving a trigger instruction, acquiring control information corresponding to the trigger instruction, and controlling the virtual light according to the acquired control information. On one hand, by the method provided by the exemplary embodiment of the disclosure, after the light emitting state information of the virtual light required by the virtual studio is acquired, the required virtual light can be generated and controlled, so that the light effect required by a program or a stage is realized, the cost for making the light and the scene is reduced, and the making cost is saved. On the other hand, by receiving the trigger instruction and acquiring the corresponding control information, a plurality of preset fixed light effects in the early stage can be switched in real time, and light can be controlled to operate according to a preset algorithm to change in real time. For example, in the live broadcast process, various lamps and lanterns and various light attributes can be selected through key control and can be combined randomly to form various light effects. Meanwhile, the stability of light control can be provided by sending a trigger instruction through a device key.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and together with the description, serve to explain the principles of the disclosure. It is to be understood that the drawings in the following description are merely exemplary of the disclosure, and that other drawings may be derived from those drawings by one of ordinary skill in the art without the exercise of inventive faculty.
Fig. 1 is a schematic diagram illustrating an exemplary system architecture of a virtual light control method and apparatus in a virtual studio to which embodiments of the present disclosure may be applied;
FIG. 2 illustrates a schematic structural diagram of a computer system suitable for use with the electronic device used to implement embodiments of the present disclosure;
fig. 3 schematically shows a schematic diagram of a flow of a virtual light control method in a virtual studio according to one embodiment of the present disclosure;
fig. 4 schematically shows a schematic diagram of a flow of an implementation method of a virtual studio according to one embodiment of the present disclosure;
fig. 5 schematically illustrates a block diagram of a virtual light control device in a virtual studio according to one embodiment of the present disclosure.
Detailed Description
Example embodiments will now be described more fully with reference to the accompanying drawings. Example embodiments may, however, be embodied in many different forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the concept of example embodiments to those skilled in the art. The described features, structures, or characteristics may be combined in any suitable manner in one or more embodiments. In the following description, numerous specific details are provided to give a thorough understanding of embodiments of the disclosure. One skilled in the relevant art will recognize, however, that the subject matter of the present disclosure can be practiced without one or more of the specific details, or with other methods, components, devices, steps, and the like. In other instances, well-known technical solutions have not been shown or described in detail to avoid obscuring aspects of the present disclosure.
Furthermore, the drawings are merely schematic illustrations of the present disclosure and are not necessarily drawn to scale. The same reference numerals in the drawings denote the same or similar parts, and thus their repetitive description will be omitted. Some of the block diagrams shown in the figures are functional entities and do not necessarily correspond to physically or logically separate entities. These functional entities may be implemented in the form of software, or in one or more hardware modules or integrated circuits, or in different networks and/or processor devices and/or microcontroller devices.
Fig. 1 is a schematic diagram illustrating a system architecture of an exemplary application environment to which a virtual light control method and apparatus in a virtual studio according to an embodiment of the present disclosure may be applied.
As shown in fig. 1, the system architecture 100 may include one or more of terminal devices 101, 102, 103, a network 104, and a server 105. The network 104 serves as a medium for providing communication links between the terminal devices 101, 102, 103 and the server 105. Network 104 may include various connection types, such as wired, wireless communication links, or fiber optic cables, to name a few. The terminal devices 101, 102, 103 may be various electronic devices having a display screen, including but not limited to desktop computers, portable computers, smart phones, tablet computers, and the like. It should be understood that the number of terminal devices, networks, and servers in fig. 1 is merely illustrative. There may be any number of terminal devices, networks, and servers, as desired for implementation. For example, server 105 may be a server cluster comprised of multiple servers, or the like.
The virtual light control method in the virtual studio provided by the embodiment of the present disclosure can be executed by the terminal devices 101, 102, and 103, and correspondingly, the virtual light control device in the virtual studio can also be disposed in the terminal devices 101, 102, and 103. The virtual light control method in the virtual studio provided by the embodiment of the present disclosure may also be executed by the terminal devices 101, 102, and 103 and the server 105 together, and accordingly, the virtual light control device in the virtual studio may be disposed in the terminal devices 101, 102, and 103 and the server 105. In addition, the virtual light control method in the virtual studio provided in the embodiment of the present disclosure may also be executed by the server 105, and accordingly, the virtual light control device in the virtual studio may be disposed in the server 105, which is not particularly limited in this exemplary embodiment.
For example, in the present exemplary embodiment, the lighting state information of the virtual light required by the virtual studio, such as the form, brightness, color, and projection light information of the light, may be input to the terminal devices 101, 102, and 103, and after receiving the lighting state information, the terminal devices may generate and store the corresponding virtual light according to the lighting state information, and after receiving the trigger instruction, obtain the control information corresponding to the trigger instruction, and control the virtual light according to the control information.
FIG. 2 illustrates a schematic structural diagram of a computer system suitable for use in implementing the electronic device of an embodiment of the present disclosure.
It should be noted that the computer system 200 of the electronic device shown in fig. 2 is only an example, and should not bring any limitation to the functions and the scope of the application of the embodiments of the present disclosure.
As shown in fig. 2, the computer system 200 includes a Central Processing Unit (CPU)201 that can perform various appropriate actions and processes in accordance with a program stored in a Read Only Memory (ROM)202 or a program loaded from a storage section 208 into a Random Access Memory (RAM) 203. In the RAM 203, various programs and data necessary for system operation are also stored. The CPU201, ROM 202, and RAM 203 are connected to each other via a bus 204. An input/output (I/O) interface 205 is also connected to bus 204.
The following components are connected to the I/O interface 205: an input portion 206 including a keyboard, a mouse, and the like; an output section 207 including a display such as a Cathode Ray Tube (CRT), a Liquid Crystal Display (LCD), and the like, and a speaker; a storage section 208 including a hard disk and the like; and a communication section 209 including a network interface card such as a LAN card, a modem, or the like. The communication section 209 performs communication processing via a network such as the internet. A drive 210 is also connected to the I/O interface 205 as needed. A removable medium 211 such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, or the like is mounted on the drive 210 as necessary, so that a computer program read out therefrom is mounted into the storage section 208 as necessary.
With the continuous maturity of computer technologies, virtual studio technologies are also increasingly applied to the production of television programs and the like. The virtual studio can digitally synthesize the virtual three-dimensional scene made by the computer and the live character moving images shot by the television camera in real time, so that the characters and the virtual background synchronously change, and further, a great deal of expenses caused by scene construction and the like can be saved while rich program effects are realized.
The generation and control of virtual lighting plays an important role in realizing a virtual studio. Therefore, the control method of the virtual light is provided, and the real-time change, editing and broadcasting guide control of the virtual light are realized, so that the control method has an important promoting effect on the development of the virtual studio technology.
In order to realize the light effect of the virtual studio, the inventor tentatively proposes the following method: and baking and curing the preset lighting effect on the model chartlet in the early manufacturing process, thereby simulating the lighting effect of the scene.
However, in practice, it has been found that the above method has the following problems: the lighting effect can only be preset well in advance, real-time control and change can not be carried out according to the links of programs when in use, the lighting effect is relatively solidified, and the scene effect is relatively single.
In order to solve the above problem, the inventor proposes a new technical solution to realize the generation and control of the virtual light, and the following describes the technical solution of the embodiment of the present disclosure in detail:
the exemplary embodiment first provides a virtual light control method in a virtual studio. Referring to fig. 3, the method for controlling virtual lighting in a virtual studio specifically includes the following steps:
step S310: acquiring light emitting state information of virtual light required by the virtual studio, and generating corresponding virtual light according to the light emitting state information;
step S320: and receiving a trigger instruction, acquiring control information corresponding to the trigger instruction, and controlling the virtual light according to the control information.
In the method for controlling virtual lighting in a virtual studio provided in the exemplary embodiments of the present disclosure, on one hand, by the method provided in the exemplary embodiments of the present disclosure, after the light emitting state information of the virtual lighting required by the virtual studio is obtained, the required virtual lighting can be generated and controlled, so as to achieve the lighting effect required by a program or a stage, reduce the cost for making lighting and scenes, and save the making cost. On the other hand, by receiving the trigger instruction and acquiring the corresponding control information, a plurality of preset fixed light effects in the early stage can be switched in real time, and light can be controlled to operate according to a preset algorithm to change in real time. For example, in the live broadcast process, various lamps and lanterns and various light attributes can be selected through key control and can be combined randomly to form various light effects. Meanwhile, the stability of light control can be provided by sending a trigger instruction through a device key.
Next, in another embodiment, the above steps are explained in more detail.
In step S310, light emitting state information of virtual light required by the virtual studio is obtained, and the corresponding virtual light is generated according to the light emitting state information.
In the present exemplary embodiment, the virtual studio is a television program production technology, and relates to a camera tracking technology, a computer virtual scene design, a color key technology, a lighting technology, and the like, and is based on the traditional color key matting technology, a three-dimensional graphics technology and a video synthesis technology of the computer are fully utilized, so that the perspective relationship of the three-dimensional virtual scene is consistent with the foreground according to the position and parameters of the camera, and after the digital real-time synthesis is performed through the color key, the foreground character and the virtual background can be synchronously changed, and the fusion of the foreground character and the virtual background is realized, so as to obtain the synthesized picture.
By the virtual studio technology, scenes which do not exist actually or are difficult to manufacture can be manufactured, the scenes can be changed instantly, the effect which cannot be realized by a real studio is realized, the space of the scene is not limited by physical space, and the camera can rotate at any angle; a large number of virtual special environments and props can be introduced, so that richer and more attractive programs can be created, the limitations in time, space and prop making are eliminated to a great extent, a larger creation imagination space is obtained, and a novel visual effect can be generated at low cost. In addition, as the scene is made, modified, stored and the like on the computer, the electronic scene is made and changed quickly, conveniently and simply, a large amount of manpower, material resources and financial resources are saved, the program making period is shortened, and the utilization rate of a studio is improved.
The method provided by the exemplary embodiment is mainly used for improving the lighting technology related to the virtual studio. The virtual lighting is generated and controlled by a computer technology and is matched with lighting required by a program, a stage and the like on site, and can be simulated in a computer three-dimensional engine. For example, the virtual light may be a fixed light effect preset in an earlier stage for real-time switching in a program, or may be obtained by arbitrarily combining lamps or light attributes in a live broadcast process, and this is not particularly limited in this exemplary embodiment.
When the virtual lighting required by the virtual studio is obtained, first, lighting state information corresponding to the virtual lighting needs to be obtained, where the lighting state information is used to determine attributes of the virtual lighting, and may include information such as types, materials, and combinations of lighting. For example, the type information may determine which type of light of the desired virtual light is a sky light, a spotlight, a spherical light, etc., the used material information may determine parameters of the desired virtual light, such as a form, a brightness, a color, a focal length, a projection pattern, a shadow, etc., and the composite information may obtain information of an object switching, a switch, a rotation direction, etc., of the desired virtual light). All attribute information of the required virtual light can be obtained through the light-emitting state information of the virtual light, so that the virtual light can be generated subsequently according to the light-emitting state information. It should be noted that the above scenario is only an exemplary illustration, and other attribute information of the virtual light defined according to the above lighting state information also belongs to the protection scope of the present exemplary embodiment.
In this exemplary embodiment, before obtaining the virtual light required by the virtual studio, a light design scheme is first obtained, where the light design scheme is an overall light scheme designed by a light designer according to the current project requirements of the virtual studio, and the method includes at least one of light layout, lamp type, lamp number, and light effect scene. For example, a lighting system based on a three-primary-color soft light lamp can be selected, and the lamp is uniform in light emission, small in shadow, less in heat emission, constant and uniform in color temperature, and natural and vivid in light emission effect. And one or more of the technologies of regional light distribution, three-dimensional light distribution, foreground light distribution, rear blue box light distribution and the like can be determined according to program requirements to realize real and reasonable light distribution. In addition, the light design scheme can also comprise light effect scenes such as flashing, color changing and swinging, light attribute design and the like. Meanwhile, other designs related to the light also belong to the scope of the light design scheme, and this is not particularly limited in this exemplary embodiment.
After the light design scheme is obtained, a lamp model file required by the light design scheme also needs to be obtained, for example, the lamp model file may be in a DWG format or in other formats meeting requirements. In addition, since the generation of the virtual lighting needs to be performed in the three-dimensional engine, after the lamp model file is obtained, the file needs to be converted into a format that can be edited in the three-dimensional engine, for example, a DAE file format. The conversion process may be performed by three-dimensional modeling software. It should be noted that the above scenario is only an exemplary illustration, and the scope of protection of the exemplary embodiment is not limited thereto.
After a lamp model file meeting the format requirement is obtained through three-dimensional modeling software, the lamp model file is imported into a three-dimensional engine, and subsequent operation of obtaining light-emitting state information and producing virtual light is carried out in the three-dimensional engine. This process, for example, may be as follows: connecting the lamp model file with a scene component in a three-dimensional engine based on a node to realize the visualization of the lamp model in the three-dimensional engine; then, in response to the moving operation of the lamp model in the lamp model file, the position state of the lamp model in the three-dimensional engine is adjusted, wherein the position state can comprise the states of the angle, the position and the like of the lamp model in the three-dimensional engine. It should be noted that the above scenario is only an exemplary illustration, and the scope of protection of the exemplary embodiment is not limited thereto.
In this exemplary embodiment, the lighting state information is edited and inputted by a three-dimensional designer through a virtual light assembly in the three-dimensional engine. For example, the virtual lighting component may include a type component, a material component, and a composite component, wherein the type component is used for simulating a light source of real lighting, and may include various types of lighting such as sky light, spotlight, and spherical light; the material component is used for editing the material of the virtual light and can comprise parameters such as the form, brightness, color, focal length, projection pattern and shadow of the virtual light; the composite component is used for realizing the functions of position effect change of virtual light, attribute interface connection of the virtual light and the like, and can comprise parameters such as copy values, object switching, rotating directions and the like.
In the process, the type components, the material components and the composite components are connected in the three-dimensional engine on the basis of nodes in response to the selection operation of the components by a designer. The selection operation may be a click, a touch, or other selection triggering operations conforming to a definition for the corresponding component, which is not particularly limited in this example embodiment.
After the components are connected based on the nodes, the designer may further set the lighting state information of the virtual lighting required by the virtual studio by performing editing operations such as selection, modification, and the like on the components, for example, parameters of attributes such as a shadow of a lighting projection object or character, a lighting projection pattern, brightness, color, lighting coordinates, a movement direction track of the lighting, and a lighting form of the lighting are edited. After receiving the light-emitting state information input by the designer, the computer system generates corresponding virtual light meeting the attribute parameter requirements according to the light-emitting state information to obtain the light effect required by the virtual studio.
It should be noted that the above scenario is only an exemplary illustration, and the scope of protection of the exemplary embodiment is not limited thereto.
In step S320, a trigger instruction is received, control information corresponding to the trigger instruction is obtained, and the virtual light is controlled according to the control information.
In this exemplary embodiment, the trigger command is used to control the virtual light to achieve the real-time light effect required by the virtual studio. For example, a plurality of fixed light effects preset in the early stage can be switched in real time through a trigger instruction, and various light effects can be formed by selecting any combination of a plurality of lamps and a plurality of light attributes in the live broadcast process, which all belong to the protection scope of the exemplary embodiment.
The trigger instruction can be a gesture instruction, for example, the switching of the light can be controlled by matching with the gesture of a host in live broadcasting, a trigger button can also be generated, the instruction of the trigger button is assigned to a key of an external hardware device, control information corresponding to the key is obtained through the trigger operation of the key, and the virtual light is controlled according to the obtained control information. In addition, other ways of controlling the change of the light effect of the virtual light also belong to the protection scope of the present exemplary embodiment.
In this exemplary embodiment, the control information is information for controlling the virtual lighting corresponding to the trigger instruction. The control information may include a time axis corresponding to the trigger instruction, and an effect parameter and a function value of the virtual light corresponding to each time on the time axis. The function value is used for controlling switching among a plurality of kinds of virtual light, for example, when the function value is 1, the function value is virtual light A, and when the function value is changed to a value other than 1, the function value is switched to virtual light B; the effect parameters are used for controlling the effect change of the virtual light, and comprise key frame values, light attribute information and operation curves.
The control information can be obtained through a sequencer component and a function component in the three-dimensional engine, wherein the sequencer component comprises parameters such as time axis editing, operation curve editing, key frame value setting and the like and is used for setting an attribute value and an operation curve of light in a key frame of a time axis so as to change a light effect; the function component comprises IF function value judgment, Not Equal function instruction judgment and the like, and is used for controlling the switching among the multiple kinds of virtual lights in real time by setting function values on a time axis.
For example, the implementation of generating the control information and controlling the virtual light according to the control information may be as follows: in the three-dimensional engine, a sequencer component and a function component are connected based on a node, and control information is obtained by setting a value of the function component and a timeline and a curve of the sequencer in the sequencer. After the control information is generated, the virtual light is controlled according to the control information corresponding to the trigger instruction in response to the received trigger instruction, and the light effect is changed and operated according to the algorithm.
It should be noted that the above scenario is only an exemplary illustration, and the scope of protection of the exemplary embodiment is not limited thereto.
On the basis of generating and controlling the virtual light according to the virtual light control method, further, the present exemplary embodiment further provides an implementation method of a virtual studio, where the implementation method of the virtual studio specifically includes the following steps:
step S410: and acquiring an actual scene picture shot by the entity camera, and scratching a foreground picture from the actual scene picture.
Step S420: acquiring a virtual scene picture shot by a virtual camera, wherein the virtual scene picture is a virtual scene picture containing the virtual light controlled according to the light control method;
step S430: and synthesizing the foreground picture and the virtual scene picture to generate a target picture.
Next, in another embodiment, the above steps are explained in more detail.
In step S410, an actual scene picture captured by the physical camera is acquired, and a foreground picture is extracted from the actual scene picture.
In this exemplary embodiment, the physical camera is a camera that exists in reality, and is configured to capture a real scene to obtain a real scene picture. After obtaining the actual scene picture, the foreground picture is extracted from the picture. The foreground picture is a picture used for being fused with the virtual scene. For example, the above process may be: in a real environment, a real camera is used for shooting a presenter or an actor to obtain an actual scene picture. In such a scenario, after the actual scene picture is obtained by shooting, a scene of weather forecast by a weather forecast host or a scene of performance of actors can be extracted from the actual scene picture as a foreground picture. It should be noted that the above scenario is only an exemplary illustration, and the scope of protection of the exemplary embodiment is not limited thereto.
In step S420, a virtual scene picture captured by a virtual camera is obtained, where the virtual scene picture is a virtual scene picture including the virtual lighting controlled according to the lighting control method.
In the present exemplary embodiment, this step is for acquiring a virtual scene picture taken by a virtual camera. The virtual camera is a camera in a three-dimensional model of a virtual scene corresponding to the real scene and is used for shooting a virtual scene picture. The virtual scene picture comprises virtual light controlled by the method, such as light in a martial arts special effect. The implementation of this process may be, for example, as follows: in the virtual studio system, the working state information of the entity camera is transmitted to the graphic workstation, and the computer obtains the distance and the relative position between the foreground object and the entity camera according to the working state information, so that the most suitable size and position of the virtual scene are calculated, and a three-dimensional model of the virtual scene is generated according to the calculation requirement. Special effects such as required scenes, light and the like are simulated in the virtual scene, and a virtual scene picture is obtained through shooting by a virtual camera. For example, a tornado special effect or a required martial arts special effect is simulated in a three-dimensional model of a virtual scene and is shot by a virtual camera. It should be noted that the above scenario is only an exemplary illustration, and the scope of protection of the exemplary embodiment is not limited thereto.
In step S430, the foreground picture and the virtual scene picture are synthesized to generate a target picture.
In the present exemplary embodiment, after the required foreground screen and virtual scene screen are obtained through the above steps, the foreground screen and virtual scene screen are synthesized to generate the target screen. For example, it may be: after a foreground picture of weather forecast performed by a weather forecast host and a virtual scene picture of the tornado special effect are obtained, the foreground picture and the virtual scene picture are synthesized to play the weather of the host and play the tornado special effect at the same time. Or after acquiring the scene of the actor performance and the special effects of martial arts, synthesizing the scene of the actor performance and the special effects of martial arts to obtain a martial arts scene with the special effects of the actor including light, scenes and the like. It should be noted that the above scenario is only an exemplary illustration, and the scope of protection of the exemplary embodiment is not limited thereto.
In addition, corresponding to the above-mentioned method for controlling virtual lighting in a virtual studio, the present exemplary embodiment further provides a virtual lighting control apparatus in a virtual studio, and as shown in fig. 5, the virtual lighting control apparatus 500 in a virtual studio may include a generation module 510 and a control module 520. Wherein:
the generating module 510 may be configured to obtain light emitting state information of virtual light required by the virtual studio, and generate corresponding virtual light according to the light emitting state information;
the control module 520 may be configured to receive a trigger instruction, obtain control information corresponding to the trigger instruction, and control the virtual light according to the control information.
In this exemplary embodiment, the control module may further include an arithmetic unit and a control unit, wherein the arithmetic unit includes a sequencer component and a function component, and is configured to calculate the control information. The control unit is connected with the operation unit through the pin integrator and used for receiving the control information output by the operation unit and switching the generated virtual light according to the control information.
In this exemplary embodiment, the virtual light control device in the virtual studio may further be externally connected to a hardware control device, and the hardware control device is connected to the control module through a data interface. For example, the pin integrator may be connected to the control module, and a parameter of the pin integrator is edited to generate a trigger button, and then an instruction of the trigger button is assigned to a key of the hardware control device. The control of virtual light can be realized through the keys of the hardware control equipment, and the stability is higher. The pin integrator is used to assign a play command, a program list, a scene sequence, and the like, and the keys include, but are not limited to, a program list, a scene list, play, pause, and stop, which is not limited in this exemplary embodiment.
The details of each module or unit in the virtual light control apparatus in the virtual studio have been described in detail in the corresponding virtual light control method in the virtual studio, and therefore are not described herein again.
It should be noted that although in the above detailed description several modules or units of the device for action execution are mentioned, such a division is not mandatory. Indeed, the features and functionality of two or more modules or units described above may be embodied in one module or unit, according to embodiments of the present disclosure. Conversely, the features and functions of one module or unit described above may be further divided into embodiments by a plurality of modules or units.
As another aspect, the present application also provides a computer-readable medium, which may be contained in the electronic device described in the above embodiments; or may exist separately without being assembled into the electronic device. The computer readable medium carries one or more programs which, when executed by an electronic device, cause the electronic device to implement the method as described in the embodiments below. For example, the electronic device may implement the steps shown in fig. 3 to 4, and the like.
It should be noted that the computer readable media shown in the present disclosure may be computer readable signal media or computer readable storage media or any combination of the two. A computer readable storage medium may be, for example, but not limited to, an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination of the foregoing. More specific examples of the computer readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the present disclosure, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. In contrast, in the present disclosure, a computer-readable signal medium may include a propagated data signal with computer-readable program code embodied therein, for example, in baseband or as part of a carrier wave. Such a propagated data signal may take many forms, including, but not limited to, electro-magnetic, optical, or any suitable combination thereof. A computer readable signal medium may also be any computer readable medium that is not a computer readable storage medium and that can communicate, propagate, or transport a program for use by or in connection with an instruction execution system, apparatus, or device. Program code embodied on a computer readable medium may be transmitted using any appropriate medium, including but not limited to: wireless, wire, fiber optic cable, RF, etc., or any suitable combination of the foregoing.
It will be understood that the present disclosure is not limited to the precise arrangements described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.
Claims (12)
1. A virtual light control method in a virtual studio is characterized by comprising the following steps:
acquiring light emitting state information of virtual light required by the virtual studio, and generating corresponding virtual light according to the light emitting state information;
and receiving a trigger instruction, acquiring control information corresponding to the trigger instruction, and controlling the virtual light according to the control information.
2. A method for implementing a virtual studio includes:
acquiring an actual scene picture shot by an entity camera, and picking a foreground picture from the actual scene picture;
acquiring a virtual scene picture shot by a virtual camera, wherein the virtual scene picture is a virtual scene picture containing the virtual light controlled by the light control method according to claim 1;
and synthesizing the foreground picture and the virtual scene picture to generate a target picture.
3. The method as claimed in claim 1, wherein before generating the corresponding virtual light according to the lighting status information, the method further comprises:
and acquiring a light design scheme required by the virtual studio, wherein the light design scheme comprises one or more of light layout, lamp types, lamp quantity and light effect scenes.
4. The virtual light control method in the virtual studio according to claim 3, wherein after obtaining the light design solution required by the virtual studio, the method further comprises:
acquiring a lamp model file required by the light design scheme, and connecting the lamp model file with a scene component in a three-dimensional engine based on a node;
and adjusting the position state of the lamp model in the three-dimensional engine in response to the movement operation of the lamp model in the lamp model file.
5. The method as claimed in claim 1, wherein the obtaining of the lighting status information of the virtual lighting required by the virtual studio includes:
responding to selection operation of virtual light assemblies in the three-dimensional engine, and connecting the virtual light assemblies on the basis of nodes;
receiving editing operation aiming at the virtual light assembly, and obtaining attribute parameters of the light-emitting state information according to the editing operation;
the virtual lighting assembly comprises a type assembly, a material assembly and a composite assembly.
6. The method as claimed in claim 5, wherein the generating the corresponding virtual lighting according to the lighting status information comprises:
and generating the corresponding virtual light according to the attribute parameters.
7. The method for controlling virtual lighting in a virtual studio according to claim 1, wherein the obtaining of the control information corresponding to the trigger instruction includes:
acquiring a time axis corresponding to the trigger instruction, and effect parameters and function values corresponding to all moments on the time axis;
the function value is used for controlling switching among multiple virtual light, the effect parameter is used for controlling effect change of the virtual light, and the effect parameter comprises a key frame value, light attribute information and an operation curve.
8. A virtual light control device in a virtual studio, comprising:
the generating module is used for acquiring the light-emitting state information of the virtual light required by the virtual studio and generating the corresponding virtual light according to the light-emitting state information;
and the control module is used for receiving a trigger instruction, acquiring control information corresponding to the trigger instruction and controlling the virtual light according to the control information.
9. The virtual light control device of claim 8, wherein the control module comprises an arithmetic unit and a control unit, wherein:
the arithmetic unit comprises a sequencer component and a function component and is used for calculating the control information;
the control unit is connected with the operation unit through a pin integrator and used for receiving the control information output by the operation unit and switching the virtual light according to the control information.
10. The virtual light control device of claim 8, wherein the device further comprises:
and the hardware control equipment is connected with the control module through a data interface.
11. A computer-readable storage medium, on which a computer program is stored, which, when being executed by a processor, carries out the method of any one of claims 1 to 7.
12. An electronic device, comprising:
a processor;
a memory for storing executable instructions of the processor;
wherein the processor is configured to perform the method of any of claims 1-7 via execution of the executable instructions.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010584442.0A CN111756956B (en) | 2020-06-23 | 2020-06-23 | Virtual light control method and device, medium and equipment in virtual studio |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010584442.0A CN111756956B (en) | 2020-06-23 | 2020-06-23 | Virtual light control method and device, medium and equipment in virtual studio |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111756956A true CN111756956A (en) | 2020-10-09 |
| CN111756956B CN111756956B (en) | 2023-04-14 |
Family
ID=72676654
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010584442.0A Active CN111756956B (en) | 2020-06-23 | 2020-06-23 | Virtual light control method and device, medium and equipment in virtual studio |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111756956B (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112562056A (en) * | 2020-12-03 | 2021-03-26 | 广州博冠信息科技有限公司 | Control method, device, medium and equipment for virtual light in virtual studio |
| CN113436343A (en) * | 2021-06-21 | 2021-09-24 | 广州博冠信息科技有限公司 | Picture generation method and device for virtual studio, medium and electronic equipment |
| CN113706719A (en) * | 2021-08-31 | 2021-11-26 | 广州博冠信息科技有限公司 | Virtual scene generation method and device, storage medium and electronic equipment |
| CN115243065A (en) * | 2022-07-19 | 2022-10-25 | 广州博冠信息科技有限公司 | Method and device for scheduling light and package and electronic equipment |
| CN115543756A (en) * | 2021-06-29 | 2022-12-30 | 腾讯科技（深圳）有限公司 | Lamp effect display method, device and storage medium |
| WO2023226686A1 (en) * | 2022-05-27 | 2023-11-30 | 京东方科技集团股份有限公司 | Simulation performance control system and control method |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101655988A (en) * | 2008-08-19 | 2010-02-24 | 北京理工大学 | System for three-dimensional interactive virtual arrangement of large-scale artistic performance |
| US20130182225A1 (en) * | 2012-01-18 | 2013-07-18 | Richard F. Stout | Digital, virtual director apparatus and method |
| CN106210453A (en) * | 2016-08-09 | 2016-12-07 | 安徽喜悦信息科技有限公司 | A kind of intelligent virtual studio system |
| CN110225224A (en) * | 2019-07-05 | 2019-09-10 | 北京乐元素文化发展有限公司 | Director method, the apparatus and system of virtual image |
| CN110543230A (en) * | 2018-05-28 | 2019-12-06 | 广州彩熠灯光有限公司 | Stage lighting element design method and system based on virtual reality |
-
2020
- 2020-06-23 CN CN202010584442.0A patent/CN111756956B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101655988A (en) * | 2008-08-19 | 2010-02-24 | 北京理工大学 | System for three-dimensional interactive virtual arrangement of large-scale artistic performance |
| US20130182225A1 (en) * | 2012-01-18 | 2013-07-18 | Richard F. Stout | Digital, virtual director apparatus and method |
| CN106210453A (en) * | 2016-08-09 | 2016-12-07 | 安徽喜悦信息科技有限公司 | A kind of intelligent virtual studio system |
| CN110543230A (en) * | 2018-05-28 | 2019-12-06 | 广州彩熠灯光有限公司 | Stage lighting element design method and system based on virtual reality |
| CN110225224A (en) * | 2019-07-05 | 2019-09-10 | 北京乐元素文化发展有限公司 | Director method, the apparatus and system of virtual image |
Non-Patent Citations (1)
| Title |
|---|
| 孙志清;李想;彭卫红;: "浅谈虚拟天气节目演播室技术及构建" * |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112562056A (en) * | 2020-12-03 | 2021-03-26 | 广州博冠信息科技有限公司 | Control method, device, medium and equipment for virtual light in virtual studio |
| CN113436343A (en) * | 2021-06-21 | 2021-09-24 | 广州博冠信息科技有限公司 | Picture generation method and device for virtual studio, medium and electronic equipment |
| CN113436343B (en) * | 2021-06-21 | 2024-06-04 | 广州博冠信息科技有限公司 | Picture generation method and device for virtual concert hall, medium and electronic equipment |
| CN115543756A (en) * | 2021-06-29 | 2022-12-30 | 腾讯科技（深圳）有限公司 | Lamp effect display method, device and storage medium |
| CN115543756B (en) * | 2021-06-29 | 2023-08-25 | 腾讯科技（深圳）有限公司 | Lamp effect display method, device and storage medium |
| CN113706719A (en) * | 2021-08-31 | 2021-11-26 | 广州博冠信息科技有限公司 | Virtual scene generation method and device, storage medium and electronic equipment |
| WO2023226686A1 (en) * | 2022-05-27 | 2023-11-30 | 京东方科技集团股份有限公司 | Simulation performance control system and control method |
| CN115243065A (en) * | 2022-07-19 | 2022-10-25 | 广州博冠信息科技有限公司 | Method and device for scheduling light and package and electronic equipment |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111756956B (en) | 2023-04-14 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111756956B (en) | Virtual light control method and device, medium and equipment in virtual studio | |
| CN111698390B (en) | Virtual camera control method and device, and virtual studio implementation method and system | |
| CN101655988A (en) | System for three-dimensional interactive virtual arrangement of large-scale artistic performance | |
| CN112037311A (en) | Animation generation method, animation playing method and related device | |
| CN109978976A (en) | Large-scale square theatrical performance virtual arrangement analogue system | |
| CN105069827A (en) | Method for processing video transitions through three-dimensional model | |
| CN112929627B (en) | Virtual reality scene implementation method and device, storage medium and electronic equipment | |
| CN111736489B (en) | Distributed stage lighting simulation system and method | |
| CN109300179A (en) | Animation method, device, terminal and medium | |
| KR102371031B1 (en) | Apparatus, system, method and program for video shooting in virtual production | |
| CN111583378B (en) | Virtual asset processing method and device, electronic equipment and storage medium | |
| CN112543344A (en) | Live broadcast control method and device, computer readable medium and electronic equipment | |
| CN117372602B (en) | Heterogeneous three-dimensional multi-object fusion rendering method, equipment and system | |
| WO2024082897A1 (en) | Illumination control method and apparatus, and computer device and storage medium | |
| Jing | Design and implementation of 3D virtual digital campus-based on unity3d | |
| CN112153472A (en) | Method and device for generating special picture effect, storage medium and electronic equipment | |
| CN107820622A (en) | A kind of virtual 3D setting works method and relevant device | |
| CN115914718A (en) | Virtual film production video remapping method and system for intercepting engine rendering content | |
| CN212308875U (en) | Immersive interactive virtual reality stage set system | |
| CN115861502A (en) | Weather rendering method and device in virtual environment, storage medium and electronic equipment | |
| CN112991498B (en) | System and method for rapidly generating lens animation | |
| Jiang et al. | Multiple HD Screen‐Based Virtual Studio System with Learned Mask‐Free Portrait Harmonization | |
| Liu et al. | Research on the computer case design of 3D human animation visual experience | |
| KR102601179B1 (en) | Apparatus, method and system for generating extended reality XR content | |
| CN115170707B (en) | 3D image implementation system and method based on application program framework |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |