CN104349020B - A kind of method that virtual video camera switches with real camera - Google Patents
A kind of method that virtual video camera switches with real camera Download PDFInfo
- Publication number
- CN104349020B CN104349020B CN201410716397.4A CN201410716397A CN104349020B CN 104349020 B CN104349020 B CN 104349020B CN 201410716397 A CN201410716397 A CN 201410716397A CN 104349020 B CN104349020 B CN 104349020B
- Authority
- CN
- China
- Prior art keywords
- virtual
- video camera
- camera
- virtual video
- real
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Landscapes
- Processing Or Creating Images (AREA)
- Studio Devices (AREA)
Abstract
The present invention relates to the system and method that a kind of virtual video camera and real camera switch, including：Real camera, real camera is connected with chroma key device, synthesis rendering server is connected with virtual video camera controller, provided with the virtual video camera parameter generation device being connected with real camera and virtual video camera controller in synthesis rendering server, virtual video camera is connected with virtual video camera parameter generation device and synthesizer, synthesizer is connected with described chroma key device, and the prospect generating means being connected with synthesizer, Background generation device and output device are additionally provided with synthesis rendering server.The present invention in rendering server by making virtual prospect, virtual background and virtual portrait, Fast back-projection algorithm, and the switching that the real scene and virtual scene at scene are realized in operation is carried out to scene by virtual video camera controller, it compensate for real camera and shooting the limitation of virtual article, be greatly improved the program expressive force of virtual studio.
Description
Technical field
The present invention relates to the present invention relates to the system and method that a kind of virtual video camera and real camera switch.It is a kind of
The system and method for Video Image processing, are a kind of system and method handled for digital video tv trick.
Background technology
Virtual studio includes a series of equipment, and virtual article is mainly implanted to the real scene of video camera shooting
In, to improve the form of expression of program.General virtual studio can include one or several following equipment：It is orientable to take the photograph
Camera equipment, blue case, chroma key device, the equipment such as virtual rendering server.Real camera is obtained by orientable video camera
Position, real camera space is placed into by virtual article, realizes the effect that virtual article is synchronized with the movement with real camera.It is blue
Case coordinates chroma key device to remove unwanted picture, only retains specific picture element so that virtual scene and real scene
Combination it is truer.The picture of virtual article/virtual portrait of virtual rendering server generation, and it is shot with video camera
Real picture be superimposed, constitute final output picture.The characteristics of due to current virtual studio, the virtual object of implantation
Part can only be used as virtual prospect or virtual background.
Virtual prospect refers to that virtual article can only be added to before real camera shooting picture.Virtual prospect can be with
Outdoor scene scene cooperates, and strengthens the expressive force of outdoor scene.Virtual background refers to that the picture that real camera is shot can only be added to
Before virtual article.Virtual background will typically coordinate the use of blue case and chroma key device.The different virtual back ofs the body can so be passed through
Scape switches the environment of surrounding, studio can be made more flexible.
Virtual prospect and virtual background can be appeared in final output picture simultaneously, but virtual prospect and the virtual back of the body
Scape can not realize the hiding relation of three dimensions, and virtual prospect is forever before virtual background.
The position of virtual video camera can only be completely consistent with the position of real camera in existing virtual studio.
Camera lens focal length is that limitation shows object key factor in greater detail, is imaged while shooting obtained field range
The restriction at machine visual angle.Although real camera is usually that, in fixed head, rocking arm, guide rail etc. has one in present virtual studio
On the device for determining activity surplus, the shooting visual field is extended.But the video camera on fixed head is to move in shooting process
, rotary camera and the visual angle of video camera can only be changed, though and rocking arm and guide rail can mobile camera position, can only also have
Mobile camera in the range of limit.And the visual angle change of video camera in itself（Camera angles and image-forming component（CCD）Size and mirror
Head focal length size is relevant）It is also limited, therefore existing virtual studio is difficult the free-roaming in virtual scene（To range
And Depth Expansion）.In traditional virtual studio, real camera can only change its position by devices such as head, rocking arm, guide rails
Put, direction, the parameter such as Zoom.But it is due to its physical limit, the field range being likely to be breached of real camera is limited, it is impossible to
Photograph the various pieces of virtual scene.
The content of the invention
To solve problem of the prior art, the present invention propose the system that a kind of virtual video camera switches with real camera and
Method.Described system and method render service switching by external hardware device or broadcast control software triggering and truly imaged
Machine and virtual video camera, and in the energy automatic smoothing transition when real camera and virtual camera position are inconsistent.When rendering
When server is switched to virtual video camera, video is shot to real camera and handled, it is followed virtual video camera
Motion.
The present invention can make virtual video camera beyond the visual field boundary of real camera, can be according to program demand in virtual field
Free-roaming in scape, and the video that can shoot real camera projects again under virtual video camera space, improves picture
The sense of reality, lifts the free degree of program creator.
The object of the present invention is achieved like this：The system that a kind of virtual video camera switches with real camera, including：With
The real camera of rendering server connection is synthesized, described real camera is connected with chroma key device, it is characterised in that described
Synthesis rendering server be connected with virtual video camera controller, in described synthesis rendering server provided with real camera and
The virtual video camera of virtual video camera controller connection, described virtual video camera is connected with synthesizer, described synthesis dress
Put and be connected with described chroma key device, the prospect generation dress being connected with synthesizer is additionally provided with described synthesis rendering server
Put, Background generation device and output device
Further, during the control peripheral hardware of described virtual video camera controller is keyboard, mouse, touch-screen or rocking bar
It is a kind of.
Further, described synthesis rendering server is used for the state according to virtual video camera, by virtual scene
Virtual prospect, virtual background etc. are rendered to picture, and the picture shot with real camera is overlapped synthesis, by final conjunction
Output device output is sent into picture；Described virtual video camera controller is used for controlling virtual video camera in virtual environment space
Position motion, the change pointed to, the propulsion of picture zoom out and focus change in location etc.；Described virtual video camera parameter
Generating means receive the control instruction of virtual video camera controller, control instruction are converted to the parameter of virtual video camera, virtually
Camera parameters generating means can also be changed and give birth to the parameter of virtual video camera according to software program set in advance
Into the parameter of virtual video camera is passed to virtual video camera for subsequently using by virtual video camera parameter generation device；Described
Virtual video camera parameter is passed to synthesizer and used by virtual video camera；Before described prospect generating means can be created virtually
Scape, can also receive three-dimensional animation production device and make virtual scene and virtual portrait, and specify from virtual environment it is virtual before
Scape, prospect generating means obtain current virtual camera parameters by synthesizer, are generated according to virtual video camera parameter virtual
Foreground picture；Described Background generation device can create virtual background, can also receive three-dimensional animation production device and make empty
Intend scene and virtual portrait, and the specified virtual background from virtual environment, Background generation device is obtained currently by synthesizer
Virtual video camera parameter, virtual background picture is generated according to virtual video camera parameter；Described synthesizer receives virtual shooting
The parameter that machine is transmitted, receives real camera shooting picture and key that chroma key device is transmitted, generates virtual foreground picture and the virtual back of the body
The picture of scape picture and other virtual article/virtual portraits, according to the definition of Virtual Space by virtual foreground picture, virtual object
Part/virtual portrait picture, real camera shooting picture, the superposition synthesis of virtual background picture, and send output to fill composite result
Put output；The picture that described output device sends synthesizer, which completes to deliver broadcast after necessary data, signal conversion, to be made
With.
Further, described virtual video camera can have one or more, one of to be used as current main virtual shooting
Machine, main virtual video camera can be specified and changed by virtual video camera controller, can also be generated and be filled by virtual video camera parameter
Put and specify and change, the parameter of main virtual video camera is sent to synthesizer and used for image rendering synthesis；
Further, the parameter of described virtual video camera includes three dimensional space coordinate, Zoom, focus parameter；
The step of a kind of method that virtual video camera of use said system switches with real camera, methods described, is such as
Under：
Prepared process：
The step of making and virtual scene be set：For three-dimensional animation production device make virtual scene and virtual portrait with
And virtual article, or make virtual prospect, virtual background and void for described prospect generating means and Background generation device
Anthropomorphic thing and virtual article；Or filled for described prospect generating means and Background generation device according to three-dimensional animation production
Put the virtual scene completed and specify virtual prospect and virtual background；
The step of calibrating camera：Three dimensional space coordinate, Zoom, focus parameter for obtaining real camera, will be obtained
The three dimensional space coordinate of the real camera taken, Zoom, focus parameter are sent to three-dimensional animation production device and virtual video camera
In parameter generation device；
The step of generating virtual video camera, for rendering server according to proven in " the step of calibrating camera "
The parameter information of parameter acquiring real camera, generates virtual video camera；Or completed according to three-dimensional animation production device
Virtual environment setting generation virtual video camera；In the presence of there are multiple virtual video cameras, control to fill by virtual video camera
Put or virtual video camera parameter generation device specifies some virtual video camera to be current main virtual video camera；
The process of broadcast：
Real camera shoots the step of broadcasting：For real camera under operator's control to studio scene and master
Hold people, welcome guest etc. to be shot, and vision signal will be shot and give synthesis rendering server by chroma key device；Real camera
Parameter passes to the virtual video camera parameter generation device of synthesis rendering server in real time；Rendering server is synthesized to fill by synthesizing
The vision signal that shoots real camera and prospect generating means, Background generation device or synthesizer are put according to truly taking the photograph
Camera parameter is rendered after virtual foreground picture, virtual background picture, virtual portrait and the superposition synthesis of virtual article picture of generation,
Output device is sent to externally to broadcast；
Send real camera and switch to the step of virtual video camera is instructed：For being wanted according to the demand of broadcast or scene script
Ask by synthesizing rendering server or virtual video camera controller sends and the instruction of virtual video camera is switched to from real camera；
The step of composograph：Given birth to for virtual video camera parameter generation device according to the instruction of virtual video camera controller
Into each parameter of virtual video camera, or virtual video camera parameter generation device is according to the control instruction of the good script of pre-edit
Each parameter of virtual video camera is generated, virtual video camera receives the parameter that the transmission of virtual video camera parameter generation device comes, received
The instruction of virtual video camera parameter generation device or virtual video camera controller switches main virtual video camera, will be uniquely virtual
The parameter of video camera or main camera is sent to synthesizer；Prospect generating means, Background generation device are according to from synthesizer
Obtained virtual video camera parameter renders the virtual foreground picture of generation and virtual background picture, and synthesizer can also autonomous basis
Virtual video camera parameter renders the virtual foreground picture of generation, virtual background picture, virtual portrait and virtual article picture, synthesis dress
Put the video for shooting real camera to be rendered according to virtual video camera parameter, and the real camera for rendering generation is clapped
Take the photograph video pictures and virtual foreground picture, virtual background picture, virtual portrait and virtual article picture are overlapped synthesis output；
Send the step of virtual video camera switchback real camera is instructed：For the demand according to program, sending will be virtual
The instruction of video camera switchback real camera；
The step of switchback real camera：Rendering server is generated by virtual video camera parameter and filled after order is received
Put the direction of motion and speed that virtual video camera is controlled according to the movement velocity and curve movement of virtual video camera, rendering server
In real camera of virtual video camera parameter generation device when switching to virtual video camera according to real camera each ginseng
Number, by virtual video camera from parameter current smooth interpolation to real camera parameter, is always maintained to virtual during smooth interpolation
Scene rendering and exports；After virtual video camera is consistent with real camera parameter, goes to real camera and shoot what is broadcasted
Step.The beneficial effect comprise that：The present invention in rendering server by making virtual prospect, virtual background
And virtual portrait, Fast back-projection algorithm, virtual scene is generated, and operation is carried out to scene by virtual video camera controller and realizes scene
Real scene and virtual scene more freely it is diversified cooperation with switching, compensate for real camera motion limitation situation
Under to show virtual scene limitation, virtual article can be showed by free movement of the virtual video camera in virtual scene
More details and bigger field range, bring brand-new visual experience, are greatly improved the listing of virtual studio
Existing power.Many trigger sources trigger camera switching.Can be by external hardware device, including keyboard, the switching such as rocking bar can also lead to
Cross a variety of switch means such as broadcast control software, it is possible to achieve inserted automatically in switching between virtual video camera and real camera
Value processing, it is ensured that switching is seamlessly transitted.The control mode of a variety of virtual video cameras, can be by keyboard, and rocking bar controls void
Intend the motion of video camera.The motion of video camera can also be controlled by prefabricated trajectory path.It can also be included by program
Script, the mode such as plug-in unit controls camera motion.The video that real camera is shot is empty in the virtual scene of virtual video camera
It is interior to render again, the good viewing experience of picture is ensure that to greatest extent.Multiple virtual video cameras are prefixed, on the one hand may be used
With the docking more smooth with many real cameras that may be set in studio；On the other hand, every virtual video camera can
Using the lens parameters of different qualities, such as can have wide-angle lens, common lens, Macro Lens first-class, every kind of camera lens is to virtual
The rendering effect of scene is different, further increases the expressive force to virtual scene, virtual article.
Brief description of the drawings
The invention will be further described with reference to the accompanying drawings and examples.
Fig. 1 is the theory diagram of one system of inventive embodiments；
Fig. 2 is the implementation process block diagram of the methods described of inventive embodiments three.
Embodiment
Embodiment one：
The present embodiment is the system that a kind of virtual video camera switches with real camera, as shown in Figure 1.The present embodiment bag
Include：The real camera being connected with synthesis rendering server, described real camera is connected with chroma key device, described synthesis wash with watercolours
Dye server is connected with virtual video camera controller, provided with real camera and virtually taking the photograph in described synthesis rendering server
The virtual video camera of camera controller connection, described virtual video camera is connected with synthesizer, described synthesizer and institute
Prospect generating means, the background being connected with synthesizer are additionally provided with the chroma key device connection stated, described synthesis rendering server
Generating means and output device.
Described synthesis rendering server is used for the state according to virtual video camera, by the virtual prospect in virtual scene,
Virtual background etc. is rendered to picture, and the picture shot with real camera is overlapped synthesis, and final synthesis picture is sent
To output device output；Described virtual video camera controller is used for controlling virtual video camera to transport in the position in virtual environment space
Change, the propulsion of picture dynamic, point to zoom out and focus change in location etc.；Described virtual video camera parameter generation device
Receive the control instruction of virtual video camera controller, control instruction is converted to the parameter of virtual video camera, virtual video camera ginseng
Number generating means can also be changed and generate to the parameter of virtual video camera according to software program set in advance, virtually take the photograph
The parameter of virtual video camera is passed to virtual video camera for subsequently using by camera parameter generation device；Described virtual video camera
Virtual video camera parameter is passed into synthesizer to use；Described prospect generating means can create virtual prospect, can also
Receive three-dimensional animation production device and make virtual scene and virtual portrait, and the specified virtual prospect from virtual environment, prospect life
Current virtual camera parameters are obtained by synthesizer into device, virtual foreground picture is generated according to virtual video camera parameter；
Described Background generation device can create virtual background, can also receive three-dimensional animation production device and make virtual scene and void
Anthropomorphic thing, and the specified virtual background from virtual environment, Background generation device obtain current virtual video camera by synthesizer
Parameter, virtual background picture is generated according to virtual video camera parameter；Described synthesizer receives the ginseng that virtual video camera is transmitted
Number, receives the real camera shooting picture that transmits of chroma key device and key, generate virtual foreground picture and virtual background picture and
The picture of other virtual article/virtual portraits, according to the definition of Virtual Space by virtual foreground picture, virtual article/visual human
Thing picture, real camera shooting picture, the superposition synthesis of virtual background picture, and send output device to export composite result；Institute
The picture that the output device stated sends synthesizer, which completes to deliver broadcast after necessary data, signal conversion, to be used.
Real camera described in the present embodiment is the camera system of the server composition of digital camera and correlation
General name, be with virtual video camera comparatively.Virtual video camera be available to computer three-dimensional cartoon making Virtual Space or
In the virtual scene of virtual studio, for the virtual concept rendered, virtual video camera is actual by multiple camera parameter structures
Into can be matched and switched with the corresponding parameter of real camera using these parameters, these parameters, which are synthesized, renders clothes
Device is engaged in generate virtual video picture according to the virtual scene of well in advance.
Rendering server described in the present embodiment can be a server or a server cluster, have
Very powerful disposal ability, because carrying out needing quick, substantial amounts of image real time transfer when rendering processing at the scene, can make
With multiple servers multithreading carry out handle, so as to will be rendered within the most short time processing complete.
Prospect generating means possess a variety of functions, and it can both create the virtual prospect in virtual scene, can also be by three
A part in the threedimensional model of dimension cartoon making device generation is appointed as virtual prospect；Same Background generation device it both may be used
To create the virtual background in virtual scene, the part in the threedimensional model that can also generate three-dimensional animation production device refers to
It is set to virtual background.Certainly virtual prospect and virtual background here needs to meet the logical relation in Virtual Space.The opposing party
Face, prospect generating means and Background generation device can also be according to the parameters of current virtual video camera, by virtual prospect and virtual
Background renders the virtual foreground picture of generation and virtual background picture.Prospect generating means and Background generation device can specially be set
The hardware system of meter or the software systems in synthesis rendering server, or the system that hardware and software is constituted.It is three-dimensional
Cartoon making device is not although be a part for switching system, but it is also possible to be arranged in synthesis rendering server, to scene
Some simple animation models are made, and more complicated animation model and scene then need to carry out in advance.
Virtual video camera controller can be a series of subsystem that hardware and control software are constituted.Can be on screen
Virtual controlling key or the real rocking bars such as button, the rocking bar of peripheral hardware control are controlled using mouse, keyboard, touch-screen etc.,
The direction of motion and movement velocity all around to control virtual video camera.
Synthesizer is the device for being synthesized virtual image and true picture.The virtual scene of virtual studio is in system
When work, it will usually according to studio（And blue case）Physical structure virtual scene dummy object and environment, synthesis
Device can be according to virtual foreground object and virtual background object in virtual scene location parameter, processing real camera clap
The real picture taken the photograph synthesizes the space overlapping relation of the image rendered with virtual prospect, virtual background, so as to generate with true
The three-dimensional virtual environment of true feeling and the synthesis picture of true picture are used for broadcast.According to the design parameter and void of real camera
Intend the parameter of video camera, synthesizer is meeting visual angle rationally and in the case of spatial occlusion relationship, it is also possible to only export virtual
The picture that environment is rendered, or the picture that only output real camera is shot, but the picture that real camera is shot is often
It can be exported after the conversion of certain space projection, to meet the motion conditions of real camera at that time and virtual video camera.
Embodiment two：
The present embodiment is the improvement of embodiment one, is refinement of the embodiment one on virtual video camera controller.This reality
It is one kind in keyboard, mouse, touch-screen or rocking bar to apply the control peripheral hardware of the virtual video camera controller described in example.
The operation of virtual video camera and real camera mode the most convenient in reality still uses rocking bar, but one
The various virtual key control virtual video cameras on screen can be used in a little operations, such as：The touch-screen of host at the scene is enterprising
Row operation etc..Dummy object is more easily showed likewise, can be realized in some cases using mouse, such as directly jumped
Some certain viewing angles is gone to, or allows video camera to be moved along pre-set path.
Embodiment three：
The present embodiment is the improvement of embodiment one, is refinement of the embodiment one on virtual video camera implementation, institute
The virtual video camera stated can have one or more, one of as current main virtual video camera, and main virtual video camera can be with
Specified and changed by virtual video camera controller, can also be specified and be changed by virtual video camera parameter generation device, it is main virtual
The parameter of video camera is sent to synthesizer and used for image rendering synthesis.
The present embodiment is prefixed multiple virtual video cameras in Virtual Space, on the one hand be able to may be set with studio
The more smooth docking of many real cameras；On the other hand, every virtual video camera can use the camera lens of different qualities
Parameter, such as can have wide-angle lens, common lens, Macro Lens first-class, and every kind of camera lens is different to the rendering effect of virtual scene, enters
One step adds the expressive force to virtual scene, virtual article.
Under normal circumstances, virtual studio may only be equipped with a real camera, at this moment be set in Virtual Space
One virtual video camera can very easily realize cooperation with true and camera and dock.Although in theory, no matter how many
Individual real camera, only one virtual video camera can just realize that the simulation to multiple real cameras is docked, but set
Multiple virtual video cameras, can more facilitate the change of the smooth locus to each real camera and other specification
It is tracked, selects corresponding virtual video camera when switching so as to real camera in time.
On the other hand, even if only one real camera, is also necessary to set multiple virtual video cameras.It is well known that
The camera lens specification of video camera is diversified, and wide-angle lens, which is good at, shows big scene and broad picture, micro-lens pair
Small objects to show power stronger.The picture effect that the camera of different focal shoots Same Scene is also to have different styles.
In virtual environment, the virtual video camera of multiple different lens types is set, spy when there can be special need in program
Plant camera lens and remove performance special screne and picture, for example, gone to show the details of a mini Mod in virtual scene with micro-lens,
The reasonability and authenticity in spatial relationship can be kept, the rendering capability to model detail is added again, is that spectators bring
Good programming experience.
Example IV：
The present embodiment is the improvement of embodiment one, is embodiment one on the thin of the virtual video camera implementation
Change, the parameter of virtual video camera includes the parameters such as three dimensional space coordinate, Zoom, focus；The wherein three dimensions of real camera
Coordinate parameters can for rationally placing the position of virtual video camera in virtual scene, make virtual video camera have one it is fixed
Originate origin.These coordinate parameters can also follow the motion of real camera in shooting process, be delivered to render clothes in real time
It is engaged in device, for updating the position of virtual video camera to keep consistent with real camera.Zoom parameters reflect real camera
To the degree for widening and reducing of captured picture, virtual video camera is also required to and real camera is same to rendering for virtual screen
Step is acted, and can just make the reasonable strong sense of reality of final output picture.Focus parameters reflect the change of real camera focal plane
Change, be also required to convert focal plane accordingly when virtual video camera is rendered.
Embodiment five：
The present embodiment is a kind of method that virtual video camera of use said system switches with real camera.The present embodiment
Substantially process it is as follows：
1st, virtual scene is made, threedimensional model is placed in corresponding position according to studio size and the demand of program, and
It is prospect to specify which threedimensional model in the scene, and which threedimensional model is background.If virtually taken the photograph using control software control
Camera, it is necessary to make the movement locus of virtual video camera, and specify real camera and virtual video camera conversion in the scene
The required time.
2nd, the position of real camera is fixed according to the demand of program making, and calibrates video camera in studio origin
Locality and its parameter such as zoom, focus.
3rd, the parameter information generation for the parameter acquiring real camera that virtual rendering server is demarcated according to the 2nd step is virtually taken the photograph
Camera, and the virtual scene that the 1st step is made is rendered by synthesizer.Synthesizer first passes through virtual video camera and renders setting
For the threedimensional model of background, then the video pictures that real camera is shot are added on background, then by virtually imaging
Machine renders the threedimensional model for being set as prospect, and the synthesis picture being added to above obtains final output picture.
4th, according to the demand of program making, it is switched on virtual video camera corresponding at the time of.If operated using rocking bar,
Switching button directly is pressed, if using control software is broadcasted, switching virtual video camera is operated on software.
5th, virtual rendering server is received after switching command, real camera can be switched into virtual video camera.Render clothes
Business device uses the positional information of virtual video camera, and the video pictures that synthesizer shoots real camera are projected to virtually again
Specified location under video camera space, then obtains final output picture using the synthesis mode of step 3.
If the 6, switched using rocking bar, the parameter of virtual video camera is identical with the parameter of real camera, can after switching
Directly to be moved by shaking the operation such as rocking bar, rotate, zoom virtual video cameras, rendering server can be according to the amplitude of rocking bar
Control the speed of virtual video camera motion.If using control software control virtual video camera switching is broadcasted, virtual video camera will
The movement locus made along in step 1 is moved.Because the good movement locus of pre-production will not be with current real camera
Parameter is consistent, and rendering server can be first consistent with real camera parameter by the parameter of virtual video camera, is then specified in step 1
Conversion time in by virtual video camera smooth interpolation to the good initial position of pre-production, finally along desired trajectory motion.
7th,, can be by virtual video camera switchback real camera after virtual video camera motion terminates according to the demand of program.
If using rocking bar control video camera, press home button, render video camera after order is received, by virtual video camera from work as
Front position smooth interpolation shakes the movement velocity that amplitude controls virtual video camera to real camera parameter, and according to rocking bar.When
After virtual video camera is consistent with real camera parameter, virtual video camera uses real camera parameter render scenes, same to step
3.If using control software control virtual video camera is broadcasted, switching command can be sent by broadcasting control software, when rendering clothes
Business device be connected to after order, in the conversion time that step 1 is specified, by the position of virtual video camera from current location smooth interpolation to
Real camera position, after virtual video camera is consistent with real camera parameter, virtual video camera is joined using real camera
Number render scenes, with step 3.
Methods described comprises the following steps that its implementation process is as shown in Figure 2：
Prepared process：
The step of making and virtual scene be set：For three-dimensional animation production device make virtual scene and virtual portrait with
And virtual article, or make virtual prospect, virtual background and void for described prospect generating means and Background generation device
Anthropomorphic thing and virtual article；Or filled for described prospect generating means and Background generation device according to three-dimensional animation production
Put the virtual scene completed and specify virtual prospect and virtual background；The step for typically all carry out before play-out, three dimensional field
The making of scape usually requires the substantial amounts of time, but some simple animations can be carried out at the scene, to adapt to the scene of change
Situation.
The step of calibrating camera：Three dimensional space coordinate, Zoom, focus parameter for obtaining real camera, will be obtained
The three dimensional space coordinate of the real camera taken, Zoom, focus parameter are sent to three-dimensional animation production device and virtual video camera
In parameter generation device；The step for often carry out at the scene, demarcation can also be carried out in advance, i.e., real camera is placed on certain
Individual defined location is demarcated, and at the scene during recorded broadcast as needed, promotes the position to switch in video camera.
The step of generating virtual video camera, for rendering server according to proven in " the step of calibrating camera "
The parameter information of parameter acquiring real camera, generates virtual video camera；Or completed according to three-dimensional animation production device
Virtual environment setting generation virtual video camera；In the presence of there are multiple virtual video cameras, control to fill by virtual video camera
Put or virtual video camera parameter generation device specifies some virtual video camera to be current main virtual video camera；If multiple true
Video camera, generally assigns the parameter of each real camera different virtual video cameras respectively, so as to corresponding virtual shooting
Machine keeps the timely tracking to real camera parameter during broadcast.
The process of broadcast：
Real camera shoots the step of broadcasting：For real camera under operator's control to studio scene and master
Hold people, welcome guest etc. to be shot, and vision signal will be shot and give synthesis rendering server by chroma key device；Real camera
Parameter passes to the virtual video camera parameter generation device of synthesis rendering server in real time；Rendering server is synthesized to fill by synthesizing
The vision signal that shoots real camera and prospect generating means, Background generation device or synthesizer are put according to truly taking the photograph
Camera parameter is rendered after virtual foreground picture, virtual background picture, virtual portrait and the superposition synthesis of virtual article picture of generation,
Output device is sent to externally to broadcast；During actually true camera shoots broadcast, virtual video camera is also synchronous renders
, the picture finally broadcasted is also true camera shooting picture and synthesized by the superposition of virtual video camera rendered picture.
Send real camera and switch to the step of virtual video camera is instructed：For being wanted according to the demand of broadcast or scene script
Ask and send to broadcast from real camera and switch to virtual video camera by synthesizing rendering server or virtual video camera controller
Instruction；This switching is actually the switching of relative switching, more importantly control.The emphasis of switching is to virtual field
The control of scape performance is realized that after switching, virtual video camera will completely disengage from true shooting by the control to virtual video camera
The limitation of machine physical parameter, the free movement in virtual environment.And in previous step, virtual video camera depends on truly take the photograph always
The physical parameter motion of camera.According to the demand of program making, the control to video camera corresponding at the time of is switched to virtually
On video camera.If currently employed rocking bar operates real camera, directly press switching push button and send switching command.If current
The control of scene script is used, i.e., is currently to broadcast control software in operation real camera, then broadcasts control software hair
Go out the order of switching.This scene and the scene of virtual video camera institute " manufacture " for crossing the position of range request shot by camera have
The combination of machine.
The step of composograph：Given birth to for virtual video camera parameter generation device according to the instruction of virtual video camera controller
Into each parameter of virtual video camera, or virtual video camera parameter generation device is according to the control instruction of the good script of pre-edit
Each parameter of virtual video camera is generated, virtual video camera receives the parameter that the transmission of virtual video camera parameter generation device comes, received
The instruction of virtual video camera parameter generation device or virtual video camera controller switches main virtual video camera, will be uniquely virtual
The parameter of video camera or main camera is sent to synthesizer；Prospect generating means, Background generation device are according to from synthesizer
Obtained virtual video camera parameter renders the virtual foreground picture of generation and virtual background picture, and synthesizer can also autonomous basis
Virtual video camera parameter renders the virtual foreground picture of generation, virtual background picture, virtual portrait and virtual article picture, synthesis dress
Put the video for shooting real camera to be rendered according to virtual video camera parameter, and the real camera for rendering generation is clapped
Take the photograph video pictures and virtual foreground picture, virtual background picture, virtual portrait and virtual article picture are overlapped synthesis output；
If switched using rocking bar, the initial conditions of virtual video camera is identical with the parameter of real camera, can after switching
Directly to be moved by shaking the operation such as rocking bar, rotate, zoom virtual video cameras, rendering server can be according to the amplitude of rocking bar
Control the speed of virtual video camera motion.If using control software control virtual video camera switching is broadcasted, virtual video camera will
Moved along the movement locus made.Because the good movement locus of pre-production will not be with current real camera parameter
Unanimously, rendering server can be first consistent with real camera parameter by the parameter of virtual video camera, then in certain conversion
In by virtual video camera smooth interpolation to the good initial position of pre-production, finally along desired trajectory motion.
In the step of composograph, the control of video camera is always leading using virtual video camera, if there is provided multiple
Virtual video camera, can also be switched over during this between different virtual video cameras, so as to from different visual angles, with
Different camera lens style performance virtual scenes.
Send the step of virtual video camera switchback real camera is instructed：For the demand according to program, sending will be virtual
Video camera switchback real camera is instructed；If controlling video camera using rocking bar, home button is pressed, the instruction of switchback is sent.
The order that control software sends switchback automatically is broadcasted if using control software is broadcasted according to script switching.If currently used
Be virtual video camera controller mouse, keyboard or touch-screen operation virtual video camera, then can use mouse, keyboard or
The button that touch-screen is clicked on screen is operated.
The step of switchback real camera：Rendering server is generated by virtual video camera parameter and filled after order is received
Put the direction of motion and speed that virtual video camera is controlled according to the movement velocity and curve movement of virtual video camera, rendering server
In real camera of virtual video camera parameter generation device when switching to virtual video camera according to real camera each ginseng
Number, by virtual video camera from parameter current smooth interpolation to real camera parameter, is always maintained to virtual during smooth interpolation
Scene rendering and exports；After virtual video camera is consistent with real camera parameter, goes to real camera and shoot what is broadcasted
Step.
Finally it should be noted that being merely illustrative of the technical solution of the present invention and unrestricted above, although with reference to preferable cloth
Scheme is put the present invention is described in detail, it will be understood by those within the art that, can be to technology of the invention
Scheme（Such as：Setting, sequencing of step of each device of system etc.）Modify or equivalent substitution, without departing from this hair
The spirit and scope of bright technical scheme.Method of the present invention can be worked out as the program applied to computer system, and is run
In computer network system of the present invention.
Claims (1)
1. a kind of method that virtual video camera switches with real camera, system used in methods described includes：With synthesis wash with watercolours
Contaminate the real camera of server connection, described real camera is connected with chroma key device, described synthesis rendering server and
Virtual video camera controller is connected, and is provided with and real camera and virtual video camera controller in described synthesis rendering server
The virtual video camera of connection, described virtual video camera is connected with synthesizer, described synthesizer and described chroma key device
Connection, be additionally provided with described synthesis rendering server the prospect generating means being connected with synthesizer, Background generation device and
Output device, it is characterised in that as follows the step of methods described：
Prepared process：
The step of making and virtual scene be set：Virtual scene and virtual portrait and void are made for three-dimensional animation production device
Intend object, or virtual prospect, virtual background and visual human are made for described prospect generating means and Background generation device
Thing and virtual article；Or for described prospect generating means and Background generation device according to three-dimensional animation production device system
The virtual scene for making to complete specifies virtual prospect and virtual background；
The step of calibrating camera：Three dimensional space coordinate, Zoom, focus parameter for obtaining real camera, by acquisition
The three dimensional space coordinate of real camera, Zoom, focus parameter are sent to three-dimensional animation production device and virtual video camera parameter
In generating means；
The step of generating virtual video camera, for synthesizing rendering server according to proven in " the step of calibrating camera "
Three dimensional space coordinate, the parameter information of Zoom, focus parameter acquiring real camera of real camera, the virtual shooting of generation
Machine；Or the setting generation virtual video camera of the virtual scene completed according to three-dimensional animation production device；When there is multiple void
Intend in the presence of video camera, some virtual video camera is specified by virtual video camera controller or virtual video camera parameter generation device
For current main virtual video camera；
The process of broadcast：
Real camera shoots the step of broadcasting：For real camera under operator's control to studio scene and hosting
People, welcome guest are shot, and give synthesis rendering server by chroma key device by shooting vision signal；The parameter of real camera
Information passes to the virtual video camera parameter generation device of synthesis rendering server in real time；Rendering server is synthesized to fill by synthesizing
The vision signal that shoots real camera and prospect generating means, Background generation device or synthesizer are put according to truly taking the photograph
The parameter information of camera renders virtual foreground picture, virtual background picture, virtual portrait and the superposition of virtual article picture of generation
After synthesis, it is sent to output device and externally broadcasts；
Send real camera and switch to the step of virtual video camera is instructed：For logical according to the demand of broadcast or the requirement of scene script
Cross synthesis rendering server or virtual video camera controller sends the instruction that virtual video camera is switched to from real camera；
The step of composograph：Generated for virtual video camera parameter generation device according to the instruction of virtual video camera controller empty
Intend the parameter information of video camera, or virtual video camera parameter generation device is given birth to according to the control instruction of the good script of pre-edit
Into the parameter information of virtual video camera, virtual video camera receives the virtual video camera that the transmission of virtual video camera parameter generation device comes
Parameter information, receive the main virtual shooting of instruction switching of virtual video camera parameter generation device or virtual video camera controller
Machine, synthesizer is sent to by the parameter information of unique virtual video camera or the virtual video camera of main virtual video camera；Prospect
Generating means, Background generation device render the virtual prospect of generation according to the parameter information of the virtual video camera obtained from synthesizer
Picture and virtual background picture, synthesizer independently can also render the virtual prospect of generation according to the parameter information of virtual video camera
Picture, virtual background picture, virtual portrait and virtual article picture, the video that synthesizer shoots real camera is according to void
The parameter information for intending video camera is rendered, and shoots video pictures and virtual prospect picture to the real camera for rendering generation
Face, virtual background picture, virtual portrait and virtual article picture are overlapped synthesis output；
Send the step of virtual video camera switchback real camera is instructed：For the demand according to program, send virtual shooting
Machine-cut returns the instruction of real camera；
The step of switchback real camera：Rendering server is synthesized after order is received, is generated and filled by virtual video camera parameter
The direction of motion and speed that virtual video camera is controlled according to the movement velocity and curve movement of virtual video camera are put, synthesis renders clothes
Real camera when virtual video camera parameter generation device in business device switches to virtual video camera according to real camera
Parameter information, by parameter information of the virtual video camera from parameter current smooth interpolation to real camera, one during smooth interpolation
It is straight to keep rendering and exporting to virtual scene；After virtual video camera is consistent with the parameter information of real camera, go to true
Real video camera shoots the step of broadcasting.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410716397.4A CN104349020B (en) | 2014-12-02 | 2014-12-02 | A kind of method that virtual video camera switches with real camera |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201410716397.4A CN104349020B (en) | 2014-12-02 | 2014-12-02 | A kind of method that virtual video camera switches with real camera |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104349020A CN104349020A (en) | 2015-02-11 |
| CN104349020B true CN104349020B (en) | 2017-11-03 |
Family
ID=52503763
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201410716397.4A Active CN104349020B (en) | 2014-12-02 | 2014-12-02 | A kind of method that virtual video camera switches with real camera |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104349020B (en) |
Families Citing this family (23)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106157352B (en) * | 2015-04-08 | 2019-01-01 | 苏州美房云客软件科技股份有限公司 | The numbers show method of hard-cover 360 degree of pictures and blank seamless switching |
| CN106713889B (en) * | 2015-11-13 | 2019-05-28 | 中国电信股份有限公司 | The rendering method and system and mobile terminal of 3D picture |
| CN105488457B (en) * | 2015-11-23 | 2019-04-16 | 北京电影学院 | Dummy emulation method and system of the camera motion control system in film shooting |
| CN105611308B (en) * | 2015-12-18 | 2018-11-06 | 盯盯拍（深圳）技术股份有限公司 | Video pictures processing method, device and system |
| CN105872387A (en) * | 2016-06-06 | 2016-08-17 | 杭州同步科技有限公司 | System and method for switching between virtual camera and real camera |
| CN106254849B (en) * | 2016-08-08 | 2018-11-13 | 深圳迪乐普数码科技有限公司 | A kind of method and terminal that foreground object is locally replaced |
| CN106780676B (en) * | 2016-12-01 | 2020-03-10 | 厦门黑镜科技有限公司 | Method and device for displaying animation |
| CN107888823A (en) * | 2017-10-30 | 2018-04-06 | 维沃移动通信有限公司 | One kind shooting processing method, apparatus and system |
| CN107948466A (en) * | 2017-11-23 | 2018-04-20 | 北京德火新媒体技术有限公司 | A kind of three-dimensional scene construction method and system for video program production |
| CN107888890A (en) * | 2017-12-25 | 2018-04-06 | 河南新汉普影视技术有限公司 | It is a kind of based on the scene packing device synthesized online and method |
| CN107948625A (en) * | 2017-12-25 | 2018-04-20 | 河南新汉普影视技术有限公司 | It is a kind of based on the scene packing method being virtually implanted and system |
| CN108364336A (en) * | 2018-01-18 | 2018-08-03 | 珠海金山网络游戏科技有限公司 | Method and system based on three-dimensional animation motion capture virtual camera stabilization |
| CN109240499B (en) * | 2018-08-31 | 2022-02-08 | 云南师范大学 | Virtual camera simulation interaction control system and method, and information data processing terminal |
| CN110225224B (en) * | 2019-07-05 | 2023-05-16 | 北京星律动科技有限公司 | Virtual image guiding and broadcasting method, device and system |
| CN113114941B (en) * | 2019-08-12 | 2023-05-12 | 创新先进技术有限公司 | Processing method, device and equipment for shooting image by camera |
| CN110730340B (en) * | 2019-09-19 | 2023-06-20 | 北京拉近众博科技有限公司 | Virtual audience display method, system and storage medium based on lens transformation |
| CN110992486B (en) * | 2019-12-06 | 2023-04-07 | 海南诺亦腾海洋科技研究院有限公司 | Shooting method of underwater simulation shooting system based on VR technology |
| CN111586317A (en) * | 2020-05-27 | 2020-08-25 | 上海姝嫣文化传播中心 | Picture scene switching method and device, computer equipment and storage medium |
| US11729507B2 (en) * | 2021-02-12 | 2023-08-15 | Sony Group Corporation | Progressive morphological lens parameter encoding |
| CN113055550A (en) * | 2021-02-26 | 2021-06-29 | 视伴科技(北京)有限公司 | Method and device for previewing event activities |
| CN114187429B (en) * | 2021-11-09 | 2023-03-24 | 北京百度网讯科技有限公司 | Virtual image switching method and device, electronic equipment and storage medium |
| CN115802165B (en) * | 2023-02-10 | 2023-05-12 | 成都索贝数码科技股份有限公司 | Lens moving shooting method applied to live broadcast connection of different places and same scene |
| CN116600063A (en) * | 2023-05-11 | 2023-08-15 | 深圳市天擎数字有限责任公司 | Virtual reality fuses studio space positioning system and device system |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1477856A (en) * | 2002-08-21 | 2004-02-25 | 北京新奥特集团 | True three-dimensional virtual studio system and its implement method |
| KR20140048827A (en) * | 2012-10-16 | 2014-04-24 | 전재웅 | Method, system and computer-readable recording medium for controlling virtual camera in virtual space of three dimensions |
| CN104168406A (en) * | 2014-09-02 | 2014-11-26 | 北京中科大洋科技发展股份有限公司 | Studio linkage broadcasting controlling system and method |
-
2014
- 2014-12-02 CN CN201410716397.4A patent/CN104349020B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1477856A (en) * | 2002-08-21 | 2004-02-25 | 北京新奥特集团 | True three-dimensional virtual studio system and its implement method |
| KR20140048827A (en) * | 2012-10-16 | 2014-04-24 | 전재웅 | Method, system and computer-readable recording medium for controlling virtual camera in virtual space of three dimensions |
| CN104168406A (en) * | 2014-09-02 | 2014-11-26 | 北京中科大洋科技发展股份有限公司 | Studio linkage broadcasting controlling system and method |
Non-Patent Citations (1)
| Title |
|---|
| 广播级真三维数字虚拟演播室技术的研究与实现;张锋;《中国优秀硕士学位论文全文数据库信息科技辑》;20140515(第05期);全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104349020A (en) | 2015-02-11 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104349020B (en) | A kind of method that virtual video camera switches with real camera | |
| US11196984B2 (en) | System and method for generating videos | |
| CN108986189B (en) | Method and system for capturing and live broadcasting of real-time multi-person actions based on three-dimensional animation | |
| WO2022062680A1 (en) | Animation generation method, apparatus and system, and storage medium | |
| JP2022177053A (en) | Information processing system, information processing method, and information processing program | |
| US20130215229A1 (en) | Real-time compositing of live recording-based and computer graphics-based media streams | |
| US20130218542A1 (en) | Method and system for driving simulated virtual environments with real data | |
| CN106358036A (en) | Method for watching virtual reality video at preset view angle | |
| CN103051830B (en) | A kind of system and method to clapped target multi-angle live event | |
| KR20090064153A (en) | Method and apparatus for creating 3d face model by using multi-view image information | |
| Lincoln et al. | Animatronic shader lamps avatars | |
| KR20130090621A (en) | Apparatus and method for pre-visualization image | |
| US20230179756A1 (en) | Information processing device, information processing method, and program | |
| KR101340598B1 (en) | Method for generating a movie-based, multi-viewpoint virtual reality and panoramic viewer using 3d surface tile array texture mapping | |
| Lincoln et al. | Animatronic shader lamps avatars | |
| Schreer et al. | Advanced volumetric capture and processing | |
| CN117456113B (en) | Cloud offline rendering interactive application implementation method and system | |
| JP2010166218A (en) | Camera system and method of controlling the same | |
| US11231745B1 (en) | Wearable article with conduits for a performance capture system | |
| WO2023236656A1 (en) | Method and apparatus for rendering interactive picture, and device, storage medium and program product | |
| JPH10208073A (en) | Virtual reality creating device | |
| KR20200092893A (en) | Augmented reality video production system and method using 3d scan data | |
| Hayashi et al. | Desktop virtual studio system | |
| CN112799559B (en) | Anti-lost interaction method and device applied to digital sand table | |
| AU2018203096B2 (en) | System, method and apparatus for rapid film pre-visualization |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |