CN108200445A - The virtual studio system and method for virtual image - Google Patents
The virtual studio system and method for virtual image Download PDFInfo
- Publication number
- CN108200445A CN108200445A CN201810030721.5A CN201810030721A CN108200445A CN 108200445 A CN108200445 A CN 108200445A CN 201810030721 A CN201810030721 A CN 201810030721A CN 108200445 A CN108200445 A CN 108200445A
- Authority
- CN
- China
- Prior art keywords
- image
- virtual
- reality
- scene
- programme
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs
- H04N21/23412—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs for generating or manipulating the scene composition of objects, e.g. MPEG-4 objects
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/21—Server components or server architectures
- H04N21/218—Source of audio or video content, e.g. local disk arrays
- H04N21/2187—Live feed
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/233—Processing of audio elementary streams
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/234—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs
- H04N21/23424—Processing of video elementary streams, e.g. splicing of video streams, manipulating MPEG-4 scene graphs involving splicing one content stream with another content stream, e.g. for inserting or substituting an advertisement
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/242—Synchronization processes, e.g. processing of PCR [Program Clock References]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/439—Processing of audio elementary streams
- H04N21/4398—Processing of audio elementary streams involving reformatting operations of audio signals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
- H04N21/44012—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving rendering scenes according to scene graphs, e.g. MPEG-4 scene graphs
Abstract
The embodiment of the present application provides the virtual studio system and method for a kind of virtual image, the reality for now including the first reality image by acquiring in real time performs in a radio or TV programme image data and live audio data, and the action data of the second reality image is acquired in real time, and with the action data drives the dummy model in real time and generates virtual image animation data, and pass through and synthesize the virtual image animation data and the reality and perform in a radio or TV programme image data, it is performed in a radio or TV programme in scene so that virtual image is implanted to the reality, and pass through the synchronous integration live audio data, the video capture video-audio data of real-time interactive in scene is performed in a radio or TV programme in the reality so as to generate the virtual image with first reality image.
Description
Technical field
The invention relates to the virtual studio systems and side of live video manufacturing technology more particularly to virtual image
Method.
Background technology
With the continuous development of computer technology and virtual reality technology, realize between virtual image and reality image
Interactive performs in a radio or TV programme technology.
However, technique is mostly applied in production of film and TV at present, that is to say, that the audiovisual materials of video capture are to carry
Before complete, therefore, current manufacturing technology simultaneously can not online be performed in a radio or TV programme suitable for real-time broadcast TV or real-time network is online
It performs in a radio or TV programme etc. using situation.In view of this, virtual image and reality image live streaming interactive in Same Scene space how to be realized
The making of video, as the application technical task to be solved.
Invention content
In view of this, the main purpose of the embodiment of the present invention is to provide virtual studio system and the side of a kind of virtual image
Method realizes the making of virtual image and reality image live video interactive in Same Scene space, to be suitable in real time
The application situation that radio and television are performed in a radio or TV programme online or real-time network is performed in a radio or TV programme online.
The embodiment of the present application provides a kind of virtual studio system of virtual image, which is characterized in that including：Field image
Acquisition module, the image frame for acquiring the reality scene of performing in a radio or TV programme in real time perform in a radio or TV programme image data to generate reality, and the reality is drilled
It broadcasts image data and is included in the reality and perform in a radio or TV programme the first reality image performed in scene；Virtual image generation module, for leading
Enter the dummy model of virtual image, and acquire the movement locus of the second reality image in real time to generate action data, and utilize institute
State action data drives the dummy model to perform action in real time, so as to generate the virtual image animation of the virtual image in real time
Data；Virtual image implant module performs in a radio or TV programme image data for synthesizing the virtual image animation data in real time with the reality,
It is performed in a radio or TV programme in scene so that the virtual image is implanted to the reality, so as to generate video capture image data in real time；Live sound
Frequency acquisition module, for acquire in real time the reality perform in a radio or TV programme scene perform in a radio or TV programme sound, to generate live audio data, the scene
Audio data includes at least the first audio data of first reality image and the second audio number of second reality image
According to；And document-video in-pace integrates module, for the live audio data and the video capture image data to be synchronized
It integrates, so as to generate the virtual image and first reality image real-time interactive in the reality performs in a radio or TV programme scene in real time
Video capture video-audio data.
Optionally, in any embodiment of the application, the virtual image implant module is further included according to the reality
Image data is performed in a radio or TV programme, analyzes the camera trace parameters of the field image acquisition module, and incite somebody to action based on the camera trace parameters
The virtual image animation data imports the reality and performs in a radio or TV programme in image data.
Optionally, in any embodiment of the application, the virtual image implant module is further included drills in the reality
It broadcasts and virtual image initial coordinate parameter is set in the image frame at scene, performed in a radio or TV programme with defining the virtual image implantation reality
Initial position in the image frame at scene.
Optionally, in any embodiment of the application, the virtual image implant module is further included with the virtual shape
As initial coordinate parameter for origin define the virtual image the reality perform in a radio or TV programme scene image frame in mobile model
It encloses.
Optionally, in any embodiment of the application, which is characterized in that the reality perform in a radio or TV programme image data further include it is aobvious
Show that the reality performs in a radio or TV programme the realistic background scene image data of the realistic background scene in scene, and virtual image implantation mould
Block further includes：Virtual background scene establishes unit, described in analyzing shown by the realistic background scene image data
Realistic background scene to establish the virtual scene model of virtual background scene, and generates virtual background scene image data；And
First synthesis unit, for synthesizing the virtual image animation data and the virtual scene image data, to generate the void
Intend the dummy synthesis animation data that image is performed in the virtual scene.
Optionally, in any embodiment of the application, the virtual image implant module further includes the second synthesis unit,
It is used to synthesize the dummy synthesis animation data and the field image data of performing in a radio or TV programme, so that the virtual background field
Scape and the realistic background scene are overlapped, are performed in a radio or TV programme so as to generate the virtual image with first reality image described
The video capture image frame of interactive performance in scene.
Optionally, in any embodiment of the application, the virtual background scene is established unit and is further included：According to described in
Realistic background scene image data analyze the position coordinates of the real world object in the realistic background scene, according to this described in generation
Dummy object in virtual background scene so that real world object in the realistic background scene in the virtual background scene
Dummy object mutually map.
Optionally, in any embodiment of the application, the virtual image implant module further includes：Rendering unit,
For the real display effect according to the real world object in the realistic background scene, in the virtual background scene
The dummy object rendered the real display effect to simulate the real world object.
Optionally, in any embodiment of the application, the document-video in-pace integration module, which further includes, records the scene
The generated time of audio data and the video capture image data, the live audio data is calculated according to this and is virtually drilled with described
Broadcast the time point deviation of image data, and according to the time point deviation for the live audio data with it is described virtual
The output time point for performing in a radio or TV programme image data is adjusted, to realize the live audio data and the video capture image data
Synchronization process.
Another embodiment of the application also provides the video capture method of virtual image, which is characterized in that including：It imports empty
Intend the dummy model of image；The image frame at the acquisition reality scene of performing in a radio or TV programme performs in a radio or TV programme image data to generate reality in real time, adopts in real time
Collect the movement locus of the second reality image with generate action data and acquire in real time the reality perform in a radio or TV programme scene perform in a radio or TV programme sound
To generate live audio data, wherein, the reality, which performs in a radio or TV programme image data and is included in the reality, performs in a radio or TV programme performed in scene
One reality image, the live audio data include at least the first audio data of first reality image and described second and show
The second audio data of real image；The dummy model is driven to perform action in real time with the action data, so as to generate in real time
The virtual image animation data of the virtual image；The virtual image animation data is synthesized in real time performs in a radio or TV programme image with the reality
The virtual image is implanted to the reality and performed in a radio or TV programme in scene by data, so as to generate video capture image data in real time；With
And it is synchronous integrate the live audio data and the video capture image data, so as to generate the virtual image and described the
One reality image performs in a radio or TV programme the video capture video-audio data of real-time interactive in scene in the reality.
Optionally, in any embodiment of the application, the method further includes through field image acquisition module to adopt
Collect and generate the reality and perform in a radio or TV programme image data, and image data is performed in a radio or TV programme according to the reality, analyze the field image acquisition
The camera trace parameters of module, and the virtual image animation data is imported into the reality based on the camera trace parameters and is drilled
It broadcasts in image data.
Optionally, in any embodiment of the application, the method is further included in the image at the reality scene of performing in a radio or TV programme
Virtual image initial coordinate parameter is set in picture, to define the image picture that the virtual image is implanted into the reality scene of performing in a radio or TV programme
Initial position in face.
Optionally, in any embodiment of the application, the method is further included is joined with the virtual image initial coordinate
Number defines moving range of the virtual image in the image frame at the reality scene of performing in a radio or TV programme for origin.
Optionally, in any embodiment of the application, the reality performs in a radio or TV programme image data and further includes the display reality
The realistic background scene image data of the realistic background scene in scene are performed in a radio or TV programme, and the method further includes the analysis reality back of the body
The realistic background scene shown by scape scene image data, to establish the virtual scene model of virtual background scene, and it is raw
Into virtual background scene image data；And the virtual image animation data and the virtual scene image data are synthesized, with
Generate the dummy synthesis animation data that the virtual image is performed in the virtual scene.
Optionally, in any embodiment of the application, the method further include by the dummy synthesis animation data with
The field image data of performing in a radio or TV programme are synthesized, so that the virtual background scene is overlapped mutually with the realistic background scene,
So as to generate the virtual image with first reality image in the video capture image for performing in a radio or TV programme interactive performance in scene
Picture.
Optionally, in any embodiment of the application, the method further includes：According to the realistic background scene image
Data analyze the appearance and its position coordinates of the real world object in the realistic background scene, generate the virtual background according to this
Dummy object in scene, so that the real world object in the realistic background scene and the virtual object in the virtual background scene
Body mutually maps.
Optionally, in any embodiment of the application, the method further includes：According in the realistic background scene
The real display effect of the real world object is rendered to simulate for the dummy object in the virtual background scene
The real display effect of the real world object.
Optionally, in any embodiment of the application, the method further includes：Record the live audio data and institute
The generated time of video capture image data is stated, calculates the live audio data and the video capture image data according to this
Time point deviation, and according to the time point deviation for the live audio data and the video capture image data
Output time point be adjusted, it is synchronous with the video capture image data with the live audio data.
The virtual studio system and method for the virtual image that the embodiment of the present application is provided include by acquiring in real time
The reality at the reality of the one reality image scene of performing in a radio or TV programme performs in a radio or TV programme image data, and pass through the second reality image and drive dummy model in real time
Execution is acted to generate real-time virtual image animation data, with by synthesizing the virtual image animation data and the reality
Image data is performed in a radio or TV programme, and the virtual image is implanted into the reality and is performed in a radio or TV programme in scene, and the described first real shape of synchronous integration
As the audio data with second reality image, and the virtual image is generated in real time with first reality image described
Reality performs in a radio or TV programme the video capture video-audio data of real-time interactive in scene, whereby, to realize that real-time broadcast TV is performed in a radio or TV programme or real online
When the making of video capture video performed in a radio or TV programme online of network.
Description of the drawings
Some of detailed description the embodiment of the present application by way of example rather than limitation with reference to the accompanying drawings hereinafter are specific
Embodiment.Identical reference numeral denotes same or similar component or part in attached drawing.Those skilled in the art should manage
Solution, what these attached drawings were not necessarily drawn to scale.In attached drawing：
Fig. 1 is illustrated according to the basic framework of the virtual studio system of the virtual image shown in the embodiment of the application
Figure；
Fig. 2 is the embodiment frame diagram of the virtual studio system for the virtual image for showing Fig. 1；
Fig. 3 is the basic procedure signal of the video capture method according to the virtual image shown in another embodiment of the application
Figure；And
Fig. 4 is the embodiment flow chart of the video capture method for the virtual image for showing Fig. 3.
Specific embodiment
Implement any technical solution of the embodiment of the present invention must be not necessarily required to reach simultaneously more than all advantages.
In order to which those skilled in the art is made to more fully understand the technical solution in the embodiment of the present invention, below in conjunction with the present invention
The technical solution in the embodiment of the present invention is clearly and completely described in attached drawing in embodiment, it is clear that described reality
It is only part of the embodiment of the embodiment of the present invention to apply example, instead of all the embodiments.Based on the implementation in the embodiment of the present invention
Example, those of ordinary skill in the art's all other embodiments obtained should all belong to the range that the embodiment of the present invention is protected.
Embodiment specific implementation is further illustrated the present invention with reference to attached drawing of the embodiment of the present invention.
Fig. 1 is illustrated according to the basic framework of the virtual studio system of the virtual image shown in the embodiment of the application
Figure.As shown in the figure, the virtual studio system 1 of the virtual image of the application mainly includes field image acquisition module 11, virtual shape
As generation module 12, virtual image implant module 13, live audio acquisition module 14 and document-video in-pace integrate module 15.
Field image acquisition module 11 performs in a radio or TV programme shadow for acquiring the image frame at the reality scene of performing in a radio or TV programme in real time to generate reality
As data, wherein, reality is performed in a radio or TV programme image data and is included in real the first reality image performed in a radio or TV programme and performed in scene, such as sing
The performing artists such as hand, dancer, host.In this present embodiment, field image acquisition module 11 is, for example, and is set to reality to drill
Broadcast the video camera at scene.
Virtual image generation module 12 is used to import the dummy model of virtual image, and acquires the second reality image in real time
Movement locus utilizes acquired action data dummy model to be driven to perform action in real time to generate action data, so as to real
The virtual image animation data of Shi Shengcheng virtual images.It in this present embodiment, can be by (such as being drilled from the background for the second reality image
Member) wearing motion capture system equipment generates action data to acquire the movement locus of the second reality image, and what is acquired is dynamic
Making data can be by three-dimensional motion engine maps to dummy model, to drive dummy model execution action so as to generate virtual image
Virtual image animation data.
Virtual image implant module 13 performs in a radio or TV programme image for synthesizing the virtual image animation data in real time with the reality
Virtual image is implanted to reality and performed in a radio or TV programme in scene by data, so as to generate video capture image data in real time, in described virtual
It performs in a radio or TV programme in the video capture picture shown by image data, virtual image and the first reality image can be real in reality performs in a radio or TV programme scene
It is now interactive in real time.
In embodiments herein, virtual image implant module 13 can perform in a radio or TV programme image data, analysis scene according to reality
The camera trace parameters of image collecting module 11, and virtual image animation data is imported into the reality based on camera trace parameters
It performs in a radio or TV programme in image data.That is, virtual image implant module 13 (is imaged by analyzing field image acquisition module 11
Machine) seat in the plane and viewfinder range and effect (including close shot, distant view), and obtain camera trace parameters, and according to this by virtual shape
It is performed in a radio or TV programme in scene as being implanted to reality, so that the reality that the virtual image after implantation can be acquired with field image acquisition module 11
The image frame at the scene of performing in a radio or TV programme blends, so as to improve the authenticity of video capture image frame.
In another embodiment of the application, virtual image implant module 13, which further includes to perform in a radio or TV programme in reality, sets void in scene
Intend vivid initial coordinate parameter, to define the initial position that virtual image is implanted into the reality scene of performing in a radio or TV programme.Preferably, virtual shape
As implant module 13 also sets shifting of the virtual image in reality performs in a radio or TV programme scene by origin of virtual image initial coordinate parameter
Dynamic range, to generate transplanting scope setup parameter, so as to define shifting of the virtual image in the image frame at the reality scene of performing in a radio or TV programme
Dynamic range.Whereby, by pre-setting scope of activities of the virtual image in the image frame at the reality scene of performing in a radio or TV programme, effectively to avoid
Virtual image and the first real reality image exception that generation position is Chong Die in the image frame at the reality scene of performing in a radio or TV programme.
Live audio acquisition module 14 performs in a radio or TV programme sound for the acquisition reality scene of performing in a radio or TV programme in real time, to generate live audio number
According in this present embodiment, the live audio data generated includes at least the first audio data second for having the first reality image
The second audio data of reality image.Live audio acquisition module 14 is for acquiring virtual image (i.e. the second reality image) and the
Dialogue between one reality image, to realize the exchange and interdynamic of the two phonetically.It specifically, can be by for the first reality image
Microphone is worn with the second reality image, to acquire the audio data.
Document-video in-pace integrate module 15 be used for the live audio data that is acquired live audio acquisition module 14 with it is virtual
The video capture image data that vivid implant module 13 is generated synchronizes integration, so as to generate virtual image and first in real time
Reality image performs in a radio or TV programme the video capture video-audio data of real-time interactive in scene in reality.Whereby, the application can realize virtual shape
As the making of live video for performing in a radio or TV programme real-time interactive in scene in reality with the first reality image.
In embodiments herein, document-video in-pace integrates module 15 by recording the live audio data and the void
Intend performing in a radio or TV programme the generated time of image data, calculate the time point deviation of live audio data and video capture image data according to this
Value, and adjusted according to output time point of the time point deviation for live audio data and video capture image data
It is whole, to realize the synchronization process of live audio data and video capture image data.Whereby, the application is by audio-visual synchronization skill
Art ensure that multiple presentation contents and multiple audio contents can synchronize be shown, and prevented that frame rate is lost and picture is lost
The situation of mistake.For example, during audio sync, by the way that the audio deviated is carried out Integral correction, broadcasting for audio is only changed
The time is put, keeps the playback rate and playing duration of audio, to prevent the loss in detail of audio.
Referring to Fig. 2, in an embodiment, display, which performs in a radio or TV programme image data and further includes the display reality, performs in a radio or TV programme in scene
The realistic background scene image data of realistic background scene, virtual image implant module 13 further include virtual background scene and establish list
Member 131, virtual background scene map unit 132 and the first synthesis unit 133.
Virtual background scene is established unit 131 and is carried on the back by analyzing the reality shown by realistic background scene image data
Scape scene to establish the virtual scene model of virtual background scene, and generates virtual background scene image data.
In this present embodiment, virtual background scene establishes unit 131 according to the realistic background scene image data, analysis
The position coordinates of real world object in the realistic background scene generate the dummy object in the virtual background scene according to this,
So that the real world object in the realistic background scene is mutually mapped with the dummy object in the virtual background scene.
It is used for specifically, virtual background scene establishes unit 131 by the orientation of the real world object in realistic background scene
Quantified, and pass through the position coordinates that normalized parametric form determines each real world object, for example, in realistic background scene
In determine a coordinate origin, to establish cartesian coordinate system in realistic background scene, and set length unit (according to precision
Need, can be arbitrary non-zero numerical value), and the distance with coordinate origin is determined by sensor, so as to calculate each real object
Then, realistic background scene and virtual background scene are mapped, are converted in realistic background scene for the cartesian coordinate of body
Real world object all azimuth informations, and be digitized and represented in the form of translating, rotating, scale, so as to fulfill reality
The accurate duplication of background scene and virtual background scene, for example, realistic background scene and the same flute of virtual background scene setting
Karr origin and same length unit, and according to the cartesian coordinate of each real world object calculated so that it is virtual
All dummy objects in background scene can find corresponding orientation, and each in virtual background scene in virtual background scene
Dummy object can also find corresponding orientation in realistic background scene.
First synthesis unit 132 is virtual to generate for synthesizing virtual image animation data and virtual scene image data
The dummy synthesis animation data that image is performed in virtual scene.
In addition, in another embodiment, virtual image implant module 13 further includes the second synthesis unit 133, be used for by
The dummy synthesis animation data that first synthesis unit 132 is generated performs in a radio or TV programme field image with what field image acquisition module was acquired
Data are synthesized, so that virtual background scene and realistic background scene are overlapped, that is, generate a secondary two worlds phase
The effect picture being mutually overlapped, so as to generate the video capture of virtual image and the first reality image interactive performance in the scene of performing in a radio or TV programme
Image frame.
In another embodiment, virtual image implant module 13 further includes rendering unit 134, is used for according to realistic background
The real display effect of real world object in scene, is rendered for the dummy object in virtual background scene with described in simulation
The real display effect of real world object.
It is shown specifically, rendering unit 134 is used to render each dummy object progress three dimensional stress in virtual background scene
Show, complete in realistic background scene optics, dynamics, thermodynamic (al) simulation, to meet the needs of user's feeling of immersion, ensure
The high-precision, high quality, low power consuming of virtual background scene are shown.The basis of the three-dimensional rendering technology includes but does not limit to
In opengl, which can select different figures to render interface according to system platform, hardware specification, including vulkan,
Opengl, directX, metal etc..
Referring to Fig. 3, it is the base of the video capture method according to the virtual image shown in another embodiment of the application
This flow diagram.
As shown in the figure, the video capture method of virtual image mainly includes the following steps that：
Step S31 imports the dummy model of virtual image.
Step S32, the image frame at the real scene of performing in a radio or TV programme of acquisition in real time are performed in a radio or TV programme image data to generate reality, are acquired in real time
The movement locus of second reality image with generate action data and acquire in real time the reality perform in a radio or TV programme scene perform in a radio or TV programme sound with
Generate live audio data.
In this present embodiment, it is performed in a radio or TV programme by field image acquisition module (such as video camera) with acquiring and generating the reality
Image data, and the reality acquired perform in a radio or TV programme image data be included in the reality perform in a radio or TV programme perform in scene first reality
Image, such as the performing artists such as singer, dancer, host.And by being dressed for the second reality image (such as backstage performer)
Motion capture system equipment generates action data to acquire the movement locus of the second reality image.In addition, the scene acquired
Audio data is then including at least the first audio data of first reality image and the second audio of second reality image
Data.
Step S33 drives the dummy model to perform action in real time with the action data, so as to generate the void in real time
Intend the virtual image animation data of image.
For example, the action data acquired can be by three-dimensional motion engine maps to dummy model, to drive dummy model
Execution action is so as to generate the virtual image animation data of virtual image.
Step S34 synthesizes the virtual image animation data and performs in a radio or TV programme image data with the reality, in real time by the void
Plan image is implanted to the reality and performs in a radio or TV programme in scene, so as to generate video capture image data in real time.
In embodiments herein, the method is further included performs in a radio or TV programme image data according to the reality, and analysis is described existing
The camera trace parameters of field image collecting module, and imported the virtual image animation data based on the camera trace parameters
The reality is performed in a radio or TV programme in image data.That is, by analyze field image acquisition module (i.e. video camera) seat in the plane and
Viewfinder range and effect (including close shot, distant view), and camera trace parameters are obtained, and virtual image is implanted to reality according to this and is drilled
It broadcasts in scene, so that the image at the reality that the virtual image after implantation can be acquired with the field image acquisition module scene of performing in a radio or TV programme is drawn
Face blends, so as to improve the authenticity of video capture image frame.
Furthermore when virtual image is implanted into, further includes and set virtual shape in the image frame at the reality scene of performing in a radio or TV programme
As initial coordinate parameter, to define the initial position that the virtual image is implanted into the image frame at the reality scene of performing in a radio or TV programme.
It further includes and sets the virtual image at the reality scene of performing in a radio or TV programme by origin of the virtual image initial coordinate parameter
Moving range in image frame to generate transplanting scope setup parameter, is drilled so as to define the virtual image in the reality
Broadcast the moving range in the image frame at scene.Whereby, it is drawn by pre-setting image of the virtual image at the reality scene of performing in a radio or TV programme
The scope of activities in face, virtual image effectively to be avoided to be generated in the image frame at the reality scene of performing in a radio or TV programme with the first real reality image
The exception of position overlapping.
Step S35, it is synchronous to integrate the live audio data and the video capture image data, so as to generate the void
Intend the video capture video-audio data that image performs in a radio or TV programme real-time interactive in scene with first reality image in the reality.
Specifically, the generated time by recording the live audio data and the video capture image data, according to
To calculate the time point deviation of the live audio data and the video capture image data, and it is inclined according to the time point
Difference is adjusted for the output time point of the live audio data and the video capture image data, with the scene
Audio data is synchronous with the video capture image data.
Referring to Fig. 4, in another embodiment, the reality that is acquired perform in a radio or TV programme image data further include display reality perform in a radio or TV programme it is existing
The realistic background scene image data of realistic background scene in.The present processes further include：
Step S41 analyzes the realistic background scene shown by the realistic background scene image data, to establish void
Intend the virtual scene model of background scene, and generate virtual background scene image data.
According to the realistic background scene image data, analyze real world object in the realistic background scene appearance and
Its position coordinates generates the dummy object in the virtual background scene according to this, so that the reality in the realistic background scene
Object is mutually mapped with the dummy object in the virtual background scene.
Specifically, by the way that the orientation of the real world object in realistic background scene is quantified, and pass through normalized
Parametric form determines the position coordinates of each real world object, for example, in realistic background scene determine a coordinate origin, with
Cartesian coordinate system is established in realistic background scene, and it (can be arbitrary non-zero number according to precision needs to set length unit
Value), and the distance with coordinate origin is determined by sensor, so as to calculate the cartesian coordinate of each real world object, then,
Realistic background scene and virtual background scene are mapped, are converted to all orientation of the real world object in realistic background scene
Information, and be digitized and represented in the form of translating, rotating, scale, so as to fulfill realistic background scene and virtual background field
The accurate duplication of scape, that is, by realistic background scene Descartes's origin same with virtual background scene setting and same
A length unit, and according to the cartesian coordinate of each real world object calculated so that all void in virtual background scene
Corresponding orientation can be found, and each dummy object in virtual background scene also can be in reality in virtual background scene by intending object
Corresponding orientation is found in background scene
In addition, the application can also be according to the real display effect of the real world object in realistic background scene, for institute
It states the dummy object in virtual background scene and is rendered the real display effect to simulate the real world object, it is main
Will include in realistic background scene optics, dynamics, thermodynamic (al) simulation.
Step S42 synthesizes the virtual image animation data and the virtual scene image data, described virtual to generate
The dummy synthesis animation data that image is performed in the virtual scene.
In preferred embodiment, it may also include：
Step S43 synthesizes the dummy synthesis animation data and the field image data of performing in a radio or TV programme, so that described
Virtual background scene is overlapped mutually with the realistic background scene, so as to generate the virtual image and first reality image
In the video capture image frame for performing in a radio or TV programme interactive performance in scene.
In conclusion the virtual studio system and method for the virtual image of the application, realize remote online and perform in a radio or TV programme function
Realization, virtual image can remotely, concurrently carry out performing in a radio or TV programme, and support playing platform for radio and television and online network
Long-range more lens controls and switching, greatly improve virtual image performs in a radio or TV programme efficiency, greatly reduce perform in a radio or TV programme online into
This.
Furthermore the realistic background scene that the application can also perform in a radio or TV programme in image data according further to reality generates virtual background
Scene, also can be by by virtual background scene and reality to generate the image video that virtual image is performed in a radio or TV programme in virtual background scene
Border background scene carries out precise overlay, and generate virtual image and the first reality image in the scene of performing in a radio or TV programme interactive performance it is virtual
Image frame is performed in a radio or TV programme, whereby, a variety of different video production demands can be met.
The apparatus embodiments described above are merely exemplary, wherein the module illustrated as separating component can
To be or may not be physically separate, the component shown as module may or may not be physics mould
Block, you can be located at a place or can also be distributed on multiple network modules.It can be selected according to the actual needs
In some or all of module realize the purpose of this embodiment scheme.Those of ordinary skill in the art are not paying creativeness
Labour in the case of, you can to understand and implement.
Through the above description of the embodiments, those skilled in the art can be understood that each embodiment can
It is realized by the mode of software plus required general hardware platform, naturally it is also possible to pass through hardware.Based on such understanding, on
Technical solution is stated substantially in other words to embody the part that the prior art contributes in the form of software product, it should
Computer software product can store in a computer-readable storage medium, the computer readable recording medium storing program for performing include for
The readable form storage of computer (such as computer) or any mechanism of transmission information.For example, machine readable media is included only
Read memory (ROM), random access memory (RAM), magnetic disk storage medium, optical storage media, flash medium, electricity, light,
Sound or the transmitting signal of other forms (for example, carrier wave, infrared signal, digital signal etc.) etc., which includes
Some instructions are used so that computer equipment (can be personal computer, server or the network equipment etc.) perform it is each
Method described in certain parts of a embodiment or embodiment.
Finally it should be noted that：Above example is only to illustrate the technical solution of the embodiment of the present application rather than it is limited
System；Although the application is described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that：Its
Still it can modify to the technical solution recorded in foregoing embodiments or which part technical characteristic is equal
It replaces；And these modifications or replacement, each embodiment technical solution of the application that it does not separate the essence of the corresponding technical solution
Spirit and scope.
It will be understood by those skilled in the art that the embodiment of the embodiment of the present invention can be provided as method, apparatus (equipment) or
Computer program product.Therefore, the embodiment of the present invention can be used complete hardware embodiment, complete software embodiment or combine soft
The form of the embodiment of part and hardware aspect.Moreover, the embodiment of the present invention can be used wherein includes calculating in one or more
The computer-usable storage medium of machine usable program code (includes but not limited to magnetic disk storage, CD-ROM, optical memory
Deng) on the form of computer program product implemented.
The embodiment of the present invention with reference to according to the method for the embodiment of the present invention, device (equipment) and computer program product
Flowchart and/or the block diagram describes.It should be understood that it can be realized by computer program instructions every in flowchart and/or the block diagram
The combination of flow and/or box in one flow and/or box and flowchart and/or the block diagram.These computers can be provided
Program instruction is to the processor of all-purpose computer, special purpose computer, Embedded Processor or other programmable data processing devices
To generate a machine so that the instruction performed by computer or the processor of other programmable data processing devices generates use
In the dress of function that realization is specified in one flow of flow chart or multiple flows and/or one box of block diagram or multiple boxes
It puts.
These computer program instructions, which may also be stored in, can guide computer or other programmable data processing devices with spy
Determine in the computer-readable memory that mode works so that the instruction generation being stored in the computer-readable memory includes referring to
Enable the manufacture of device, the command device realize in one flow of flow chart or multiple flows and/or one box of block diagram or
The function of being specified in multiple boxes.
These computer program instructions can be also loaded into computer or other programmable data processing devices so that counted
Series of operation steps are performed on calculation machine or other programmable devices to generate computer implemented processing, so as in computer or
The instruction offer performed on other programmable devices is used to implement in one flow of flow chart or multiple flows and/or block diagram one
The step of function of being specified in a box or multiple boxes.
Claims (18)
1. a kind of virtual studio system of virtual image, which is characterized in that including：
Field image acquisition module, the image frame for acquiring the reality scene of performing in a radio or TV programme in real time perform in a radio or TV programme image number to generate reality
Image data is performed in a radio or TV programme according to, the reality be included in the reality perform in a radio or TV programme the first reality image performed in scene；
Virtual image generation module for importing the dummy model of virtual image, and acquires the action of the second reality image in real time
Track drives the dummy model to perform action in real time to generate action data using the action data, so as to give birth in real time
Into the virtual image animation data of the virtual image；
Virtual image implant module performs in a radio or TV programme image data for synthesizing the virtual image animation data in real time with the reality,
It is performed in a radio or TV programme in scene so that the virtual image is implanted to the reality, so as to generate video capture image data in real time；
Live audio acquisition module, for acquire in real time the reality perform in a radio or TV programme scene perform in a radio or TV programme sound, to generate live audio number
According to the live audio data includes at least the first audio data of first reality image and second reality image
Second audio data；And
Document-video in-pace integrates module, whole for the live audio data to be synchronized with the video capture image data
It closes, the void of real-time interactive in scene is performed in a radio or TV programme in the reality with first reality image so as to generate the virtual image in real time
Plan performs in a radio or TV programme video-audio data.
2. the virtual studio system of virtual image according to claim 1, which is characterized in that the virtual image is implanted into mould
Block is further included performs in a radio or TV programme image data according to the reality, analyzes the camera trace parameters of the field image acquisition module, and base
The virtual image animation data is imported the reality in the camera trace parameters to perform in a radio or TV programme in image data.
3. the virtual studio system of virtual image according to claim 2, which is characterized in that the virtual image is implanted into mould
Block is further included sets virtual image initial coordinate parameter in the image frame at the reality scene of performing in a radio or TV programme, described virtual to define
Image is implanted into the initial position in the image frame at the reality scene of performing in a radio or TV programme.
4. the virtual studio system of virtual image according to claim 3, which is characterized in that the virtual image is implanted into mould
Block, which is further included, to be defined the virtual image as origin using the virtual image initial coordinate parameter and performs in a radio or TV programme scene in the reality
Image frame in moving range.
5. the virtual studio system of virtual image according to claim 1, which is characterized in that the reality performs in a radio or TV programme image number
According to further including the realistic background scene image data for showing that the reality performs in a radio or TV programme the realistic background scene in scene, and described virtual
Vivid implant module further includes：
Virtual background scene establishes unit, is carried on the back by analyzing the reality shown by the realistic background scene image data
Scape scene to establish the virtual scene model of virtual background scene, and generates virtual background scene image data；And
First synthesis unit, for synthesizing the virtual image animation data and the virtual scene image data, to generate
State the dummy synthesis animation data that virtual image is performed in the virtual scene.
6. the virtual studio system of virtual image according to claim 5, which is characterized in that the virtual image is implanted into mould
Block further includes the second synthesis unit, is used to close the dummy synthesis animation data and the field image data of performing in a radio or TV programme
Into so that the virtual background scene and the realistic background scene are overlapped, so as to generate the virtual image with it is described
First reality image is in the video capture image frame for performing in a radio or TV programme interactive performance in scene.
7. the virtual studio system of virtual image according to claim 5, which is characterized in that the virtual background scene is built
Vertical unit further includes：According to the realistic background scene image data, real world object in the realistic background scene is analyzed
Position coordinates generate the dummy object in the virtual background scene according to this, so that the real object in the realistic background scene
Body is mutually mapped with the dummy object in the virtual background scene.
8. the virtual studio system of virtual image according to claim 7, which is characterized in that the virtual image is implanted into mould
Block further includes：
Rendering unit is used for the real display effect according to the real world object in the realistic background scene, for institute
It states the dummy object in virtual background scene and is rendered the real display effect to simulate the real world object.
9. the virtual studio system of virtual image according to claim 1, which is characterized in that the document-video in-pace integrates mould
Block further includes the generated time for recording the live audio data and the video capture image data, calculates the scene according to this
The time point deviation of audio data and the video capture image data, and according to the time point deviation for described existing
The output time point of audio data and the video capture image data is adjusted, with realize the live audio data and
The synchronization process of the video capture image data.
10. a kind of video capture method of virtual image, which is characterized in that including：
Import the dummy model of virtual image；
The image frame at the acquisition reality scene of performing in a radio or TV programme performs in a radio or TV programme image data to generate reality in real time, acquires the second reality image in real time
Movement locus to generate action data and acquire the reality scene of performing in a radio or TV programme in real time performs in a radio or TV programme sound to generate live audio
Data, wherein, the reality, which performs in a radio or TV programme image data and is included in the reality, performs in a radio or TV programme the first reality image performed in scene, described
Live audio data includes at least the first audio data of first reality image and the second sound of second reality image
Frequency evidence；
The dummy model is driven to perform action in real time with the action data, so as to generate the virtual of the virtual image in real time
Vivid animation data；
The virtual image animation data is synthesized in real time and performs in a radio or TV programme image data with the reality, and the virtual image is implanted to
The reality is performed in a radio or TV programme in scene, so as to generate video capture image data in real time；And
It is synchronous to integrate the live audio data and the video capture image data, so as to generate the virtual image with it is described
First reality image performs in a radio or TV programme the video capture video-audio data of real-time interactive in scene in the reality.
11. the video capture method of virtual image according to claim 10, which is characterized in that the method further includes logical
It crosses field image acquisition module and performs in a radio or TV programme image data to acquire and generate the reality, and image number is performed in a radio or TV programme according to the reality
According to analyzing the camera trace parameters of the field image acquisition module, and based on the camera trace parameters by the virtual shape
It is performed in a radio or TV programme in image data as animation data imports the reality.
12. the video capture method of virtual image according to claim 11, which is characterized in that the method further include in
Virtual image initial coordinate parameter is set in the image frame at the reality scene of performing in a radio or TV programme, to define the virtual image implantation institute
State the initial position in the image frame at the reality scene of performing in a radio or TV programme.
13. the video capture method of virtual image according to claim 12, which is characterized in that the method further include with
The virtual image initial coordinate parameter defines image frame of the virtual image at the reality scene of performing in a radio or TV programme for origin
In moving range.
14. the video capture method of virtual image according to claim 10, which is characterized in that the reality performs in a radio or TV programme image
Data further include the realistic background scene image data for showing that the reality performs in a radio or TV programme the realistic background scene in scene, and the side
Method further includes：
The realistic background scene shown by the realistic background scene image data is analyzed, to establish virtual background scene
Virtual scene model, and generate virtual background scene image data；And
The virtual image animation data and the virtual scene image data are synthesized, to generate the virtual image in the void
Intend the dummy synthesis animation data performed in scene.
15. the video capture method of virtual image according to claim 14, which is characterized in that the method further include by
The dummy synthesis animation data is synthesized with the field image data of performing in a radio or TV programme so that the virtual background scene with it is described
Realistic background scene is overlapped mutually, and is performed in a radio or TV programme in scene mutually described so as to generate the virtual image and first reality image
The video capture image frame of dynamic performance.
16. the video capture method of virtual image according to claim 14, which is characterized in that the method further includes：
According to the realistic background scene image data, the appearance and its position for analyzing the real world object in the realistic background scene are sat
Mark, generates the dummy object in the virtual background scene, so that real world object and institute in the realistic background scene according to this
The dummy object stated in virtual background scene mutually maps.
17. the video capture method of virtual image according to claim 16, which is characterized in that the method further includes：
According to the real display effect of the real world object in the realistic background scene, for the institute in the virtual background scene
It states dummy object and is rendered the real display effect to simulate the real world object.
18. the video capture method of virtual image according to claim 12, which is characterized in that the method further includes：
The generated time of the live audio data and the video capture image data is recorded, calculates the live audio data according to this
With the time point deviation of the video capture image data, and according to the time point deviation be directed to the live audio number
It is adjusted according to the output time point with the video capture image data, with the live audio data and the video capture
Image data synchronizes.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810030721.5A CN108200445B (en) | 2018-01-12 | 2018-01-12 | Virtual playing system and method of virtual image |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810030721.5A CN108200445B (en) | 2018-01-12 | 2018-01-12 | Virtual playing system and method of virtual image |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108200445A true CN108200445A (en) | 2018-06-22 |
| CN108200445B CN108200445B (en) | 2021-02-26 |
Family
ID=62588856
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810030721.5A Active CN108200445B (en) | 2018-01-12 | 2018-01-12 | Virtual playing system and method of virtual image |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108200445B (en) |
Cited By (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109859327A (en) * | 2019-02-20 | 2019-06-07 | 中山市嘉游动漫科技有限公司 | A kind of virtual cartoon scene construction method and device with reality of combination |
| CN110225224A (en) * | 2019-07-05 | 2019-09-10 | 北京乐元素文化发展有限公司 | Director method, the apparatus and system of virtual image |
| CN110290291A (en) * | 2019-07-05 | 2019-09-27 | 北京乐元素文化发展有限公司 | Picture synthesis method and device and interactive approach |
| CN110300242A (en) * | 2019-07-05 | 2019-10-01 | 北京乐元素文化发展有限公司 | The performance system of virtual image |
| CN110689570A (en) * | 2019-09-29 | 2020-01-14 | 北京达佳互联信息技术有限公司 | Live virtual image broadcasting method and device, electronic equipment and storage medium |
| CN110691279A (en) * | 2019-08-13 | 2020-01-14 | 北京达佳互联信息技术有限公司 | Virtual live broadcast method and device, electronic equipment and storage medium |
| CN110719533A (en) * | 2019-10-18 | 2020-01-21 | 广州虎牙科技有限公司 | Live virtual image broadcasting method and device, server and storage medium |
| CN111598983A (en) * | 2020-05-18 | 2020-08-28 | 北京乐元素文化发展有限公司 | Animation system, animation method, storage medium, and program product |
| CN111683260A (en) * | 2020-05-07 | 2020-09-18 | 广东康云科技有限公司 | Program video generation method, system and storage medium based on virtual anchor |
| CN112017264A (en) * | 2020-09-10 | 2020-12-01 | 网易（杭州）网络有限公司 | Display control method and device for virtual studio, storage medium and electronic equipment |
| WO2021109764A1 (en) * | 2019-12-05 | 2021-06-10 | 中兴通讯股份有限公司 | Image or video generation method and apparatus, computing device and computer-readable medium |
| CN113365130A (en) * | 2020-03-03 | 2021-09-07 | 广州虎牙科技有限公司 | Live broadcast display method, live broadcast video acquisition method and related devices |
| CN113395540A (en) * | 2021-06-09 | 2021-09-14 | 广州博冠信息科技有限公司 | Virtual broadcasting system, virtual broadcasting implementation method, device and equipment, and medium |
| CN115619912A (en) * | 2022-10-27 | 2023-01-17 | 深圳市诸葛瓜科技有限公司 | Cartoon character display system and method based on virtual reality technology |
| CN115866354A (en) * | 2022-11-25 | 2023-03-28 | 广州美术学院 | Interactive virtual reality-based non-material heritage iconic deduction method and device |
Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102688603A (en) * | 2011-03-22 | 2012-09-26 | 王鹏勃 | System of and method for real-time magic-type stage performance based on technologies of augmented reality and action recognition |
| CN105872575A (en) * | 2016-04-12 | 2016-08-17 | 乐视控股（北京）有限公司 | Live broadcasting method and apparatus based on virtual reality |
| CN107197385A (en) * | 2017-05-31 | 2017-09-22 | 珠海金山网络游戏科技有限公司 | A kind of real-time virtual idol live broadcasting method and system |
| CN107194979A (en) * | 2017-05-11 | 2017-09-22 | 上海微漫网络科技有限公司 | The Scene Composition methods and system of a kind of virtual role |
| CN107248195A (en) * | 2017-05-31 | 2017-10-13 | 珠海金山网络游戏科技有限公司 | A kind of main broadcaster methods, devices and systems of augmented reality |
| WO2017191978A1 (en) * | 2016-05-02 | 2017-11-09 | Samsung Electronics Co., Ltd. | Method, apparatus, and recording medium for processing image |
-
2018
- 2018-01-12 CN CN201810030721.5A patent/CN108200445B/en active Active
Patent Citations (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN102688603A (en) * | 2011-03-22 | 2012-09-26 | 王鹏勃 | System of and method for real-time magic-type stage performance based on technologies of augmented reality and action recognition |
| CN105872575A (en) * | 2016-04-12 | 2016-08-17 | 乐视控股（北京）有限公司 | Live broadcasting method and apparatus based on virtual reality |
| WO2017191978A1 (en) * | 2016-05-02 | 2017-11-09 | Samsung Electronics Co., Ltd. | Method, apparatus, and recording medium for processing image |
| CN107194979A (en) * | 2017-05-11 | 2017-09-22 | 上海微漫网络科技有限公司 | The Scene Composition methods and system of a kind of virtual role |
| CN107197385A (en) * | 2017-05-31 | 2017-09-22 | 珠海金山网络游戏科技有限公司 | A kind of real-time virtual idol live broadcasting method and system |
| CN107248195A (en) * | 2017-05-31 | 2017-10-13 | 珠海金山网络游戏科技有限公司 | A kind of main broadcaster methods, devices and systems of augmented reality |
Cited By (16)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN109859327A (en) * | 2019-02-20 | 2019-06-07 | 中山市嘉游动漫科技有限公司 | A kind of virtual cartoon scene construction method and device with reality of combination |
| CN110225224A (en) * | 2019-07-05 | 2019-09-10 | 北京乐元素文化发展有限公司 | Director method, the apparatus and system of virtual image |
| CN110290291A (en) * | 2019-07-05 | 2019-09-27 | 北京乐元素文化发展有限公司 | Picture synthesis method and device and interactive approach |
| CN110300242A (en) * | 2019-07-05 | 2019-10-01 | 北京乐元素文化发展有限公司 | The performance system of virtual image |
| CN110691279A (en) * | 2019-08-13 | 2020-01-14 | 北京达佳互联信息技术有限公司 | Virtual live broadcast method and device, electronic equipment and storage medium |
| CN110689570A (en) * | 2019-09-29 | 2020-01-14 | 北京达佳互联信息技术有限公司 | Live virtual image broadcasting method and device, electronic equipment and storage medium |
| CN110719533A (en) * | 2019-10-18 | 2020-01-21 | 广州虎牙科技有限公司 | Live virtual image broadcasting method and device, server and storage medium |
| WO2021109764A1 (en) * | 2019-12-05 | 2021-06-10 | 中兴通讯股份有限公司 | Image or video generation method and apparatus, computing device and computer-readable medium |
| CN113365130A (en) * | 2020-03-03 | 2021-09-07 | 广州虎牙科技有限公司 | Live broadcast display method, live broadcast video acquisition method and related devices |
| CN111683260A (en) * | 2020-05-07 | 2020-09-18 | 广东康云科技有限公司 | Program video generation method, system and storage medium based on virtual anchor |
| CN111598983A (en) * | 2020-05-18 | 2020-08-28 | 北京乐元素文化发展有限公司 | Animation system, animation method, storage medium, and program product |
| CN112017264A (en) * | 2020-09-10 | 2020-12-01 | 网易（杭州）网络有限公司 | Display control method and device for virtual studio, storage medium and electronic equipment |
| CN112017264B (en) * | 2020-09-10 | 2023-09-26 | 网易（杭州）网络有限公司 | Display control method and device for virtual studio, storage medium and electronic equipment |
| CN113395540A (en) * | 2021-06-09 | 2021-09-14 | 广州博冠信息科技有限公司 | Virtual broadcasting system, virtual broadcasting implementation method, device and equipment, and medium |
| CN115619912A (en) * | 2022-10-27 | 2023-01-17 | 深圳市诸葛瓜科技有限公司 | Cartoon character display system and method based on virtual reality technology |
| CN115866354A (en) * | 2022-11-25 | 2023-03-28 | 广州美术学院 | Interactive virtual reality-based non-material heritage iconic deduction method and device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108200445B (en) | 2021-02-26 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN108200445A (en) | The virtual studio system and method for virtual image | |
| US20130215229A1 (en) | Real-time compositing of live recording-based and computer graphics-based media streams | |
| US8655152B2 (en) | Method and system of presenting foreign films in a native language | |
| US6084590A (en) | Media production with correlation of image stream and abstract objects in a three-dimensional virtual stage | |
| US8633933B2 (en) | System and method of producing an animated performance utilizing multiple cameras | |
| US9542975B2 (en) | Centralized database for 3-D and other information in videos | |
| KR101713772B1 (en) | Apparatus and method for pre-visualization image | |
| US20050001852A1 (en) | System and method for inserting content into an image sequence | |
| JP2014127987A (en) | Information processing apparatus and recording medium | |
| WO1998045813A9 (en) | Media production with correlation of image stream and abstract objects in a three-dimensional virtual stage | |
| CN207460313U (en) | Mixed reality studio system | |
| CN106648098B (en) | AR projection method and system for user-defined scene | |
| US20010043219A1 (en) | Integrating live/recorded sources into a three-dimensional environment for media productions | |
| EP4111677B1 (en) | Multi-source image data synchronization | |
| CN108305308A (en) | It performs under the line of virtual image system and method | |
| CN101563669A (en) | System and method for interactive visual effects compositing | |
| CN108961368A (en) | The method and system of real-time live broadcast variety show in three-dimensional animation environment | |
| KR20070099949A (en) | System for making 3d-continuty and method thereof | |
| JP2022510658A (en) | Systems and methods for determining virtual camera paths | |
| US10032447B1 (en) | System and method for manipulating audio data in view of corresponding visual data | |
| US20230033201A1 (en) | Image processing apparatus, image processing method, and storage medium | |
| Chanpum | Virtual production: Interactive and real-time technology for filmmakers | |
| JP2002271692A (en) | Image processing method, image processing unit, studio apparatus, studio system and program | |
| CN108574833A (en) | A kind of optical projection system, method, server and control interface | |
| WO2023285872A1 (en) | Smoothly changing a focus of a camera between multiple target objects |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |