CN108833741A - The virtual film studio system and method combined are caught with dynamic in real time for AR - Google Patents
The virtual film studio system and method combined are caught with dynamic in real time for AR Download PDFInfo
- Publication number
- CN108833741A CN108833741A CN201810640691.XA CN201810640691A CN108833741A CN 108833741 A CN108833741 A CN 108833741A CN 201810640691 A CN201810640691 A CN 201810640691A CN 108833741 A CN108833741 A CN 108833741A
- Authority
- CN
- China
- Prior art keywords
- dynamic
- performer
- catch
- real time
- film studio
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/2224—Studio circuitry; Studio devices; Studio equipment related to virtual studio applications
Abstract
The virtual film studio system combined is caught with dynamic in real time for AR the present invention relates to a kind of comprising the dynamic device for catching between the dynamic police station in fixed-site and with performer.Wherein include between above-mentioned dynamic police station：3 D-printing shell；Connect the trunk bracket of 3 D-printing shell；It is arranged on the wall of 3 D-printing shell or the one or more that is supported by bracket is dynamic catches camera；And for receiving motion capture data and carrying out the graphics workstation mould group of calculation process.The invention further relates to above-mentioned for AR with the dynamic method for catching the virtual film studio system combined in real time.The beneficial effects of the invention are as follows：By using augmented reality, more true virtual scene is built in film studio, acquisition, which allows, to be in performer in film studio and can also face the technical effect shot in real scene such as body.
Description
Technical field
The present invention relates to augmented reality (Augmented Reality, referred to as AR) technologies.Particularly, the present invention relates to
The virtual film studio system and method combined are caught with dynamic in real time for AR to a kind of.
Background technique
For the reason of the manufacturing cycle, cost and risk control, many movie TV programs all use later period video at present
The mode of synthetic technology assists making certain camera lenses for being difficult to shoot, such as several roles' driving vehicles are mutual on a highway
It carries out chasing the high risk camera lens fought.In addition, the film and television works of some magic subject matters also had to using the above-mentioned later period
The mode of Video Composition technology allows performer to show some performance movements for violating physical law or create and such as alarms mountain
The illusory scene of magnificence in high mountain.
However, when shooting movie TV programs in this way, performer be typically all be in only with green curtain or
In the film studio that blue curtain is arranged.At this point, performer is only capable of relying on simple label or the drama in some film studios to field
Scape is briefly described to be performed, and body is avoided to encounter the barrier in virtual scene simultaneously.On the one hand due to performer without
Method is on the spot in person, this energy for needing the cost of performer additional understands current photographed scene；On the other hand since performer can not
It is interacted with the element in the virtual scene that is not present in film studio, to limit the performance of performer.
Summary of the invention
The present invention provide it is a kind of catch the virtual film studio system and method combined with dynamic in real time for AR, by using
Augmented reality, builds more true virtual scene in film studio, acquisition allow be in film studio performer also can be as
Body faces the technical effect shot in real scene.
To achieve the goals above, disclosed herein is following technical schemes.
The first aspect of the present invention is a kind of to catch the virtual film studio system combined with dynamic in real time for AR.Above system
Including the dynamic device for catching between the dynamic police station in fixed-site and with performer.Wherein include between above-mentioned dynamic police station：Three
Dimension printing shell；Connect the trunk bracket of 3 D-printing shell；It is arranged on the wall of 3 D-printing shell or passes through bracket
The one or more of support is dynamic to catch camera；And for receiving motion capture data and carrying out the graphics workstation of calculation process
Mould group.
It further, further include that 3 D-printing shell is set between above-mentioned dynamic police station in above system of the invention
Wall or the one or more lighting systems supported by bracket.
Further, in above system of the invention, above-mentioned dynamic device for catching includes being worn on the AR on performer head dynamic to catch
The display helmet is caught with face.The display helmet includes：Wireless audio headset；Wireless video signal transmission module；It is watched for performer
The wireless picture module of virtual scene；For shooting the helmet camera of performer's frontal scene；And it is arranged in performer face
The human facial expression recognition sensor of side.
Further, in above system of the invention, above-mentioned dynamic device for catching includes that the movement being worn on performer is caught
Catch clothes.Wherein, motion capture clothes are moved equipped with joint catches module, for capturing and identifying the limb action of performer.
Still further, motion capture clothes are equipped with wireless data transfer module and just in above system of the invention
Take supplying cell.
Further, in above system of the invention, three-dimensional real-time game engine program；Three-dimensional move in real time catches software journey
Sequence；The program of the three-dimensional numerical digit model of hardware specification data correlation between dynamic police station；For recording the sheet of of three-dimensional animation
Capture program.
The second aspect of the present invention be it is a kind of for AR with the method for catching the virtual film studio system combined dynamic in real time.On
The method of stating includes the following steps：A, according to shooting needs, the hardware between moving police station is created or adjusted in a manner of 3 D-printing, it should
Hardware includes 3 D-printing shell and trunk bracket；B, dynamic catch of AR that one or more performer's collocation use is provided and catches display with face
The helmet and motion capture clothes；C, the real time 3-D image in the game engine in graphics workstation is transmitted to the wear-type into performer
Dynamic catch of AR catches the display helmet with face；D, it has dressed dynamic catch of AR to middle between dynamic police station and catches the display helmet with face and what motion capture took drills
Member carries out recording three-dimensional animation or video.
Further, when executing the step C of the above method, the three dimensional angular in three-dimensional animation is made in graphics workstation
Color and three-dimensional scenic, and it is imported into d engine, and three-dimensional character is matched with the movement picture of performer, then data reality is caught by dynamic
When be output to graphics workstation, while the wear-type AR of final picture transmission to performer's head-mount being shown in dynamic police officer's helmet,
Make performer it can be seen that and hearing final picture effect.
Further, when executing the step D of the above method, it is dynamic catch performer wear the helmet between dynamic police station according to drama
When carrying out motion capture performance, allow by helmet camera and/or it is dynamic catch camera observe in real time with oneself subjective point of view and
The picture effect of final viewpoint, to adjust oneself performance.
Beneficial effects of the present invention are：By allowing the performer of movie TV programs to perform in the scene of extension reality,
So that performer can obtain being in film studio such as performance effect on the spot in person.
Detailed description of the invention
Fig. 1 show the AR according to the present invention that is used for the dynamic schematic diagram for catching the virtual film studio system combined in real time.
Fig. 2 show detailed schematic according to an embodiment of the invention.
Fig. 3 show detailed schematic according to another embodiment of the present invention.
Fig. 4 show flow chart according to the method for the present invention.
Fig. 5 is shown in one embodiment according to the method for the present invention, by the reality in the game engine in graphics workstation
When 3-D image be transferred to the dynamic wear-type AR for catching performer show dynamic police officer's helmet to realize reality performer and three-dimensional role
Interaction process.
Specific embodiment
It is carried out below with reference to technical effect of the embodiment and attached drawing to design of the invention, specific structure and generation clear
Chu, complete description, to be completely understood by the purpose of the present invention, scheme and effect.It should be noted that the case where not conflicting
Under, the features in the embodiments and the embodiments of the present application can be combined with each other.
It should be noted that unless otherwise specified, when a certain feature referred to as " fixation ", " connection " are in another feature,
It can directly fix, be connected to another feature, and can also fix, be connected to another feature indirectly.In addition, this
The descriptions such as upper and lower, left and right used in invention are only the mutual alignment pass relative to each component part of the present invention in attached drawing
For system.In the present invention and the "an" of singular used in the attached claims, " described " and "the" also purport
It is including most forms, unless the context clearly indicates other meaning.
In addition, unless otherwise defined, the technology of all technical and scientific terms used herein and the art
The normally understood meaning of personnel is identical.Term used in the description is intended merely to description specific embodiment herein, without
It is to limit the present invention.Term as used herein "and/or" includes the arbitrary of one or more relevant listed items
Combination.
It will be appreciated that though various elements, but this may be described using term first, second, third, etc. in the disclosure
A little elements should not necessarily be limited by these terms.These terms are only used to for same type of element being distinguished from each other out.For example, not departing from
In the case where disclosure range, first element can also be referred to as second element, and similarly, second element can also be referred to as
One element.Depending on context, word as used in this " if " can be construed to " ... when " or " when ...
When ".
Referring to Fig.1, according to the present invention to catch the virtual film studio system combined with dynamic in real time for AR, including be located at solid
10 and the dynamic device for catching with performer are determined between the dynamic police station in place, wherein 10 including between the dynamic police station：3 D-printing
Shell 11；Connect the trunk bracket 12 of 3 D-printing shell 11；It is arranged on the wall of 3 D-printing shell 11 or passes through branch
The one or more of frame support is dynamic to catch camera 13；And for receiving motion capture data and carrying out the figure work of calculation process
Make station mould group 15.10 further include the wall of 3 D-printing shell 11 is arranged in or is supported by bracket one between the dynamic police station
A or multiple lighting systems 14.
Before actually building film studio system, need to make based on AR in three-dimensional animation with it is dynamic in real time catch combine it is virtual
The relevant design drawing in film studio, circuit circuit diagram, three-dimensional numerical digit model and related facility construction drawing.
Graphics workstation mould group 15 run application program include：Three-dimensional real-time game engine program；Three-dimensional move in real time is caught
Software program；The program of the three-dimensional numerical digit model of 10 hardware specification data correlation between dynamic police station；For recording three-dimensional animation
Sheet of capture program.
Referring to Fig. 2, the dynamic device for catching includes being worn on dynamic catch of AR on performer head to catch the display helmet 20 with face.Show head
Helmet includes：Wireless audio headset 21；Wireless video signal transmission module 22；The wireless picture mould of virtual scene is watched for performer
Block 23；For shooting the helmet camera 24 of performer's frontal scene；And the human facial expression recognition of performer's upper face is set
Sensor 25.
In some embodiments, it is contemplated that performer's is easy to wear, can be customized in such a way that three-dimensional is promised for performer
The wearing part of the helmet.
Referring to Fig. 3, the dynamic device for catching includes that the motion capture being worn on performer takes 30, and wherein motion capture takes 30
It is moved equipped with joint and catches module 31, for capturing and identifying the limb action of performer.Motion capture takes 30 and is equipped with wireless data biography
Defeated module 32 and portable supplying cell 33.
According to the above embodiments, the system according to the present invention executes method as shown in Figure 4, the party in operation
Method includes the following steps：
A, according to shooting needs, the hardware in 10 between moving police station is created or adjusted in a manner of 3 D-printing, which includes
3 D-printing shell 11 and trunk bracket 12；
B, the AR that the one or more performers' collocation of offer use, which moves to catch to catch with face, shows that the helmet 20 and motion capture take 30；
C, by the real time 3-D image in the game engine in graphics workstation transmit the wear-type AR into performer it is dynamic catch with
Catch the display helmet 20 in face；
D, dynamic catch of AR has been dressed in 10 between dynamic police station and has caught the performer for showing that the helmet 20 and motion capture take 30 with face, has been carried out
Record three-dimensional animation or video.
In step C, the three-dimensional character and three-dimensional scenic in three-dimensional animation are made in graphics workstation, and imported into three
Dimension engine, and three-dimensional character is matched with the movement picture of performer, it then dynamic will catch data and be output to graphics workstation in real time, simultaneously
The wear-type AR of final picture transmission to performer's head-mount is shown in dynamic police officer's helmet, makes performer it can be seen that and hearing final
Picture effect.
In step D, move catch performer wear the helmet 10 between dynamic police station in when carrying out motion capture performance according to drama, permit
Perhaps it is observed in real time by helmet camera 24 and/or dynamic camera 13 of catching with oneself subjective point of view and the picture of final viewpoint effect
Fruit, to adjust oneself performance.
Fig. 5 is shown in one embodiment according to the method for the present invention, by the reality in the game engine in graphics workstation
When 3-D image be transferred to the dynamic wear-type AR for catching performer show dynamic police officer's helmet to realize reality performer and three-dimensional role
Interaction process comprising：
S1, the three-dimensional character for making three-dimensional animation；
S2, the three-dimensional scenic for making three-dimensional animation；
S3, three-dimensional character and three-dimensional scenic are imported into game engine；
S4, three-dimensional character is caught performer and matched with dynamic；
S5, by three-dimensional scenic picture transmission into the dynamic AR helmet for catching performer；
S6, finally start sheet of shooting and performance work.
Further, this method process can be realized in being operably coupled to suitable any kind of computing platform,
Including but not limited to PC, mini-computer, main frame, work station, network or distributed computing environment, individual or collection
At computer platform or communicate with charged particle tool or other imaging devices etc..Each aspect of the present invention can be with
The machine readable code in non-transitory storage medium or equipment is stored in realize, no matter is moveable or is integrated to meter
Platform, such as hard disk, optical reading and/or write-in storage medium, RAM, ROM are calculated, so that it can be read by programmable calculator,
It can be used for configuration and operation computer when storage medium or equipment are read by computer to execute process described herein.This
Outside, machine readable code, or part thereof can be transmitted by wired or wireless network.
The above, only presently preferred embodiments of the present invention, the invention is not limited to above embodiment, as long as
It reaches technical effect of the invention with identical means, all any modifications within the spirit and principle of the disclosure, made,
Equivalent replacement, improvement etc. should be included within the scope of disclosure protection.It all should belong to protection scope of the present invention.At this
Its technical solution and/or embodiment can have a variety of different modifications and variations in the protection scope of invention.
Claims (9)
1. a kind of catch the virtual film studio system combined with dynamic in real time for AR, it is characterised in that including being located in fixed-site
Dynamic police station between (10) and the dynamic device for catching with performer, wherein (10) include between the dynamic police station：
3 D-printing shell (11)；
Connect the trunk bracket (12) of 3 D-printing shell (11)；
It is arranged on the wall of 3 D-printing shell (11) or the one or more that is supported by bracket is dynamic catches camera (13)；
And
For receiving motion capture data and carrying out the graphics workstation mould group (15) of calculation process.
2. according to claim 1 catch the virtual film studio system combined with dynamic in real time for AR, which is characterized in that institute
(10) further include setting in the wall of 3 D-printing shell (11) or the one or more supported by bracket between Shu Dong police station
Lighting system (14).
3. according to claim 1 catch the virtual film studio system combined with dynamic in real time for AR, which is characterized in that institute
Stating device for catching includes being worn on dynamic catch of AR on performer head to catch the display helmet (20) with face, which includes：
Wireless audio headset (21)；
Wireless video signal transmission module (22)；
The wireless picture module (23) of virtual scene is watched for performer；
For shooting the helmet camera (24) of performer's frontal scene；And
The human facial expression recognition sensor (25) of performer's upper face is set.
4. according to claim 1 or 3 catch the virtual film studio system combined with dynamic in real time for AR, feature exists
In the dynamic device for catching includes the motion capture clothes (30) being worn on performer, and wherein motion capture clothes (30) are equipped with joint
It is dynamic to catch module (31), for capturing and identifying the limb action of performer.
5. according to claim 4 catch the virtual film studio system combined with dynamic in real time for AR, which is characterized in that dynamic
Make to capture clothes (30) equipped with wireless data transfer module (32) and portable supplying cell (33).
6. according to claim 1 catch the virtual film studio system combined with dynamic in real time for AR, which is characterized in that figure
Shape work station mould group (15) includes：
Three-dimensional real-time game engine program；
Three-dimensional move in real time catches software program；
The program of the three-dimensional numerical digit model of the hardware specification data correlation of (10) between dynamic police station；
For recording the sheet of capture program of three-dimensional animation.
7. a kind of move the method for catching the virtual film studio system combined with real-time for AR, it is characterised in that including following step
Suddenly：
A, according to shooting needs, the hardware between moving police station in (10) is created or adjusted in a manner of 3 D-printing, which includes three
Dimension printing shell (11) and trunk bracket (12)；
B, dynamic catch of AR that one or more performer's collocation use is provided and catches the display helmet (20) and motion capture clothes (30) with face；
C, dynamic catch of wear-type AR for transmitting the real time 3-D image in the game engine in graphics workstation into performer is caught with face
It shows the helmet (20)；
D, the display helmet (20) is caught with face and motion capture takes the performer of (30) to having dressed dynamic catch of AR between dynamic police station in (10), into
Row records three-dimensional animation or video.
8. the method according to the description of claim 7 is characterized in that the step C further includes：
The three-dimensional character and three-dimensional scenic in three-dimensional animation are made in graphics workstation, and imported into d engine, and by three
It ties up role to match with the movement picture of performer, then dynamic will catch data and be output to graphics workstation in real time, while final picture being passed
The defeated wear-type AR to performer's head-mount is shown in dynamic police officer's helmet, makes performer it can be seen that and hearing final picture effect.
9. the method according to the description of claim 7 is characterized in that the step D further includes：
It is dynamic when catching performer and wearing the helmet and carry out motion capture performance according to drama in (10) between dynamic police station, allow to take the photograph by the helmet
As head (24) and/or dynamic camera (13) of catching are observed in real time with the picture effect of oneself subjective point of view and final viewpoint, to adjust
The performance of oneself.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810640691.XA CN108833741A (en) | 2018-06-21 | 2018-06-21 | The virtual film studio system and method combined are caught with dynamic in real time for AR |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810640691.XA CN108833741A (en) | 2018-06-21 | 2018-06-21 | The virtual film studio system and method combined are caught with dynamic in real time for AR |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN108833741A true CN108833741A (en) | 2018-11-16 |
Family
ID=64142860
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810640691.XA Pending CN108833741A (en) | 2018-06-21 | 2018-06-21 | The virtual film studio system and method combined are caught with dynamic in real time for AR |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108833741A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111192350A (en) * | 2019-12-19 | 2020-05-22 | 武汉西山艺创文化有限公司 | Motion capture system and method based on 5G communication VR helmet |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1728773A (en) * | 2004-07-29 | 2006-02-01 | 台湾梦工场科技股份有限公司 | Method and system for making media in virtual studio |
| CN1783947A (en) * | 2005-09-30 | 2006-06-07 | 王小明 | Programme automatic making system and method |
| JP2009212582A (en) * | 2008-02-29 | 2009-09-17 | Nippon Hoso Kyokai <Nhk> | Feedback system for virtual studio |
| CN107248195A (en) * | 2017-05-31 | 2017-10-13 | 珠海金山网络游戏科技有限公司 | A kind of main broadcaster methods, devices and systems of augmented reality |
| CN107250891A (en) * | 2015-02-13 | 2017-10-13 | Otoy公司 | Being in communication with each other between head mounted display and real-world objects |
| CN107358656A (en) * | 2017-06-16 | 2017-11-17 | 珠海金山网络游戏科技有限公司 | The AR processing systems and its processing method of a kind of 3d gaming |
| CN107845125A (en) * | 2017-10-23 | 2018-03-27 | 珠海金山网络游戏科技有限公司 | A kind of virtual video camera methods, devices and systems caught based on three-dimensional |
| CN108108026A (en) * | 2018-01-18 | 2018-06-01 | 珠海金山网络游戏科技有限公司 | A kind of VR virtual realities motion capture system and motion capture method |
-
2018
- 2018-06-21 CN CN201810640691.XA patent/CN108833741A/en active Pending
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1728773A (en) * | 2004-07-29 | 2006-02-01 | 台湾梦工场科技股份有限公司 | Method and system for making media in virtual studio |
| CN1783947A (en) * | 2005-09-30 | 2006-06-07 | 王小明 | Programme automatic making system and method |
| JP2009212582A (en) * | 2008-02-29 | 2009-09-17 | Nippon Hoso Kyokai <Nhk> | Feedback system for virtual studio |
| CN107250891A (en) * | 2015-02-13 | 2017-10-13 | Otoy公司 | Being in communication with each other between head mounted display and real-world objects |
| CN107248195A (en) * | 2017-05-31 | 2017-10-13 | 珠海金山网络游戏科技有限公司 | A kind of main broadcaster methods, devices and systems of augmented reality |
| CN107358656A (en) * | 2017-06-16 | 2017-11-17 | 珠海金山网络游戏科技有限公司 | The AR processing systems and its processing method of a kind of 3d gaming |
| CN107845125A (en) * | 2017-10-23 | 2018-03-27 | 珠海金山网络游戏科技有限公司 | A kind of virtual video camera methods, devices and systems caught based on three-dimensional |
| CN108108026A (en) * | 2018-01-18 | 2018-06-01 | 珠海金山网络游戏科技有限公司 | A kind of VR virtual realities motion capture system and motion capture method |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111192350A (en) * | 2019-12-19 | 2020-05-22 | 武汉西山艺创文化有限公司 | Motion capture system and method based on 5G communication VR helmet |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Matsuyama et al. | 3D video and its applications | |
| CN108986189A (en) | Method and system based on real time multi-human motion capture in three-dimensional animation and live streaming | |
| CN110602517B (en) | Live broadcast method, device and system based on virtual environment | |
| US20130215229A1 (en) | Real-time compositing of live recording-based and computer graphics-based media streams | |
| RU98105829A (en) | METHOD AND SYSTEM FOR CREATING VIDEO PROGRAMS | |
| CN109145788A (en) | Attitude data method for catching and system based on video | |
| CN108600729B (en) | Dynamic 3D model generation device and image generation method | |
| CN114638918B (en) | Real-time performance capturing virtual live broadcast and recording system | |
| TWM556170U (en) | VR terminal device | |
| CN109961039A (en) | A kind of individual's goal video method for catching and system | |
| CN109453517A (en) | Virtual role control method and device, storage medium, mobile terminal | |
| US20050277466A1 (en) | Method and system for creating event data and making same available to be served | |
| JP2020086983A (en) | Image processing device, image processing method, and program | |
| CN107592488A (en) | A kind of video data handling procedure and electronic equipment | |
| KR20150091064A (en) | Method and system for capturing a 3d image using single camera | |
| WO2022127747A1 (en) | Method and system for real social using virtual scene | |
| CN107908002A (en) | Enhancing and the device and method of mixed reality | |
| CN104883561A (en) | Three-dimensional panoramic display method and head-mounted display device | |
| CN102740029A (en) | Light emitting diode (LED) display module, LED television and LED television system | |
| CN108833741A (en) | The virtual film studio system and method combined are caught with dynamic in real time for AR | |
| KR102203109B1 (en) | Method and apparatus of processing image based on artificial neural network | |
| US20160127617A1 (en) | System for tracking the position of the shooting camera for shooting video films | |
| WO2019153783A1 (en) | Dynamic dance image capture and restoration system based on flexible sensor, and control method | |
| CN108416255B (en) | System and method for capturing real-time facial expression animation of character based on three-dimensional animation | |
| CN110113628A (en) | A kind of panorama live broadcast system under video-splicing server and moving condition |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20181116 |
|
| RJ01 | Rejection of invention patent application after publication |