WO2001067779A1 - An improved method and apparatus for enhanced puppetry or similar types of performances utilizing a virtual set - Google Patents
An improved method and apparatus for enhanced puppetry or similar types of performances utilizing a virtual set Download PDFInfo
- Publication number
- WO2001067779A1 WO2001067779A1 PCT/US2000/022612 US0022612W WO0167779A1 WO 2001067779 A1 WO2001067779 A1 WO 2001067779A1 US 0022612 W US0022612 W US 0022612W WO 0167779 A1 WO0167779 A1 WO 0167779A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- color
- puppet
- virtual
- puppeteers
- background
- Prior art date
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/64—Circuits for processing colour signals
- H04N9/74—Circuits for processing colour signals for obtaining special effects
- H04N9/75—Chroma key
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03B—APPARATUS OR ARRANGEMENTS FOR TAKING PHOTOGRAPHS OR FOR PROJECTING OR VIEWING THEM; APPARATUS OR ARRANGEMENTS EMPLOYING ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ACCESSORIES THEREFOR
- G03B15/00—Special procedures for taking photographs; Apparatus therefor
- G03B15/08—Trick photography
- G03B15/10—Trick photography using back-projection, i.e. blending artificial background with real foreground
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
- H04N5/272—Means for inserting a foreground image in a background image, i.e. inlay, outlay
Definitions
- This invention is directed to an innovation in puppetry performances using virtual sets, as well as similar types of performances where it is desirable to selectively combine real images with virtual images in real time
- Puppet shows have existed since antiquity in almost all countries of the world In most forms, the puppet is manipulated either directly by hand, or by rods, strings or wires Shadows of puppets are also sometimes used in a performance
- Bunraku puppetry requires teams of three to four puppeteers to stand behind each puppet and move the arms, legs, mouth and body using rods and the puppeteer's hands
- the chief manipulator supports the puppet by inserting his or her left hand into the puppet body from behind, to move the puppet's head and mouth. His or her right hand controls the puppet's right hand
- the assistants respectively take charge of the puppet's feet and left hand Since three or four people handle the different parts of the puppet, lifelike motion cannot be achieved without precision timing among the manipulators For all motions there are detailed rules and forms to be followed No manipulator is allowed to act on their own
- the key-color process is generally an iterative process in which the end product, or combined file or video is composited or "married in post" and is not viewable for evaluation until the entire process has been completed.
- film producers frequently view the end product and require changes to either the foreground or background portions, requiring that the entire sequence be "reshot "
- the process is post rendered in real-time, it is difficult to perform actual interaction between a moving puppet, for example, and the puppet's environment
- the normal cycle for "blue screen” film production can require several iterations of this process
- a puppet or other object to be filmed is placed on a set in front of a key-color background screen Additional objects may also be present on the set such as puppeteers to manipulate the puppet or additional supporting objects Prior to commencement of live action filming, all objects on the set, except the puppet or other objects to be seen in the final film product, are covered with material matching the color of the key-color background screen
- a computer generated virtual background is then produced which is combined with the live action filming It is a feature of the invention that when the live action is combined with the virtual background, all objects covered with the key-color material disappear from the final viewed product
- FIG 1 illustrates a front view of the virtual set of the instant invention
- FIG 2 illustrates a block diagram of the various components utilized to create film and/or video in accordance with the instant invention
- FIG 3 illustrates a rear view of the virtual set of the instant invention DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
- FIG 1 there is shown a virtual set in accordance with one embodiment of the invention directed to puppetry
- Puppet 103 is the type of advanced puppet described above, which takes a minimum of 3 puppeteers/manipulators, 100, 101 and 102 to operate the puppet in a life-like manner
- the puppet rests on table 104, and the background consists entirely of ke> -color background screen 105 Rods 106- 109, etc , are used by the puppeteers to control all movements of puppet 103
- the puppeteers wear head-to-foot highly reflective keyable color spandex suits, 1 10, 1 11 and 112
- the suits include a hood gloves foot coverings and a piece of gauze, or similar material, over the eyes
- the key-color of the material completely covering the puppeteers exactly matches the color of key-color screen 105
- table 104, rods 106-109, the studio floor, and all other objects in the set except puppet 103 will exactly match the color of key-color screen 105
- puppet 103 is designed and built with special care not to include colors in the body of the puppet that would match the key-color Special care is taken to insure that puppet 103 does not include the key-color in its coloring or shading
- Key-color screen 105 is typically in the shape of a hard cyclorama which is built and painted a reflective keyable color This color could be reflective green or blue or even a highly reflective gray
- a cyclorama is essentially a high wall that is curved at the base to eliminate any hard lines in the set that can cause shadows Ideally, when filming the action of puppet 103 the
- Table 104 is designed to be approximately thirty-six (36) inches high but of course can be in various shapes and forms and multiple tables can be used All tables to be used on the set can be adjusted for height and size, and would be painted the same keyable color as screen 105 These tables are used by the puppeteers to simulate where the ground would be in the virtual set This gives the puppets, when they walk within the virtual set something real to step on so the action of walking is believable These tables can also have a light source within the table to create a glow from below in order to further eliminate shadows where the characters touch the table surface
- the lighting strategies are very important to the success of the inventive technique Successfully marrying two images in real time — the live puppets and a virtual background — without shadows or key-color problems, is the measure of success for the technical process Suffused lighting that creates an overall lack of shadows is the base of the lighting techniques
- FIG 2 there is illustrated the manner in which a shot is actually taken of the set shown in FIG 1
- Set 200 is the same set as shown in FIG 1
- a shot of the performance on the set is taken with digital camera 204, and the digital output of camera 204 is sent to video compositor 202
- video compositor 202 It is, of course, understood that a standard film or video camera could be used in place of a digital camera, with the performance being digitized in a well-known mannei
- This video compositor can be, for example, an Ultimate device The Ultimate technique has been used in video compositing for 20 years, is well known in the art, and will not be described in further detail herein
- the virtual background to be combined with the actual performance taken bv digital camera 204 is generated by virtual background generator 201
- Virtual backgrounds can be designed within a computer in any variety of virtual software programs L-set and Maya are two examples, but this software is always changing and being innovated What is key, is that the virtual system is a real time system that streams the set in real time so that the studio video switching system can composite both the live puppet image with the computerized virtual sets simultaneously Typically, an Onyx (a high capacity, very fast computer) is used for this purpose, but there are several real time virtual composite systems on the market, all with different degrees of ease of use
- the studio itself, to be used with the invention, as far as control room equipment is concerned, can be conventional, requiring tape machines, switchers and all the usual elements although maximized for good kev-color technique
- digital monitor 203 After the outputs of digital camera 204, and virtual background generator 201 are combined in video compositor 202, the combined output is sent to digital monitoi 203
- digital monitor 203 what is shown on digital monitor 203 is only the movements of puppet 103 superimposed on the virtual background generated by virtual background generator 201
- the puppeteers, which were controlling the puppet on the actual set, shown in FIG 1, are completely eliminated from the final product, and only the puppet and the virtual background are visible
- FIG 3 illustrates a rear view of the set in FIG 1 showing what the puppeteers see while manipulating puppet 103
- the puppeteers can readily watch the finished product on monitor 203, while the action is taking place
- the puppeteers can see the composited final image on the monitor in real time Therefore, the puppeteers have the complete ability to interact with their environment, any virtual and real objects in that environment and each other
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Studio Circuits (AREA)
- Processing Or Creating Images (AREA)
- Processing Of Color Television Signals (AREA)
- Studio Devices (AREA)
Abstract
Description
Claims
Priority Applications (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP00955655A EP1228647A4 (en) | 2000-03-08 | 2000-08-17 | An improved method and apparatus for enhanced puppetry or similar types of performances utilizing a virtual set |
CA002373640A CA2373640A1 (en) | 2000-03-08 | 2000-08-17 | An improved method and apparatus for enhanced puppetry or similar types of performances utilizing a virtual set |
JP2001565672A JP2003526293A (en) | 2000-03-08 | 2000-08-17 | Improved methods and apparatus for advanced puppetry and similar types of performance using virtual sets |
AU2000267822A AU2000267822A1 (en) | 2000-03-08 | 2000-08-17 | An improved method and apparatus for enhanced puppetry or similar types of performances utilizing a virtual set |
Applications Claiming Priority (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US18781400P | 2000-03-08 | 2000-03-08 | |
US60/187,814 | 2000-03-08 | ||
US53752900A | 2000-03-29 | 2000-03-29 | |
US09/537,529 | 2000-03-29 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2001067779A1 true WO2001067779A1 (en) | 2001-09-13 |
Family
ID=26883425
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/US2000/022612 WO2001067779A1 (en) | 2000-03-08 | 2000-08-17 | An improved method and apparatus for enhanced puppetry or similar types of performances utilizing a virtual set |
Country Status (5)
Country | Link |
---|---|
EP (1) | EP1228647A4 (en) |
JP (1) | JP2003526293A (en) |
AU (1) | AU2000267822A1 (en) |
CA (1) | CA2373640A1 (en) |
WO (1) | WO2001067779A1 (en) |
Families Citing this family (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8098330B2 (en) * | 2006-07-28 | 2012-01-17 | International Business Machines Corporation | Mapping of presentation material |
Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5151793A (en) * | 1990-02-26 | 1992-09-29 | Pioneer Electronic Corporation | Recording medium playing apparatus |
US5519826A (en) * | 1994-04-29 | 1996-05-21 | Atari Games Corporation | Stop motion animation system |
US5790124A (en) * | 1995-11-20 | 1998-08-04 | Silicon Graphics, Inc. | System and method for allowing a performer to control and interact with an on-stage display device |
US5923400A (en) * | 1994-03-28 | 1999-07-13 | Spector; Donald | Real-time film animation technique |
US5949433A (en) * | 1996-04-11 | 1999-09-07 | Discreet Logic, Inc. | Processing image data |
US6034740A (en) * | 1995-10-30 | 2000-03-07 | Kabushiki Kaisha Photron | Keying system and composite image producing method |
US6101289A (en) * | 1997-10-15 | 2000-08-08 | Electric Planet, Inc. | Method and apparatus for unencumbered capture of an object |
Family Cites Families (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH08212379A (en) * | 1995-02-01 | 1996-08-20 | Fujitsu Ltd | Image compositing device |
-
2000
- 2000-08-17 JP JP2001565672A patent/JP2003526293A/en active Pending
- 2000-08-17 CA CA002373640A patent/CA2373640A1/en not_active Abandoned
- 2000-08-17 WO PCT/US2000/022612 patent/WO2001067779A1/en not_active Application Discontinuation
- 2000-08-17 AU AU2000267822A patent/AU2000267822A1/en not_active Abandoned
- 2000-08-17 EP EP00955655A patent/EP1228647A4/en not_active Withdrawn
Patent Citations (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5151793A (en) * | 1990-02-26 | 1992-09-29 | Pioneer Electronic Corporation | Recording medium playing apparatus |
US5923400A (en) * | 1994-03-28 | 1999-07-13 | Spector; Donald | Real-time film animation technique |
US5519826A (en) * | 1994-04-29 | 1996-05-21 | Atari Games Corporation | Stop motion animation system |
US6034740A (en) * | 1995-10-30 | 2000-03-07 | Kabushiki Kaisha Photron | Keying system and composite image producing method |
US5790124A (en) * | 1995-11-20 | 1998-08-04 | Silicon Graphics, Inc. | System and method for allowing a performer to control and interact with an on-stage display device |
US5949433A (en) * | 1996-04-11 | 1999-09-07 | Discreet Logic, Inc. | Processing image data |
US6101289A (en) * | 1997-10-15 | 2000-08-08 | Electric Planet, Inc. | Method and apparatus for unencumbered capture of an object |
Non-Patent Citations (1)
Title |
---|
See also references of EP1228647A4 * |
Also Published As
Publication number | Publication date |
---|---|
CA2373640A1 (en) | 2001-09-13 |
EP1228647A1 (en) | 2002-08-07 |
AU2000267822A1 (en) | 2001-09-17 |
EP1228647A4 (en) | 2006-05-03 |
JP2003526293A (en) | 2003-09-02 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US7209181B2 (en) | System and method for compositing of two or more real images in a cinematographic puppetry production | |
US6624853B1 (en) | Method and system for creating video programs with interaction of an actor with objects of a virtual space and the objects to one another | |
CN107231531A (en) | A kind of networks VR technology and real scene shooting combination production of film and TV system | |
US5420622A (en) | Stop frame animation system using reference drawings to position an object by superimposition of TV displays | |
US6870574B2 (en) | Method and apparatus for enhanced puppetry or similar types of performances utilizing a virtual set | |
US11231745B1 (en) | Wearable article with conduits for a performance capture system | |
US20010024533A1 (en) | System & method for compositing of real and virtual images in a cinematographic puppetry production | |
US3070920A (en) | Puppet like figure and animation apparatus | |
US3899848A (en) | Animated cartoon character and method | |
US20200371420A1 (en) | Entertainment presentation systems and method | |
WO2001067779A1 (en) | An improved method and apparatus for enhanced puppetry or similar types of performances utilizing a virtual set | |
Husinsky et al. | Virtual stage: Interactive puppeteering in mixed reality | |
US5923400A (en) | Real-time film animation technique | |
WO2020110432A1 (en) | Learning device, foreground region deduction device, learning method, foreground region deduction method, and program | |
Gibbs et al. | Interaction in the virtual studio | |
Zhang et al. | Research on the Application of xR Extended Reality Shooting Technology in the Experimental Drama" Pipa Xing" | |
Gomide | Motion capture and performance | |
JP2024014517A (en) | Information processing system, information processing method, and computer program | |
Feifei | Picture Analysis of Picture Composition in TV Camera | |
Jacquemin et al. | Alice on both sides of the looking glass: Performance, installations, and the real/virtual continuity | |
Gu | A Study on the 3D Contents Production Technology of Taepyungmu | |
Moosajee et al. | Joji-777: Animated Multi-Character Paintings with a Single Performer: A novel approach to realtime motion capture and choreography | |
Yuan et al. | Study on the Application of CG Technology to the Creation of Short Film Works: Centered around the original works Soul painting | |
Wucher | Rebellions Are Built on Realism | |
Collins | The reality of virtual TV studios |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AK | Designated states |
Kind code of ref document: A1 Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BY BZ CA CH CN CR CU CZ DE DK DM DZ EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NO NZ PL PT RO RU SD SE SG SI SK SL TJ TM TR TT TZ UA UG UZ VN YU ZA ZW |
|
AL | Designated countries for regional patents |
Kind code of ref document: A1 Designated state(s): GH GM KE LS MW MZ SD SL SZ TZ UG ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE BF BJ CF CG CI CM GA GN GW ML MR NE SN TD TG |
|
121 | Ep: the epo has been informed by wipo that ep was designated in this application | ||
ENP | Entry into the national phase |
Ref document number: 2373640 Country of ref document: CA Ref country code: CA Ref document number: 2373640 Kind code of ref document: A Format of ref document f/p: F |
|
ENP | Entry into the national phase |
Ref country code: JP Ref document number: 2001 565672 Kind code of ref document: A Format of ref document f/p: F |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2000955655 Country of ref document: EP |
|
WWP | Wipo information: published in national office |
Ref document number: 2000955655 Country of ref document: EP |
|
REG | Reference to national code |
Ref country code: DE Ref legal event code: 8642 |
|
WWW | Wipo information: withdrawn in national office |
Ref document number: 2000955655 Country of ref document: EP |