WO2001020902A1

WO2001020902A1 - Method and system for producing animation

Info

Publication number: WO2001020902A1
Application number: PCT/US2000/025370
Authority: WO
Inventors: David J. Hernandez
Original assignee: Dav Dez Arts, Inc.
Priority date: 1999-09-15
Filing date: 2000-09-15
Publication date: 2001-03-22
Also published as: AU7491900A

Abstract

A method of producing animation for a motion picture is provided. The method includes the steps of: recording behavior of an entity, producing at least one two-dimensional image based on the recorded behavior, tracing a plurality of two-dimensional images produced, and compiling a sufficient number of traced two-dimensional images to create an animated likeness of the entity. The likeness may be merged with a motion picture. The method may include the step of rendering a virtual three-dimensional background setting. The background setting may comprise a chromo-key environment. A step of displaying the motion picture may also be included. It is contemplated that the method may include the step of editing the traced two-dimensional images. A step of incorporating additional effects with the animated version is also envisioned. A system for producing animation for a motion picture is also disclosed. The system includes means for recording behavior of an entity, means for producing at least one two-dimensional image based on the recorded behavior, means for digitally tracing a plurality of two-dimensional images produced, and means for compiling a sufficient number of traced two-dimensional images to create an animated likeness of the entity.

Description

METHOD AND SYSTEM FOR PRODUCING ANIMATION

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present invention relates generally, to character animation and, more particularly, to animated versions of live entities that are merged with an animated motion picture.

2. Description of the Related Art

Traditionally, character animation of a live entity is created by drawing either hard line or, more recently, computer generated images of a live actor which are compiled to create an animated character. Several drawings are used to produce action of the animated character. See, e.g., U.S. Patent Nos. 2,998,313 and 3,510,210. Three dimensional sets and props are typically created by hard line or computer generation for the animated characters to move within and utilize.

Animated drawings of a live actor for an animated motion picture are normally produced by preparing a plurality of individual drawings which are successively recorded by a movie camera to create the illusion of movement or change in position when projected. See, e.g., U.S. Patent No. 3,731,995. A high degree of care must be exercised in each individual drawing so that the successive motion picture frames match the preceding and following frames avoiding any vibration or discontinuity in projection of the animation. Further, the animated frames must satisfy a reasonable degree of realism. For example, it may take as many as 14,000 individual drawings to produce a 10-minute animated sequence. As a result, the production of these drawings is very expensive and time consuming and thus the production of the animated motion picture is correspondingly, expensive and time consuming.

Attempts have been made to overcome the disadvantages of the prior art. The photographic processes of motion pictures have been used to take a motion picture

sequence of a live actor going through a sequence of desired movements to provide the artist with a guide for the positioning of his animated characters within a given animated frame or eel (a eel is a transparent sheet of cellulose acetate or one frame of animation in digital or hard copy). This approach leaves to the artist the expensive and time consuming job of actually drawing out the animated character for each frame of the motion picture.

Further attempts have been made to reduce the shortcomings of the above discussed technology by providing a description to a computer of the characteristics of characters to be created within the computer. U.S. Patent No. 3,510,210 discloses a digital point assignment program for animation by providing a description to a computer of the characters to be reproduced. A computer processor stores reference points indicative of an actor's motions which are used to create an animated character. U.S. Patent No. 5,696,892 to Redman et al. discloses a method for computer generating a three dimensional animated likeness of an actor into a virtual reality environment from stored data. This process creates and renders a three dimensional space that must exist prior to the generation of the animated characters. The above discussed animation technology disadvantageous^ continues to require multiple distinct images to be hardline drawn, or computer generated for animation of a character. It would be desirable to produce animated versions of live entities without the use of costly and time consuming animation production techniques. It is, therefore, an object of the present invention to provide a method of producing animation in the production of animated motion pictures which is cost effective and efficient.

It is a further object of this invention to provide a method for producing animation with a more precise rendering of a live actor's performance. Objects and advantages of the invention are set forth in part herein and in part will be obvious herefrom, or may be learned by practice with the invention, the same being realized and attained by means of the instrumentalities and combinations pointed out in the appended claims.

SUMMARY

Accordingly, the disclosed method and system of the present invention provides a unique form of animation; The result is a cost effective photo-realistic motion

picture including three dimensional animated versions of real actors and entities compiled from eel animation. In one particular embodiment, the process begins by filming, taping, direct digital capture or any other method of taking real action pictures of actors performing. The performances are then rendered or transferred into a computer. A computer operator

traces the actor frame by frame capturing each detail of the actor's appearance, movements, facial expressions, and actions. This creates a three dimensional animated version of the actor including all the above detail without an animator creating a single picture. The actions and detail are real live action in detail, only animated.

Artists and animators then create computer generated three dimensional sets and props that the animated actors will move through and use. The animated actors and the sets are digitally merged to create a seamless three dimensional animated film. Final editing and sound is added and the completed movie can now be output to virtually any media.

In accordance with the present disclosure, the subject character is produced as the subject character, only digitally animated. The animation comes from tracing the actual live actor. The actor in each frame and the position of his body is reflected by his exact body movements and not a drawing of how an animator believes the actor should appear. The animation action exactly duplicates real action. The present invention permits real actors to be animated and act in ammated films with total accuracy.

In another embodiment, a method of producing animation for a motion picture is disclosed. The method including the steps of recording behavior of an entity; producing at least one two-dimensional image based on the recorded behavior, tracing a plurality of two-dimensional images produced, and compiling a sufficient number of traced two-dimensional images to create an animated likeness of the entity. The step of recording behavior may be done by video taping. In addition, a step of providing a blank screen environment may be performed wherein the behavior takes place in a blank screen environment. The behavior may take place in a blue screen environment. The likeness can be a virtual three-dimensional image. The method may further include the step of merging the likeness with a motion picture. The method may include the step of rendering a virtual three-dimensional background setting. The background setting may be carried out in a chromo-key environment.

The method may further comprise the step of displaying the motion picture. A step of editing the traced two-dimensional images may be incorporated with the method. The method may also include the step of incorporating additional effects with the animated version.

In another alternate embodiment, a method of producing animation for a motion picture is disclosed comprising the steps of: cold capturing an entity onto a recordable medium, digitally transforming the medium into at least one two-dimensional image, tracing a plurality of the two-dimensional images, compiling a sufficient number of traced two-dimensional images to create an animated version of the entity, and digitally merging the animated version with the motion picture.

In yet another alternate embodiment, a method for digitally producing animation for an animated motion picture is disclosed comprising the steps of: video recording a performance of a three-dimensional entity onto a recordable medium, digitally producing at least one two-dimensional eel from the recorded performance, tracing a plurality of two-dimensional eels, compiling a sufficient number of traced eels to create a virtual three-dimensional animated likeness, digitally creating a virtual three- dimensional motion picture setting for the animated motion picture, digitally merging the virtual three-dimensional animated likeness and the virtual three-dimensional motion picture setting with the animated motion picture, and displaying the animated motion picture.

In one particular embodiment, a system for producing animation for a motion picture is disclosed in accordance with the current disclosure. The system includes means for recording behavior of an entity, means for producing at least one two- dimensional image based on the recorded behavior, means for digitally tracing a plurality of two-dimensional images produced, and means for compiling a sufficient number of traced two-dimensional images to create an animated likeness of the entity.

The means for recording may include a video cam recorder interfacing with the means for producing at least one two-dimensional image. The means for compiling the sufficient number of traced two-dimensional images to create an animated likeness may include a digital processor. The system may further include a video display interfacing with the processor for displaying the animated likeness.

BRIEF DESCRIPTION OF THE DRAWINGS The accompanying drawings, referred to herein and constituting a part hereof, illustrate the various embodiments of the method and system of the present invention, and, together with the description, serve to explain the principles of the

invention.

FIG. 1 is a block diagram of one embodiment of the system and method in

accordance with the present invention; FIG. 2 illustrates a cold capturing of a performance of a live actor or other physical entity on a video recording media in accordance with the disclosed system and method;

FIG. 3 is a block diagram representation of a digiprint step of the system and method; FIG. 4 is a block diagram representation of a track and trace step of the system and method; and

FIG. 5 is a block diagram representation of a key edit step of the system and method.

DETAILED DESCRIPTION OF THE EXEMPLARY EMBODIMENTS

The present invention is described below in the context of animated motion pictures, including animated photo-realistic movies compiled from eel animation and displaying three-dimensional animated versions of live actors. Other live or real world entities may be depicted in the animated movies such as, for example, animals, nature, etc. Animated versions of inanimate objects are also contemplated such as, for example, automobiles, toys, etc. It is envisioned that the animated versions, in accordance with this disclosure, may be used with other forms of media, such as, for example, video games, video commercials, etc. The disclosed invention produces a photo-realistic motion picture including three dimensional animated versions of real actors and entities compiled from eel animation. Referring now to the drawings in detail, and initially to FIG. 1, a method and system of producing animation for a motion picture, designated generally by the numeral 10, in accordance with the present invention is shown. Pre-production procedures may be incorporated with the disclosed method and system. These pre- production steps (not shown) may include, for example, providing scripts to actors and artists detailing each scene of the motion picture to create storyboards, rehearsal, etc.

A block diagram illustrates system 10 for producing a three-dimensional animated version of a live actor. System 10 includes recording the behavior of an entity onto a recordable medium, such as, for example, the step represented by cold capture block 12. Cold capture block 12 includes capturing on film or video, media actors, animals, and any other moving objects that can be filmed or videotaped. It is

contemplated that the entity may be captured on video media in a non-moving or still

position.

Referring now to FIG. 2, during cold capture, an actor 14 is filmed or video taped before a camera 16. Camera 16 includes a sound microphone 18 for simultaneously capturing sound with video for use in synchronizing the animated texture of the actor with a reproduced voice or other sound generated by the actor. Actor 14 performs a scripted performance from which a real action video recording is captured on film, an analog or digital video cassette recorder/player 20.

Actor 14 may perform beneath, in front of, on top of, or any combination thereof, a solid color background set, as will be discussed in detail below. It is contemplated that the actor's performance may be filmed, taped, direct digital captured or any other method of taking real action pictures of actors performing. The actor's recorded behavior may alternatively be non-scripted or natural or may include animal behavior, such as, for example, a wild animal, domestic animal, etc., either indoors or outdoors. A multiple number of actors may perform; male, female, etc. Human and non-humans (dogs, horses, etc.) may also be included in a particular performance or behavior to be recorded, combinations thereof included. Furthermore, the actors are not required to occupy the same set during a performance. One actor can act out their performance in one set location and another actor in a different location. It is also contemplated. that one actor's performance take place on a set at one time and another actor's performance take place on that set at a different time. There are no tangible things or props required other than the solid color background.

Camera 16 may be of any suitable type for videotaping, such as, for example, a conventional S-VHS video cassette recorder/player. It is contemplated that sound may be recorded remote from the camera. Filming may also be performed from camera 16, as is known to one skilled in the art. Actor 14 performs the scripted performance in a location having a solid color background set, such as, for example, white room 22. There are no tangible things or props other than the solid color background. This type of background setting is sometimes referred to as a blank screen or a blue screen set. This conventional blank or blue screen background is used in ordinary video production to provide a background that can be changed in a video switching process, commonly referred to as chromo-keying. The process is often used in broadcast television, such as, for example, during news weather reports. Blank or blue screening may be used in conjunction with the current disclosure whereby actor 14 is filmed or photographed in front of a spectrally pure color

screen, such as white room 22, and is later silhouetted and composited into another filmed scene or photograph.

It is envisioned that multiple cameras may be used to record the same actor at different angles or multiple actors at multiple angles. This technique facilitates a more accurate capturing of the distinctive details of actor 14, such as, for example, appearance, movements, facial expressions, and actions, to provide a more precise animated version of actor 14. Actors may also perform with animals, inanimate objects or the like. All voices are recorded at this time while the actors perform. The actors perform for the camera as they would for actual film or television.

Referring back to FIG. 1, system 10 includes, producing at least one two- dimensional image based on the recorded behavior, such as, for example, the step represented by digiprint block 24 which includes the unedited film or video being digitally transformed into frame-by-frame still photos. It is contemplated that a film speed of 24 frames per second (24 FPS) is used, being the standard speed of live action and animated film or video. Other frame speeds are also envisioned.

Referring now to FIG. 3, the video recording captured on video recorder 20, discussed above, is transferred to a computer or processor 26. Processor 26 includes a digitizer card 28. After the video recording is transferred to processor 26, digitizer card 28 digitizes each frame 30 of the video recording. Digitizer card 28 digitizes each frame 30 to a suitable form for tracing, discussed below, such as, for example, by using imaging software that displays each frame from a computer screen (not shown). Digitizer card 28 transforms each frame 30 to a still photograph of the recorded behavior of the actor. The still photograph captures actor 14 in time providing facility for tracing the characteristics of the actor. The still photograph is displayed from a computer screen for tracing.

The still photograph may also be produced as a hard copy, such as, for example, paper products, transparencies, etc., for tracing. The traced hard copy can then be scanned onto a processor for compiling the traced features. It is envisioned that each digitized frame 30 may be displayed from a television screen, overhead projector, etc.

Digiprint can be performed using any digital hardware including hardware

and associated peripheral devices for display and interactivity such as, for example, those commercially distributed by Macintosh Corp. and International Business Machines, Corp. or equivalent PC devices. A variety of imaging software may be used, such as, for example, the software available under the trademarks ADOBE PHOTOSHOP, PHOTOSUITE, QVLINK, COREL DRAW, PHOTOPAINT, MGI PHOTO.

The solid color background set is deleted from each frame leaving the actor's image available for tracing of the characteristics. White-room 22, as shown in FIG. 2, may be deleted from each frame 30 leaving only the features of the actor's image.

Referring back to FIG. 1, system 10 includes tracing a plurality of two- dimensional images produced such as, for example, the step represented by track and trace block 32, which includes artists tracing and coloring over each frame 30 of actor 14's performance. Referring now to FIG. 4, each frame 30 displayed is transformed into a painted animated eel 34.

Digitizer 28, as discussed hereinabove, converts the video recording for display from a computer screen. A computer operator (not shown) traces each frame 30. The computer operator traces actor 14, frame by frame, as depicted on the computer screen displaying the video recording. The computer screen displays each frame or still photo of actor 14 captured in time.

The artist traces the features or characteristics of actor 14 in that particular frame 30 which forms an animated eel of the animated motion picture. Tracing frames 30, of actor 14, from the displayed still photo allows an animated eel 34 to be directly created therefrom, as will be discussed hereinbelow. Tracing advantageously avoids the need to store the features of the actor for later computer creation and generation of an animated character. The present disclosure provides tracing and the direct creation of animated eels from the recorded behavior of the actor.

The traced frames may be taken from a pre-recorded video or film recording. They may also be captured simultaneously as the performance occurs. The tracing of each frame 30 of actor 14 captures each detail of actor 14's appearance, movements, facial expressions and actions. As the still photo is displayed from the computer screen, an artist may trace the features of actor 14 using any of the number of commercially available peripheral components associated with the digital hardware. A computer pen (not shown) may be used to trace the features. It is contemplated that the features may be traced using a mouse, command cursor, or voice recognition, etc. This step can also be accomplished by using any of a number of computer paint programs

commercially distributed.

Each animated eel 34 is filled or colored in, according to the distinctive features of actor 14 recorded on the recordable medium. It is envisioned that commercially distributed computer software may be used to fill and paint the traced images, such as, for example, the software available under the trademarks PAINT SHOP and ADOBE. In an alternate embodiment, it is not required to trace each image produced. Commercially distributed software, such as those paint and fill programs discussed, can fill in missing frames. For example, if five frames are used to depict a character's animation, frame 1 and 2 are traced. Frames 3-5 can be filled in based on frames 1 and 2.

Referring back to FIG. 1, system 10 includes digitally creating a virtual three-dimensional motion picture setting, such as, for example, the step represented by digital atmosphere block 36 including artists creating and designing all of the backgrounds, vehicles and all other matter that will be seen in the finished work. These may include computer generated three dimensional sets and props that the animated versions of the actors will move through and use. This process can be traditional art, 2D digital art, 3D CGI (Computer Generated Imaging), or a live action film.

System 10 includes compiling a sufficient number of traced two- dimensional images to create an animated version of the entity, such as, for example, the step represented by key-edit block 38 which includes the frame-by-frame animation being edited, compiled and placed into a seamless string of digital animation. ADR (Automatic

Diagram Replacement), sound effects, and special digital effects are added at this time. This process can be achieved with any multimedia software such as, for example, the software available under the trademarks VIDEO SUITE, DIRECTOR, PREMIERE, FLASH, AFTER-EFFECTS. Referring now to FIG. 5, during key-edit 38, animated eels 34, produced during track and trace 32, are transformed into animated frames 40. Animated frames 40 are collectively compiled and merged into a seamless string of digital animation producing an animated version of actor 14's live performance. Animated frames 40 are directly formed from each traced still-photo that was displayed from the computer screen, discussed hereinabove. Advantageously, the system does not require a computer processor to perform complex operations for generating an animated image. The animated frames are traced versions of still photos compiled to form a seamless string of animation thereby producing an animated version of actor 14. Each animated frame 40 represents a still photo capturing the precise movement of an actor in time. A computer

does not fill in any part of actor 14's motion. Each part or feature is traced creating a

smooth animated version because every characteristic is captured.

Animated frames 40 are merged into the seamless string of animation by a compiler 42. Compiler 42 combines digital atmosphere 36 and special effects 44 with animated frames 40 to produce an unedited version of an animated motion picture 46. A variety of imaging software may be used such as, for example, the software available under the trademarks CINEMA4D, AFTER EFFECTS, SPEED RAZOR, AUTODESK,

BOARDMASTER, MGI VIDEO SUITE, IOTA, ANIMATO, PREMIERE, FUTURE SPLASH, FLASH.

Referring back to FIG. 1, system 10 includes editing the unedited version of animated motion picture 46, such as, for example, the step represented by live edit block 48 which includes the traditional editing process. Animated motion picture 46 is cut, clipped and set for time and story.

System 10 includes a step represented by a final product block 50 which includes producing a complete animated motion picture including the seamless string of animation, discussed above, with any background setting and additional effects included therewith. It is contemplated that final product 50 may be in any suitable form for viewing an animated film such as, for example, a VHS recording for home viewing, projection screen for commercial viewing, television, etc.

It will be understood that various modifications may be made to the embodiments disclosed herein. For example, the recorded behavior may include a portion thereof as hand drawn sketches to be incorporated with live recorded behavior. Moreover, the background scenes can include a virtual reality environment. Therefore, the above description should not be construed as limiting, but merely as exemplifications of various embodiments. Those skilled in the art will envision other modifications within the scope and spirit of the claims appended hereto.

Claims

WHAT IS CLAIMED IS:

1. A method of producing animation for a motion picture, the method comprising the steps of: recording behavior of an entity; producing at least one two-dimensional image based on the recorded behavior; tracing a plurality of two-dimensional images produced; and compiling a sufficient number of the traced two-dimensional images to create an animated likeness of the entity.

^• 2. A method of producing animation according to claim 1, wherein the step of recording behavior includes filming the behavior.

3. A method of producing animation according to claim 1, wherein the step of recording behavior includes video taping.

4. A method of producing animation according to claim 1, further comprising the step of providing a blank screen environment wherein the behavior takes place in said blank screen environment.

5. A method of producing animation according to claim 1, wherein the likeness is a virtual three-dimensional image.

6. A method of producing animation according to claim 1, further comprising the step of merging the likeness with a motion picture.

7. A method of producing animation according to claim 6, further

comprising the step of rendering a virtual three-dimensional background setting.

8. A method of producing animation according to claim 7, wherein the

background setting is carried out in a chromo-key environment.

9. A method of producing animation according to claim 8, further comprising the step of displaying the motion picture.

10. A method of producing animation according to claim 1, further comprising the step of editing said traced two-dimensional images.

11. A method of producing animation according to claim 1 , further comprising the step of incorporating additional effects with the animated version.

12. A method of producing animation for a motion picture, the method comprising the steps of: cold capturing an entity onto a recordable medium; digitally transforming the medium into at least one two-dimensional image, tracing a plurality of said two-dimensional images; compiling a sufficient number of traced two-dimensional images to create an animated version of the entity; and digitally merging the animated version with the motion picture.

13. A method of producing animation according to claim 12, further comprising the step of editing the traced two-dimensional images.

14. A method of producing animation according to claim 12, further comprising the step of incoφorating additional effects with the animated version.

15. A method for digitally producing animation for an animated motion picture, the method comprising the steps of: recording a performance of a three-dimensional entity onto a recordable

medium; digitally producing at least one two-dimensional eel from the recorded performance; tracing a plurality of the digitally produced two-dimensional eels; compiling a sufficient number of traced eels to create a virtual three- dimensional animated likeness; digitally creating a virtual three-dimensional motion picture setting for the animated motion picture; digitally merging the virtual three-dimensional animated likeness and the virtual three-dimensional motion picture setting with the animated motion picture, and displaying the animated motion picture

16. A system for producing animation for a motion picture comprising: means for recording behavior of an entity; means for producing at least one two-dimensional image based on the recorded behavior; means for digitally tracing a plurality of two-dimensional image produced; and means for compiling a sufficient number of traced two-dimensional images to create an animated likeness of the entity.

17. A system for producing animation according to claim 16, wherein the means for recording includes a video cam recorder interfacing with the means for producing at least one two-dimensional image.

18. A system for producing animation according to claim 16, wherein the means for compiling the sufficient number of traced two-dimensional images to create an animated likeness includes a digital processor.

19. A system for producing animation according to claim 18, further comprising a video display interfacing with the processor for displaying the animated likeness.