JP2007500395A - Improved paint projection and paint projection apparatus - Google Patents

Abstract

A method for a computer system includes, in a first form, a procedure for causing a 3D model (500) to pose, in a first form, a procedure for determining a first 2D (510) view of a 3D model, a second In form (550), a procedure that causes the 3D model to pose, in a second form, a process that determines a second 2D (570) view of the 3D model, a first 2D image, Depending on the treatment associated with the 2D view, the second 2D (570) image associated with the second 2D view of the 3D model, the first 2D image and the first form for the 3D model, the first Depending on the treatment that associates the set of surface parameters with the curved surface of the 3D model visible in the first 2D view, and the second 2D image and the second form for the 3D model, the second set of surfaces The Eisu parameters includes treatment associating the curved surface of the 3D model visible to the second 2D view.
[Selection] Figure 4

Description

  The present invention relates to computer animation. More specifically, the present invention relates to an improved method and apparatus for specifying the surface properties of an animation object.

  For years, filmmakers have often tried to tell stories about fictional creatures, dreamy places, and fantasy things. To do so, filmmakers have often used animation techniques to “animate” this fictional one. Two of the main policies in animation have traditionally been line-based animation techniques and stop-motion animation techniques.

  Animation methods based on line drawing were improved in the 20th century by filmmakers such as Walt Disney and used in movies such as “Snow White and the Seven Dwarfs” and “Fantasia” (1940). This animation technique generally required artists to hand-draw (or paint) an animated image on a transparent medium or cell. Next, after painting, each cell will be captured or recorded on film as one or more frames in the movie.

  Animation techniques based on stop motion generally required the construction of small sets, props and characters. These filmmakers will assemble these sets, add props, and place small characters in a pose. After the animator is satisfied with the way everything is done, one or more frames of the film will be taken for that particular arrangement. An animation technique based on stop motion was developed by filmmakers such as Willis O'Brien for movies such as “King Kong” (1932). Later, these techniques were improved by animation producers such as Ray Harryhausen for movies including “Mighty Joe Young” (1948) and “Clash Of The Titans” (1981).

  Around the end of the 20th century, when computers became widely available, animation creators began to rely on computers to help with animation processing. This included procedures that facilitated drawing-based animation using a computer, for example, by painting on an image or generating an intermediate image ("tweening"). This also included using a computer to augment the stop motion animation technique. For example, a physical model may be represented and manipulated by a virtual model in computer memory.

  One of the pioneering companies in the computer-aided animation (CAA) industry was Pixar, dba Pixar Animation Studios. Over the years, Pixar has developed and provided both a computing platform specifically designed for CAA and an Academy Award-winning rendering software known as RenderMan®.

  Over the years, Pixar has also developed software products and software environments for domestic use, making it easy for users (model producers, modelers) to define object rigs and for users (animation producers). ) Has made it easy to animate these objects rig. Based on such an actual experience, the inventor of the present invention determines that additional functions are given to the above software products and software environment in order to facilitate the definition and animation processing of objects. Yes. One such function is a method and apparatus that facilitates the definition of object surface properties.

  The inventors of the present invention have determined that an improved method for assigning surface parameters to an object is needed.

  The present invention relates to computer animation. More specifically, the present invention relates to a method and apparatus that allows a user to specify surface parameters of an object or portions of an object that are in different poses.

  Embodiments of the present invention are used to help manage the process of generating a three-dimensional “painting”. The implementation controls the definition of multiple poses, manages the rendering of views, provides a mechanism to send texture information to curved materials, cataloging and sources for textures and other data files・ Realize control.

  In an embodiment of the present invention, the user can paint “directly” on a three-dimensional object using virtually any conventional two-dimensional paint program. In one embodiment, the paint program utilizes “layers”. In some implementations, the user performs several two-dimensional paintings (eg, overlay images) on different views of the object. A typical view is a camera with orientations such as “front” and “back”. In an embodiment of the invention, if the object model is too difficult to paint completely with only one reference port, the user can cause the object model to pose again in multiple forms. it can. In addition, the user can also paint on several overlay images of this re-posed object view.

  A typical workflow of an embodiment of the present invention includes loading an object model into the system and causing the object model to pose differently. For example, to paint on a table, the user can “explode” the model by moving the table leg in one pose that defines the table and moving away from the bottom of the table. May have a pose. The workflow may then include creating or defining one or more views and painting on the model in different poses.

  In various implementations, a rendering pass is made to an object at different poses and in a defined view. The result of this rendering pass is typically a bitmap image of the rendered object, a view, and an associated depth map of the rendered surface. This workflow may also include actions that cause the user to load these rendered bitmaps into a two-dimensional paint program to paint one or more passes representing colors, displacements, and the like.

  Later, the system computes the result of planar projection (inverse map) of each object in each pose at each pose at render time, and the resulting 2D of every visible curved point. Save the coordinates. The surface shader uses these stored 2D coordinates to evaluate surface parameters such as a 2D texture map for each pass. The values returned by this pass calculation are then used to color the curved surfaces affected by the paint, or have various effects on the surface shader to displace these curved surfaces. In other embodiments, non-planar projection methods such as perspective are used.

  In an embodiment, this depth map is evaluated during the planar projection stage process to ensure that only the foremost curved surface for the projected view receives this paint. In addition, surface perpendiculars are taken into account during the projection process to avoid projecting paint onto a surface that is vertical or that faces away from this projected view.

  In an embodiment of the invention, after resolving all projection paths for each view and for each pose of this object model, the surface shader finishes its calculation. The resulting rendered object model generally assumes a different pose than that described above.

  In various embodiments, the rendered object model is generally rendered in association with a scene, and the rendered scene is stored in memory. Later, this rendered scene is typically retrieved in memory and displayed to the user. In various embodiments, the memory is a hard disk drive, RAM, DVD-ROM, CD-ROM, film (thin film) media, print media, and the like.

  From the above description, from an embodiment of the present invention, a user can have an articulated 3D object model pose in multiple forms and receive paint projected from multiple views. . These embodiments improve the efficiency and effectiveness of applying surface parameters, such as multiple texture maps, colors, etc., to the curved surface of complex deformable 3D object models.

  Advantages of embodiments of the present invention include the ability to allow the user to paint on any 3D object model from multiple viewing positions and multiple pose forms of this object. The concept of multiple pose forms allows the user to paint on areas that may not be directly accessible except when the model is deformed or broken down into smaller pieces.

  Embodiments of the present invention introduce a unique approach to organizing multiple views / poses and to apply the resulting texture map back onto this object. More specifically, these implementations selectively control which curved surface receives paint using the orientation (perpendicular) of the curved surface and the depth map rendered from this projection view.

  According to one aspect of the invention, a method for a computer system is described. One method is a procedure that, in the first form, causes at least a portion of the three-dimensional object model to pose, while in the first form, the first two-dimensional of the at least part of the three-dimensional object model. A procedure for determining a view, a procedure for causing the part of the three-dimensional object model to pose in a second form, and a second part of the part of the three-dimensional object model while in the second form. A procedure for determining a two-dimensional view of The various techniques also include a step of associating the first two-dimensional image with the first two-dimensional view of the at least part of the three-dimensional object model, and the second two-dimensional image with the three-dimensional object model. Also included is a procedure associated with the partial second 2D view. The process also determines a first set of surface parameters according to a first two-dimensional image and according to a first form for the at least part of the three-dimensional object model. A treatment associated with the at least part of the curved surface of the three-dimensional object model visible in the two-dimensional view, a second two-dimensional image, and a second form for the part of the three-dimensional object model In response, the second set of surface parameters may include a procedure relating the partial surface of the 3D object model visible in the second 2D view.

  According to another aspect of the invention, a computer program product for a computer system including a processor is described. The computer program product exposes code for instructing the processor to accept a first form for at least a portion of a three-dimensional object, and at least a curved surface of the three-dimensional object in the first form. Code for instructing the processor to determine a first two-dimensional image, code for instructing the processor to accept a second configuration for at least a portion of the three-dimensional object, and a second configuration Code for instructing the processor to determine a second two-dimensional image exposing the at least part of the curved surface of the three-dimensional object in The additional computer code includes code for instructing the processor to receive a first two-dimensional paint image associated with the first two-dimensional image and a second second associated with the second two-dimensional image. May include code that instructs the processor to receive a dimensional paint image. The code also includes the processor to determine a first group of parameters associated with the at least some curved surface of the three-dimensional object in the first form as a function of the first two-dimensional paint image. And determining a second group of parameters associated with the at least part of the curved surface of the three-dimensional object in the second form in accordance with a second two-dimensional paint image. Contains code that instructs the processor. These codes include machine readable or human readable code on tangible media. Typical media include magnetic disks and optical disks.

  In accordance with yet another aspect of the invention, a computer system is described. The computer system generally includes a display, a memory, and a processor. In some computer systems, the memory includes a model of a 3D object, a first pose and a second pose for the 3D object, a first 2D image and a second 2D image, and the 3D It is configured to store surface shading parameters associated with the curved surface of the object. In this computer system, the processor is generally configured to output a first view of the three-dimensional object in the first pose to the display, and a second view of the three-dimensional object in the second pose. Are further output to the display, and are further configured to receive a first two-dimensional image and a second two-dimensional image. The processor also determines a first set of surface parameters associated with the curved surface of the three-dimensional object in response to the first view of the three-dimensional object and in response to the first two-dimensional image. Determining and determining a second set of surface parameters associated with the additional surface of the three-dimensional object in response to the second view of the three-dimensional object and according to the second two-dimensional image. It is configured.

  For a more complete understanding of the present invention, reference is made to the accompanying drawings. While these drawings are understood not to limit the scope of the present invention, the presently described embodiments and the best mode of the present invention as currently understood will be described with reference to the following accompanying drawings. And will be described in more detail.

  The following terms are used in the following patent disclosures:

  “Gprim (geometric primitive)”. A single 3D curved surface defined by a parametric function (Bspline) and by a collection of 3D points organized into any number of faces (polygons) or the like.

  "Model (object model)". A collection of Gprims organized into any number of surfaces (polygon mesh and subdivided surface), implicit surface, or the like. This system does not have to represent the 2D surface with parameters in order to perform its function.

  “View”. An orthographic or perspective camera that can generate an image of the model from a specific viewing position.

  “Pose”. The state of the model in terms of a specific exact transformation within the model hierarchy and the specific form of the model's Gprim. A pose also represents the state of one or more views.

  The pose generally includes the position and orientation of both the model and all view cameras. In an embodiment of the invention, a pose specifies a particular form or orientation of two or more objects in the object model. For example, a pose may specify that two objects are at a specific distance from each other, or that two objects are at a specific angle to each other, or similar. Examples of different poses of objects are illustrated below.

  Whenever a character is positioned, the position is generally saved as a specified pose so that the system and user can later reference the position. The user changes the position of the model and establishes a new camera view and then saves the new pose. The painting (overlay image) generated in a particular view is closely tied to the position and orientation of the camera.

  “Pass”. “Color” or “Displacement” along with the type of painting, eg, the number of color channels that are to be used in the path. The name gives a handle that is used to refer to a set of paintings in the shader. In general, their names are arbitrary.

  FIG. 1 is a block diagram of an exemplary computer system 100 according to one embodiment of the invention.

  In this embodiment, the computer system 100 generally includes a monitor 110, a computer 120, a keyboard 130, a user input device 140, a network interface 150, and the like.

  In this embodiment, the user input device 140 is typically a computer mouse, trackball, trackpad, wireless remote control, drawing tablet, display tablet integration device (eg, Cintiq by Wacom), voice command system, eye It is embodied as a tracking system. The user input device 140 generally allows the user to select objects, icons, text, etc. displayed on the monitor 110.

  Embodiments of the network interface 150 generally include an Ethernet card, a modem (telephone, satellite, cable, ISDN) (asynchronous) digital subscriber line (DSL) unit, and the like. Network interface 150 is typically coupled to a computer network, as shown. In other embodiments, the network interface 150 may be physically integrated on the motherboard of the computer 120, may be a software program such as soft DSL, or the like.

  The computer 120 typically includes a processor 160, familiar computer components such as random access memory (RAM) 170, disk storage devices such as disk drives 180, and a system bus that interconnects these computer components. 190 is included.

  In one embodiment, the computer 120 is a PC-compatible computer having one or more microprocessors, such as a Pentium IV ™ or Xeon ™ microprocessor from Intel Corporation. Further, in this embodiment, computer 120 typically also includes a LINUX-based operating system.

  The RAM 170 and the disk drive 180 include data, audio / video files, computer programs, scene descriptor files, object data files, overlay images, depth maps, shader descriptors, rendering engines, shading Examples of tangible media for storing engines, output image files, texture maps, displacement maps, painting environments, object generation environments, animation environments, surface shading environments, asset management systems, databases and database management systems, etc. is there. Other types of tangible media include floppy disks, removable hard disks, CD-ROMs, DVDs, barcodes and other optical storage media, flash memory, read only memory (ROM), and batteries. There are backed up volatile memory, semiconductor memory such as a storage device on a network, and the like.

  In this embodiment, the computer system 100 also includes software that enables communication over a network, such as the HTTP protocol, TCP / IP protocol, RTP / RTSP protocol, and the like. Alternative embodiments of the present invention may also use other communication software and file transfer protocols such as IPX, UDP, etc.

  FIG. 1 represents a computer rendering system in which the present invention can be implemented. Those of ordinary skill in the art will readily appreciate that many other hardware and software configurations are suitable for use with the present invention. For example, the computer may be a desktop configuration, a portable configuration, a rack mount configuration, or a tablet configuration. In addition, the Pentium ™ or Itanium ™ microprocessor, Advanced Micro Devices, Inc. An Opteron ™ or AthlonXP ™ microprocessor from Motorola, Inc. The use of other microprocessors such as PowerPC G4 ™ microprocessor, G5 ™ microprocessor, etc. is also conceivable. In addition, Windows® (registered trademark) such as Windows XP (registered trademark) from Microsoft Corporation, Windows NT (registered trademark) operating system, Solaris from Sun Microsystems, LINUX (registered trademark) from Apple Computer Corporation, UNIX (registered trademark), UNIX®, etc. Other types of operating systems are also conceivable.

  FIG. 2 shows a block diagram of one embodiment of the present invention. Specifically, FIG. 2 shows an animation environment 200, an object generation environment 210, and a storage system 220.

  In this embodiment, the object generation environment 210 is an environment that allows a user (model producer) to specify an articulation model of an object including an armature and a rig. Within this environment, the user can generate models of objects (manually, according to procedures, etc.) and specify how these objects articulate against animation variables (Avars). In one particular embodiment, the object creation environment 210 is a Pixar proprietary object creation environment known as “Gipeto”. In other embodiments, other types of object generation environments can be used.

  In this embodiment, the user (shader) also uses the object generation environment 210 to specify the surface parameters of these object models. As described below, an environment that allows a user to assign parameters to the surfaces of these object models through painting may be provided within the object generation environment 210 or separately. In various embodiments, these surface parameters include color data, texture mapping data, displacement data, and the like. These surface parameters are typically used to render this object in the scene.

  In an embodiment of the invention, this environment allows the user to define a pose for this object model. In addition, this environment allows the user to render views of the object model in different poses. This environment also provides this mechanism to create a flat projection (depth map and surface normal to a “reference” pose (also known as Pref) while shading and rendering in standard object form. And maintain associations between different views, different poses, different paint data, different surface parameter data, etc., as described below.

  In this embodiment, the object model generated using the object generation environment 210 can also be used in the animation environment 20. In general, an object model is built hierarchically. The hierarchy of building the object model is useful. This is because, in general, different users (model producers) are assigned tasks for generating different models. For example, one model maker is assigned the task of generating the hand model 290, and another model maker is assigned the task of generating the lower arm model 280.

  In this embodiment, the animation environment 200 is an environment that allows a user (animation creator) to manipulate an articulation model of an object through animation variables (Avars). In one embodiment, the animation environment 200 is a Pixar proprietary animation environment (known as “Men V”). However, in other embodiments, other animation environments can be adapted. In this embodiment, the animation environment 200 allows an animator to manipulate the Avars provided in these object models (inclusive rigs) and move these objects with respect to time (ie, move the objects Animate).

  In other embodiments of the present invention, the animation environment 200 and the object generation environment 210 may be combined to form a single integrated environment.

  In FIG. 2, storage system 220 includes any organized and repeatable way of accessing an articulation model of an object. For example, in one embodiment, the storage system 220 includes a simple flat-directory structure on a local or network drive. In other embodiments, the storage system 220 is an asset management system, or a database access system tied to a database, or the like. In one embodiment, storage system 220 receives reference data to the object model from animation environment 200 and object generation environment 210. In return, the storage system 220 provides the object model stored here. The storage system 220 also generally stores surface shading parameters, overlay images, depth maps, etc. as described herein.

  Conventionally, the Pixar object generation environment allows a user to paint and project an image (texture) on a single object model from a plurality of views in a specific form (pose). However, the inventors of the present invention have found that this object generation environment does not support the view of objects in different poses and it is difficult to texture on complex 3D models in a single pose. It was.

  3A-3B illustrate a flow process according to one embodiment of the present invention. Initially, a three-dimensional object model is provided (step 300). In general, one or more users (object model producers) specify geometric representations of one or more objects through an object generation environment. These objects are combined together to form a larger object model. In this embodiment, the modeler may use an object generation environment such as Gepetto.

  Next, in this embodiment, other users specify how the curved surfaces of these objects should be displayed. For example, these users (shaders) can create object surface effects such as basic colors, scratches, dust, displacement maps, rough and bright maps, transparency, and control over material types. Specify any number. To do so, the user obtains a 3D object model and specifies an initial pose (step 310). In other embodiments, this step need not be specifically performed when the object has a default pose. For example, an object model for a character such as a car may have a default pose with its door closed. At the same time, the user typically specifies one or more view camera positions. In other embodiments, several default cameras can be used for each object. For example, in various embodiments, commonly designated projection views include a top view, a left side view, a right side view, a bottom view, and the like. Further, the camera may be a diagonal view or a similar view. A projected view is not only planar, but may also be non-planar and projective. As an example, if a curved projector maps an image onto a curved surface, a perspective method can be considered.

  Next, in this embodiment, the computer system renders a 2D view of the 3D object in the first pose (step 320). More specifically, the system renders each view using the object model, the pose, and view camera data. In various embodiments, this rendering pass may be a high quality rendering by a rendering program such as Pixar's Renderman product. In other embodiments, this rendering / shading process can be performed using low quality rendering processes such as GL and GPU hardware, software renderers, and the like.

  In various embodiments, each rendered view is saved as an individual view image file or combined to form a larger file. Along with each rendered view, a depth map is also generated that can utilize the planar projection function.

  In this embodiment, the system displays one or more rendered views of the object (step 330). In an embodiment of the invention, this step is performed in a user environment that allows the user to graphically assign pixel values onto a two-dimensional image. Generally, such an environment is referred to as including a “paint” function. In one embodiment, the one or more views can be displayed to the user simultaneously.

  Next, in an embodiment, the user assigns a pixel value along with a view of this object (step 340). In one embodiment, the user performs this procedure by graphically painting “on” the object. This painting is similar to a child drawing or coloring an image drawn in a coloring book. For example, the user applies different brushes on the object's view using an overlay layer or the like. The use of a mechanism similar to “layer” is contemplated herein. In this embodiment, these different brushes may have one or more gray scale values, one or more colors, and so on.

  As an example, a user may use a thin black brush to draw a crack type pattern in the overlay layer of this view. In another example, the user may use a spray paint type brush to darken selected portions in the overlay layer of this view. In yet another example, the user may use a paint brush to color the overlay layer of this view. In still other embodiments, other ways of specifying an overlay layer image, such as applying one or more gradients to the image, operations limited to specified portions of the overlay layer image (eg, selection) ), The incorporation of one or more images into the overlay layer image (e.g., a decal layer), and the like.

  Next, in this embodiment, an overlay layer image for each view is saved (step 350). In various examples, these overlay layer images are stored separately from the two-dimensional view and in an identifiable file. In other embodiments, the overlay layer image is stored in the layer of the two-dimensional view or the like. In various embodiments, the file containing this overlay layer image is also associated with the pose defined at step 310 and the depth map determined at step 320, step 360.

  In this embodiment, the user decides to have the 3D object in the second pose pose again (step 370). The above process is then repeated. In various embodiments, the three-dimensional object is re-paused to generate as many processes as the user deems necessary to generate one or more views and depth maps to paint on the views. It can be repeated for a pose. As an example, in a character object, a certain pose may be a character with an open mouth and arms raised, and another pose may be a character with a mouth closed and arms lowered. As another example, in a folding table, one pose is an unfolded folding table, and another pose is a folding table in which the legs are “disassembled” or separated from the table top plate. There is also.

  In some embodiments of the present invention, the user may simultaneously view on the screen views obtained from different poses of this three-dimensional object. Thus, as seen above, the painting process need not be performed only based on one pose of this object at a time. In addition, the user may paint on the view of this object from different poses in the same session. For example, if a character poses with an open mouth, the user paints white on the layer on the view that shows the character's mouth, and then the user turns black on the layer on the view that shows the character's hair. Paint, and then the user may repaint another white shade on the layer on the view that shows the character's mouth.

  In this embodiment, the next step is to associate the values painted on each view of the three-dimensional object in the first pose back to the three-dimensional object (step 380). More specifically, each view of a three-dimensional object is generally a two-dimensional projection of the curved surface of the three-dimensional object in the first pose. Thus, the portion that appears to be “painted” by the overlay image is projected back to the 3D object using the associated depth map. Such a function becomes effective. This is because the system maintains a linkage between the overlay image, view, and pose of the 3D object. If there are multiple rendered views, the paint is projected back to the three-dimensional object in the first pose for each rendered view.

  In an embodiment of the invention, the curved surface normal can be used to “feather” the effect of the projection of this three-dimensional object onto the curved surface. For example, if a curved surface is parallel to this projection view, the paint effect is calculated to be ~ 100%, however, the curved surface makes an angle of 30 degrees with respect to this projection view. The paint effect is calculated to be ˜50% (sin (30)), while if the curved surface forms an angle of 60 degrees with respect to the projected view, the paint effect is calculated. The effect is such that it is calculated to be ˜13% (sin (60)). The size of feathering is adjusted by the user. In other embodiments, feathering can be used to change the paint effect at transitions such as the edges or boundaries of the object. In various embodiments, this projected paint feathering reduces the smearing of the projected paint.

  FIG. 4 shows an example of an embodiment. In this example, the three-dimensional cylinder 500 is displayed as a rectangle 510 in the two-dimensional view 520 of the cylinder 500. With the above process, the user paints an overlay image 530 on the view 520. In this example, the user paints the lower half of the cylinder 500 in black.

  Next, as shown in FIG. 4, the overlay image is projected onto the three-dimensional cylinder. Therefore, the model of the curved surface 540 on the lower front side of the cylindrical body 500 is associated with the property, that is, black, and the model is feathered as the curved surface normal goes away from the visible plane. The curved surface 550 on the lower rear side of the cylindrical body 500 is not exposed in the view 520 and is not associated with black.

  In this example, the rear view 560 and lower view 570 of the cylinder 500 may be specified to expose the remaining lower half curved surface of the cylinder 500.

  Returning to FIG. 3, the next step is to associate the values painted in the respective views of the 3D object in the second pose back to this 3D object (step 390). As above, each view of this object is generally a two-dimensional projection of the curved surface of the three-dimensional object in the second pose. Thus, the portion that appears to be “painted” by the overlay image is projected onto the 3D object using the associated depth map. When there are a plurality of rendered views, the paint is projected back to the three-dimensional object in the second pose for each rendered view.

  In this embodiment, the planar projections from step 380 and step 390 are combined and both are projected back to the curved surface of the three-dimensional object (step 400). In other words, the user paints on the rendered view of a 3D object in a different pose and projects the paint data back to a single 3D object in a neutral pose.

  The inventor of the present invention considers the above functions important. This is because the above functionality allows the user to re-pose the 3D object and allow the user to paint on the resulting rendered view. This is because the user can “paint” the difficult-to-reach part. As an example, a certain pose is a character with a closed mouth, and another pose is a character with an open mouth. Furthermore, an example using the embodiment of the present invention is illustrated below.

  In embodiments of the present invention, this step 400 may be performed prior to formal rendering of the three-dimensional object. In other embodiments, the steps are performed dynamically during the formal rendering process. For example, the data from step 380 and the data from step 390 are maintained in separate files. Next, when the object is to be rendered with high quality (eg, using Pixar's Renderman), the system uses plane projection data from the 3D object in the first pose, Dynamically combined with planar projection data from the 3D object in the second pose.

  The combined planar projection data is then used to render a three-dimensional object that is typically in a third pose (step 410). As an example, the first pose is a character with both arms lowered, the second pose is a character with both arms raised, and the third pose is a character with only one arm raised. is there.

  In the embodiment of the present invention, the paint data may specify any number of properties for the curved surface of the object. Such properties are also referred to as shading path data. A typical object surface may have more than 100 shading paths. For example, the paint data specifies the color of the curved surface, the application of the texture map, the application of the displacement map, and the like. In an embodiment of the present invention, the planar projection from step 380 and the planar projection from step 390 may apply the same or different properties to the surface of this object. For example, step 380 is a curved surface “crack” path, and step 390 is a curved surface color path.

  In various embodiments, this object is rendered at the same time as other objects in the scene. This rendered scene is generally another two-dimensional image, which is then saved (step 420). In an embodiment of the present invention, the rendered scene can be an optical format such as film, optical disc (e.g., CD-ROM, DVD), magnetic format such as hard disk, network drive, electronic signal, data Can be stored in electronic form such as packets. The resulting rendered scene representation is later retrieved and displayed in one or more viewers (display devices) (step 430).

  5A to 5C show an example of an embodiment of the present invention. Specifically, FIG. 5A shows the three-dimensional model of box 600 in a closed pose. FIG. 5B shows several two-dimensional views of the box 600 including a front view 610, a top view 620, and a side view 630.

  In FIG. 5C, the user has generated overlay images 640-660 on views 610-630, respectively. As explained above, the user is generally painting over views 610-630 to produce overlay images 640-660. FIG. 5D shows the 3D model in box 670 in a closed pose after the overlay images 640-660 have been projected back into the 3D model in box 600 in a closed pose.

  6A to 6D show another example of an embodiment of the present invention. Specifically, FIG. 6A shows the three-dimensional model of box 700 in an open pose. FIG. 6B shows a two-dimensional view of the box 700 that includes a top view 710, a first cross section 720, and a second cross section 730.

  In FIG. 6C, the user has generated overlay images 740-760 on views 710-730, respectively. Again, the user typically paints over each figure to generate an overlay image. FIG. 6D shows the 3D model of box 770 in the open pose after the overlay images 740-760 have been projected back into the 3D model of box 700 in the open pose.

  Next, in this embodiment, the three-dimensional model of the box 670 and the three-dimensional model of the box 770 are combined to form a single three-dimensional model. Shown in FIG. 6E is a single three-dimensional model of box 780 containing the unprojected data from FIGS. 5C and 6C. As shown in FIG. 6E, this three-dimensional model may assume a different pose than the pose shown in FIG. 5A or 6A.

  7A-7C illustrate another example of one embodiment of the present invention. More specifically, FIG. 7A shows a three-dimensional model of a stool in a default pose 800. In FIG. 7B, several views 810 of the stool 800 in this default pose are shown. In this example, the user can paint on the view 810 as described above. Next, 7C shows the three-dimensional model of the stool in the second pose 820. As can be seen, the stool leg 830 is “disassembled” or separated from its seating surface. Several views 840 are shown. In this example, in view 840, it can be seen that the user can more easily paint on the bottom surface of the sitting surface 850 and on the stool leg 860.

  Many modifications or variations can be easily envisioned. In light of the above disclosure, one of ordinary skill in the art will appreciate that there may be any number of environments that apply the above concepts. For example, a painting function that is indispensable for an object generation environment, another shading environment, a third-party paint program (for example, Photoshop, Maya, SoftImage) may be provided. Some of the embodiments described above use a planar projection technique to form a view of the object and project this overlay layer back into the three-dimensional object. Other embodiments may also use non-planar projection techniques to form a perspective view of the object and to project back to the three-dimensional object.

  In another embodiment of the present invention, the process of painting on the overlay layer and returning to the 3D object for planar projection is performed in real time or near real time for multiple poses of the 3D object. Sometimes. For example, the user is given a first view of an object in a first pose and a first view of an object in a second pose. The user then paints on the overlay layer of this first view. In this embodiment, when the user paints, a plane projection process is performed in which the paint is projected back to the three-dimensional object. Next, in real-time or near real-time, the system renders again the first view of the object in the first pose and also the second view of the object in the second pose. In such an embodiment, this process is so fast that the user can effect the effect of the surface parameter specification on the object in one pose among all other poses (views of other poses). Can know.

  In the embodiment of the present invention, various methods of painting on the curved surface, for example, a method using a brush, a texture, a gradient, a filter, and the like are conceivable. In addition, various ways of saving these painted images (eg, layers) are also contemplated.

  The above-described embodiments disclose methods for computer systems and computer systems that can perform these disclosed methods. Additional embodiments include computer program products on tangible media, including software code that causes the computer system to perform these disclosed methods.

  Those skilled in the art will envision additional embodiments after reading this disclosure. In other embodiments, the invention disclosed above can be advantageously combined in whole or in part. The block diagram and flow diagram of this architecture are put together for easy understanding. However, combinations of blocks, addition of new blocks, rearrangement of blocks, etc. shall be considered in alternative embodiments of the present invention.

  The specification and drawings are, accordingly, to be regarded in an illustrative sense rather than a restrictive sense. However, it will be apparent that various modifications and changes may be made to such specification and drawings without departing from the broader spirit and scope of the invention as set forth in the claims.

1 shows a block diagram of a system according to an embodiment of the invention. 1 shows a block diagram of one embodiment of the present invention. 3 is a flow process according to an embodiment of the present invention. 3 is a flow process according to an embodiment of the present invention. An example of one embodiment is shown. An example of one embodiment of the present invention is shown. An example of one embodiment of the present invention is shown. An example of one embodiment of the present invention is shown. An example of one embodiment of the present invention is shown. 4 shows another example of an embodiment of the present invention. 4 shows another example of an embodiment of the present invention. 4 shows another example of an embodiment of the present invention. 4 shows another example of an embodiment of the present invention. 4 shows another example of an embodiment of the present invention. 4 shows another example of an embodiment of the present invention. 4 shows another example of an embodiment of the present invention. 4 shows another example of an embodiment of the present invention.

Explanation of symbols

  500 three-dimensional model in first form, 510 first two-dimensional view, 550 three-dimensional model in second form, 570 second two-dimensional view

Claims (22)

In a first form, causing at least a portion of the three-dimensional object model to pose;
Determining a first two-dimensional view of the at least part of the three-dimensional object model while in the first configuration;
In a second form, causing the portion of the three-dimensional object model to pose;
Determining a second 2D view of the portion of the 3D object model while in the second configuration;
Associating a first two-dimensional image with the first two-dimensional view of the at least part of the three-dimensional object model;
Associating a second two-dimensional image with the second two-dimensional view of the portion of the three-dimensional object model;
In response to the first two-dimensional image and in response to the first form for the at least part of the three-dimensional object model, a first set of surface parameters is set to the first two-dimensional image. Associating with the at least part of the surface of the three-dimensional object model visible in a three-dimensional view;
Depending on the second two-dimensional image and depending on the second form for the portion of the three-dimensional object model, a second set of surface parameters may be applied to the second two-dimensional image. Associating with the partial curved surface of the three-dimensional object model visible in a view;
Including methods.   The method of claim 1, wherein the first two-dimensional view of the portion of the three-dimensional object model is selected from the group of a front view, a side view, a top view, and a bottom view. The portion of the three-dimensional object model includes a first object and a second object;
The first form for the at least part of the three-dimensional object model includes the first object and the second object having a first relationship;
The first form for the portion of the three-dimensional object model includes the first object and the second object having a second relationship;
The method according to claim 1, wherein the first relationship and the second relationship are different.   4. The method of claim 3, wherein the first relationship and the second relationship are selected from the group of linear relationships and angular relationships. Displaying the first two-dimensional view of the at least part of the object model on a display;
Generating a first two-dimensional image on the display by painting on the first two-dimensional view of the at least part of the object model;
The method according to claim 1, further comprising:   6. A method as claimed in any preceding claim, wherein the first set of surface parameters is selected from the group comprising curved surface color, curved surface appearance, displacement map, texture map. Rendering the portion of the three-dimensional object model in response to the first set of surface parameters and the second set of surface parameters to form a rendered object;
Storing the rendered representation of the object in a tangible medium;
The method according to claim 1, further comprising:   8. A tangible medium comprising the representation of the rendered object formed by the method described in any of claims 1-7. Code instructing the processor to accept a first form for at least a portion of the three-dimensional object;
Code for instructing the processor to determine a first two-dimensional image exposing the at least part of the curved surface of the three-dimensional object in the first form;
Code for instructing the processor to accept a second form for the at least part of the three-dimensional object;
Code for instructing the processor to determine a second two-dimensional image exposing the at least part of the curved surface of the three-dimensional object in the second form;
Code for instructing the processor to receive a first two-dimensional paint image associated with the first two-dimensional image;
Code for instructing the processor to receive the second two-dimensional paint image associated with the second two-dimensional image;
The processor is configured to determine a first group of parameters associated with the curved surface of the at least part of the three-dimensional object in the first form as a function of the first two-dimensional paint image. A code to instruct,
The processor is configured to determine a second group of parameters associated with the curved surface of the at least part of the three-dimensional object in the second form as a function of the second two-dimensional paint image. A code to instruct,
Including
A computer program product for a computer system comprising the processor, wherein the code is all on a tangible medium.   The first two-dimensional image is a view selected from the group of a front view, a side view, a top view, a bottom view, and a diagonal view, and the at least part of the three-dimensional object in the first form The computer program product of claim 9, comprising an image.   The computer according to any of claims 9 to 10, further comprising code for instructing the processor to combine at least some of the parameters of the first group and at least some of the parameters of the second group. -Program products. Code for instructing the processor to determine a third two-dimensional image exposing the at least some additional curved surface of the three-dimensional object in the first form;
Code for instructing the processor to receive a third two-dimensional paint image associated with the third two-dimensional image;
The processor is configured to determine a third group of parameters associated with the additional surface of the at least some of the three-dimensional objects in the first form as a function of the third two-dimensional paint image. A code that instructs
Further including
12. The at least part of the curved surface of the three-dimensional object in the first form overlaps the at least part of the additional write curved surface of the three-dimensional object in the first form. A computer program product as described in any of the above. The portion of the three-dimensional object model includes a first object and a second object;
The first form includes the first object and the second object oriented in a direction forming a first angle;
The second form includes the first object and the second object oriented in a direction forming a second angle;
The computer program product according to any one of claims 9 to 12, wherein the first angle and the second angle are different.   14. The method according to claim 9, wherein the first set of parameters and the second set of parameters are selected without replacement from a group including a curved surface color, a curved surface appearance, a displacement map, and a texture map. The computer program product described in 1. Code for instructing the processor to determine a fourth two-dimensional image exposing the at least some additional curved surface of the three-dimensional object in the second form;
Code for instructing the processor to receive a fourth two-dimensional paint image associated with the fourth two-dimensional image;
The processor to determine a fourth group of parameters associated with the additional curved surface of the at least some of the three-dimensional objects in the fourth form as a function of the fourth two-dimensional paint image. A code that instructs
Code for instructing the processor to combine the parameters of the first group and the parameters of the fourth group;
The computer program product according to claim 9, further comprising: Display,
A memory configured to store a model of a three-dimensional object, the memory configured to store a first pose and a second pose for the three-dimensional object, and a first two-dimensional image And a memory configured to store a surface shading parameter associated with the surface of the three-dimensional object;
A processor coupled to the memory and the display, the processor being configured to output a first view of the three-dimensional object in the first pose to the display, wherein the processor is in the second pose. Configured to output a second view of a three-dimensional object to the display, configured to receive the first two-dimensional image, and configured to receive the second two-dimensional image; Configured to determine a first set of surface parameters associated with the surface of the three-dimensional object in response to the first view of the object and in response to the first two-dimensional image; According to the second view of the three-dimensional object and according to the second two-dimensional image A processor configured to determine a surface parameter of the second set associated with additional curved objects,
A computer system comprising:   The computer system of claim 16, wherein the first view of the three-dimensional object is selected from the group of a front view, a side view, a top view, a bottom view, and a perspective view. The three-dimensional object includes a first object and a second object;
The first pose includes the first object positioned in a first orientation relative to the second object;
The second pose includes the first object positioned in a second orientation relative to the second object;
The computer system according to claim 16, wherein the first direction and the second direction are selected from a group of distance and angle.   The computer system according to claim 16, wherein the additional curved surface of the three-dimensional object includes another curved surface of the three-dimensional object that is not within the curved surface of the three-dimensional object.   20. A computer system as claimed in any one of claims 16 to 19 wherein the first set of surface parameters is selected from the group comprising curved surface color, curved surface appearance, displacement map, texture map. The processor also shades the three-dimensional object in response to the first set of surface parameters and the second set of surface parameters to form a shaded representation of the three-dimensional object. Composed of
21. A computer system according to any of claims 16 to 20, wherein the memory is also configured to store the shaded representation of the three-dimensional object. The first view of the three-dimensional object in the first pose includes a front view;
The computer system according to any of claims 16 to 21, wherein the second view of the three-dimensional object in the second pose also includes a front view.

Images