JP6473214B1 - Program, recording medium, and drawing method - Google Patents

Abstract

The present invention provides suitable image presentation even when a three-dimensional drawing expression using a two-dimensional image group and a drawing expression using a three-dimensional object are mixed. For a first type of drawing object that realizes a three-dimensional expression by a group of parts each composed of a two-dimensional image, a drawing direction is determined based on an arrangement position and viewpoint information in a three-dimensional space, and an object The shape and depth order of each part constituting the object is changed according to the drawing direction, and the two-dimensional image of each part constituting the changed object is applied from the viewpoint to the flat object orthogonal to the depth direction of the object arrangement position. Thus, the first type drawing object is arranged in the three-dimensional space, and the arranged object is drawn. Further, the flat plate object to which the two-dimensional image of the part is applied is deformed based on the relief information in the three-dimensional space associated with at least some of the parts constituting the first type drawing object. [Selection] Figure 8

Description

  The present invention relates to a program, a recording medium, and a drawing method, and more particularly to a technique that makes it possible to present a three-dimensional drawing expression of the image by changing the appearance of the two-dimensional image.

  There is a technology that enables a three-dimensional drawing expression using a two-dimensional image by deforming a two-dimensional image of a character or the like drawn by a designer according to a set parameter. In the technique described in Patent Document 1, the state of viewing a character from various directions by changing the position, shape, and depth order of each part of a character or the like designed with a two-dimensional image. Can be presented without using a three-dimensional model.

  By the way, in recent years, electronic games and video contents that present three-dimensional computer graphics (3DCG) as a display screen have been increasing in order to provide a suitable play experience. This depends on the ease of applying motion and the extensibility of drawing expressions such as shadow drawing. On the other hand, when a screen is presented by drawing a three-dimensional model, an expression technique such as toon rendering has been developed. However, depending on the drawing direction, the designer may assume that the character's face is a two-dimensional image. It may not be a suitable drawing expression as it was. For this reason, a method has been proposed in which a part of a character's head or the like uses a three-dimensional drawing expression based on a two-dimensional image, and other parts and surrounding environmental objects are represented using a three-dimensional model. ing.

US Patent No. 8791942

  When a three-dimensional drawing expression using a two-dimensional image group (hereinafter, simply a drawing expression using an extended two-dimensional object) and a drawing expression using a three-dimensional object are mixed, the extended two finally A three-dimensional object and a three-dimensional object are arranged in the same three-dimensional space as drawing objects, and a display screen is generated by drawing a drawing object group in a predetermined viewing volume based on viewpoint information, similarly to 3DCG. .

  Here, as shown in FIG. 3, the extended two-dimensional object is drawn on a plane group orthogonal to a straight line connecting the viewpoint 301 and the reference arrangement position (reference point) 302 of the extended two-dimensional object. This is done by arranging a dimensional image. In other words, the drawing direction (viewing direction / drawing direction) of the extended two-dimensional object is determined according to the positional relationship between the viewpoint and the reference point 302, and the position of the two-dimensional image of each part associated with the direction. On the basis of the shape and the depth order, a corresponding flat object (which may be a so-called billboard) 307 is arranged, and each two-dimensional image is applied and drawn.

  Since the extended two-dimensional object drawing method is like this, when mixing with a three-dimensional object, some parts of the extended two-dimensional object that are shielded by the three-dimensional object 401 when viewed from the viewpoint ( As for the flat object (402), depth information longer than that of the three-dimensional object is set as shown in FIG.

  By the way, as described above, since the flat object to which the two-dimensional image of each part of the extended two-dimensional object is applied is determined according to the viewpoint and the reference point, when the viewpoint is set at a different position, FIG. As shown in b), there is a possibility that a flat drawing object 411 corresponding to the viewpoint related to the extended two-dimensional object and the three-dimensional object 401 interfere with each other in the space and a suitable drawing expression is not made.

  The present invention has been made in view of the above-described problems, and is suitable even when a three-dimensional drawing expression using a two-dimensional image group and a drawing expression using a three-dimensional object are mixed. An object of the present invention is to provide a program, a recording medium, and a drawing method for performing simple image presentation.

In order to achieve the above-mentioned object, the program of the present invention is a first type of drawing object that realizes a three-dimensional expression by a group of parts each composed of a two-dimensional image. A first type of drawing object that realizes a three-dimensional representation of the direction by changing the shape and depth order of the part group according to the direction to be drawn, and a second type of drawing that defines the three-dimensional shape An object arranged in a three-dimensional space for drawing, and the program uses the first type of drawing object to display the arrangement position of the object in the three-dimensional space and the viewpoint information indicating the viewpoint for drawing. Based on the process of determining the drawing direction in which the object is drawn, and the shape and depth order of the parts constituting the first type of drawing object. Processing to change according to the determined drawing direction, and the depth from the viewpoint to the arrangement position of the first type of drawing object from the viewpoint of the two-dimensional image of each part constituting the changed first type of drawing object By applying to a flat object having a plane orthogonal to the direction, a process of arranging the first type of drawing object in the three-dimensional space, a process of arranging the second type of drawing object in the three-dimensional space, and a viewpoint A process of causing a computer to execute a process of drawing a first type of drawing object and a second type of drawing object arranged in a three-dimensional space based on the information, and arranging the first type of drawing object Is a relief information including position information in a three-dimensional space associated with at least some of the parts constituting the first type of drawing object Based on, characterized in that it comprises a process for deforming the flat objects 2-dimensional image of the part is applied.

  With this configuration, according to the present invention, even when a three-dimensional drawing expression using a two-dimensional image group and a drawing expression using a three-dimensional object are mixed, suitable image presentation is performed. Is possible.

The block diagram which showed the function structure of PC100 which concerns on embodiment and modification of this invention The block diagram which showed the module structure implement | achieved about the drawing application performed with PC100 which concerns on embodiment and modification of this invention Diagram for explaining a drawing method of an extended two-dimensional object Diagram for explaining a drawing method when an extended 2D object and a 3D object coexist in a 3D space The figure for demonstrating the relief information which concerns on Embodiment 1 of this invention The figure for demonstrating the shape control of the flat object based on the relief information based on Embodiment 1 of this invention Another figure for demonstrating shape control of the flat object based on undulation information based on Embodiment 1 of this invention The flowchart which illustrated the display control processing performed with PC100 based on Embodiment 1 of this invention The figure for demonstrating the mesh shape control based on the physical point based on Embodiment 2 of this invention The figure for demonstrating the shape control of the flat object based on the relief information based on Embodiment 2 of this invention The flowchart which illustrated the display control processing performed with PC100 concerning Embodiment 2 of the present invention. The figure for demonstrating the shape control of the flat object based on the three-dimensional object based on the modification of this invention The figure for demonstrating drawing of the extended two-dimensional object according to the distance with a viewpoint based on Embodiment 3 of this invention The figure for demonstrating the shape control of the flat object based on the relief information based on Embodiment 3 of this invention The flowchart which illustrated the display control processing performed with PC100 concerning Embodiment 3 of the present invention. The flowchart which illustrated the display control processing performed with PC100 concerning Embodiment 4 of the present invention. The figure for demonstrating the effect which concerns on the compound aspect of embodiment and modification of this invention Another figure for demonstrating the effect which concerns on the compound aspect of embodiment and modification of this invention

[Embodiment 1]
Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the drawings. Note that, in the embodiment described below, the present invention is applied to drawing software configured to be installed and executed on a general-purpose information processing terminal (PC) having a screen drawing function as an example of a drawing program. An applied example will be described. However, the present invention can be applied to any program that can provide a three-dimensional representation of an extended two-dimensional object according to the present invention by being executed in any device having a screen drawing function.

  In this specification, the “extended two-dimensional object” as the first type of drawing object according to the present invention can provide a three-dimensional expression by using a group of parts each composed of a two-dimensional image. It is a configured drawing object, and by changing the position, shape, and depth order of the parts that make up the object according to the drawing direction (drawing direction), it is possible to realize a three-dimensional representation of the direction It is assumed that the drawing object is configured as follows. In other words, the extended two-dimensional object does not define a three-dimensional shape, but is configured to be able to provide a “three-dimensional” drawing expression for various drawing directions by changing the two-dimensional image of the part. . On the other hand, the “three-dimensional object” as the second type of drawing object according to the present invention defines a three-dimensional three-dimensional shape, and even if the state for each drawing direction is not defined, “ It is configured to be able to provide a “three-dimensional” drawing representation.

<Functional configuration of PC>
FIG. 1 is a block diagram showing a functional configuration of a PC 100 according to the embodiment of the present invention.

  The control unit 101 is a control device such as a CPU, for example, and controls the operation of each block included in the PC 100. Specifically, the control unit 101 reads out a program related to an operating system stored in the recording medium 102, a program related to a drawing application that performs drawing in a three-dimensional space, and the like by developing the program in the memory 103 and executing it. Control the operation of each block.

  The recording medium 102 is a non-volatile memory such as a rewritable ROM or a storage device such as an HDD detachably connected to the PC 100, for example. Further, the recording medium 102 may include a recording medium such as a disc on which a game program having a function provided by a drawing application that is accessible via a predetermined readable / writable interface such as an optical drive is recorded. . The recording medium 102 stores not only the above-described program, but also information such as parameters necessary for the operation of each block, various data used for presenting drawing objects (extended 2D objects and 3D objects), and the like.

  The memory 103 may be a volatile memory such as a RAM. The memory 103 is used not only as a development area for developing a program read from the recording medium 102 but also as a storage area for storing intermediate data output in the operation of each block.

  The drawing unit 104 may be a drawing device such as a GPU, and generates a screen (image) displayed in the display area of the display unit 110. In the present embodiment, the drawing unit 104 uses the extended two-dimensional object and the three-dimensional object arranged in the three-dimensional space as viewpoint information (viewpoint information) in which various camera parameters such as position, line-of-sight direction or posture, and angle of view are set. ) To generate a screen to be displayed on the display unit 110. Control (display update) for causing the display control unit 105 to display the screen generated by the various drawing units 104 according to the drawing application on the display unit 110 is performed.

  The display unit 110 may be a display device such as an LCD. In the present embodiment, the display unit 110 is described as a constituent element of the PC 100, but the embodiment of the present invention is not limited to this. The display unit 110 does not have to be configured in the same manner as the PC 100 and the housing, and may be an external display device that is detachably connected to the PC 100.

  The operation input unit 106 is a user interface that the PC 100 has, such as a mouse, a keyboard, a pen tablet, and a game controller. When the operation input unit 109 detects an operation input made by various interfaces, the operation input unit 109 outputs a control signal corresponding to the operation input to the control unit 101. Alternatively, the operation input unit 106 notifies the control unit 101 of the occurrence of an event corresponding to the operation input.

<Module configuration>
Next, in the PC 100 having such a functional configuration, the functional module according to the present invention (mainly extension 2) of the three-dimensional space rendering realized by executing the program according to the rendering application of the present embodiment. A functional module for drawing a three-dimensional object and a three-dimensional object will be described with reference to FIG. Among the module configurations shown in FIG. 2, the functional module realized in the PC 100 of the present embodiment is a configuration indicated by a solid line, and a configuration indicated by a broken line and a one-dot chain line is not included in the present embodiment. And In the present embodiment, the following functional module is described as being realized by software by a program related to a drawing application, but the embodiment of the present invention is not limited to this. That is, some or all of the functions realized by each module may be provided by specific hardware having the functions, or may be realized by using both software and hardware. May be.

  The drawing direction setting module 201 derives and sets the drawing direction in which the object is drawn for each of the extended two-dimensional objects arranged in the three-dimensional space to be drawn based on the viewpoint information relating to the drawing screen. Here, the drawing direction indicates from which direction the extended two-dimensional object is to be viewed on the drawn screen. That is, when the drawn screen is presented, the viewer (viewpoint) is displayed. Is guided to specify the plane (direction) of the extended two-dimensional object that is directly facing. The drawing direction is not limited to the positional relationship between the position in the three-dimensional space where the extended two-dimensional object is placed and the viewpoint, but is specified by considering the posture change of the extended two-dimensional object itself. Although details will be described later, in the drawing application of the present embodiment, the torso part of one character is constituted by a three-dimensional object, and one extended two-dimensional object is arranged on the head in a form linked to this. Has been. One extended two-dimensional object has a center of rotation and a reference point (root joint) serving as a reference for the arrangement position, and the root joint is associated with a position corresponding to the neck of the character of the three-dimensional object. It has been. Therefore, the drawing direction setting module 201 derives a drawing direction based on the position of the viewpoint based on the viewpoint information, the line-of-sight direction, the position of the root joint, and the rotation amount of each extended rotation direction of the extended two-dimensional object at the root joint.

  The position shape determination module 202 determines the position and shape of each part for realizing the drawing expression related to the drawing direction based on the set drawing direction information. Although details will be described later, the extended two-dimensional object predefines information on what display mode (state) each part has in various drawing directions. For this reason, the position shape determination module 202 is based on the information on the state of each part that has been defined in advance for the set drawing direction, or if there is no definition for the set drawing direction, other positions are defined. Based on the interpolation from the selected state, the state for the set drawing direction is derived, and the shape of the two-dimensional image of each part, the arrangement position, and the depth order are changed. Here, the depth order is set in the direction from the viewpoint to the root joint in order to realize a shielding relation between parts and between the part and the three-dimensional object, and is extended to the three-dimensional space. Referenced when placing

  The undulation application module 203 applies deformation based on the three-dimensional undulation information (undulation information) associated with the part at the time of placement in the three-dimensional space for at least some parts of the extended two-dimensional object. . In order to ensure a favorable (designer-desired) viewing experience formed by two-dimensional graphics, each part of the extended two-dimensional object basically has an associated two-dimensional image as described below. By applying to a flat plate object arranged in a three-dimensional space so that the plane is orthogonal to the direction from the viewpoint toward the root joint, it is presented as a so-called billboard object. In other words, the texture is applied to a three-dimensional object having a three-dimensional three-dimensional shape in order to similarly represent a picture expressed in two dimensions defined when editing an extended two-dimensional object in a three-dimensional space drawing. It is not a mode to do so, but a method similar to billboarding is adopted. On the other hand, as will be described later, there is a mode in which a suitable drawing expression is not made by this method. Therefore, in the drawing application of this embodiment, the undulation application module 203 changes the undulation of the flat object to which the two-dimensional image of the part is applied. To perform the process.

  The arrangement module 204 arranges the extended two-dimensional object and the three-dimensional object in the three-dimensional space to be drawn. In the arrangement, the three-dimensional object does not need to be changed every frame if there is no movement or state change with respect to the object itself. On the other hand, since the extended 2D object is presented like a billboard as described above, the extended 2D object is presented according to a viewpoint change that occurs between frames even if there is no movement or state change with respect to the extended 2D object itself. Both the rendered expression and the state of each part can change, and the state of the flat object placed in the three-dimensional space needs to be dynamically changed.

  The drawing module 205 draws the three-dimensional space in which the necessary drawing objects are arranged by the arrangement module 204 according to the camera parameters based on the viewpoint information, and causes the drawing unit 104 to generate a screen to be presented on the display unit 110. In drawing, the occlusion relation of each object arranged in the three-dimensional space appears on the screen in order to refer to the depth order and the depth buffer.

《Basic drawing method of drawing objects》
Hereinafter, the basic drawing method of the drawing object (group) obtained by connecting the extended two-dimensional object and the three-dimensional object will be described in detail with reference to the drawings.

  As described above, for the extended two-dimensional object, state information including the position, shape, and depth order of the two-dimensional image of each part in a predetermined drawing direction (drawing direction) at the time of editing is defined. More specifically, the two-dimensional image of each part is configured as a (two-dimensional) mesh in which a plurality of vertices and polygons are defined, and the position of each vertex is moved in each drawing direction during editing. The mesh position and shape can be defined. In addition, since the shielding relationship between parts may change depending on the drawing direction, the depth order can be set for each part (or for each vertex). The drawing direction in which the state of the part is not defined can be derived by interpolation from the state in another drawing direction in which the definition is made. At the time of editing, the drawing direction is, for example, a rotation amount (2-axis or 3-axis) obtained by rotating a vector (reference vector) indicating the front direction of the object determined for the root joint of the extended two-dimensional object around the root joint. The rotation angle) may be determined as a reference. Therefore, when the drawing direction is determined, the extended two-dimensional object can provide at least a drawing expression related to the drawing direction as a two-dimensional image by changing the state of each part to the shape, position, and depth order corresponding to the direction. It is configured.

  By the way, when both objects are arranged in the three-dimensional space in order to realize the three-dimensional drawing expression by connecting the extended two-dimensional object with the three-dimensional object, the drawing direction is determined to draw the three-dimensional space. It is determined in accordance with the angle formed by the reference vector of the extended two-dimensional object with respect to a straight line connecting the determined viewpoint and the connection point of the three-dimensional object in the three-dimensional space, that is, the root joint of the extended two-dimensional object. That is, the drawing direction when the extended 2D object is arranged in the 3D space is determined based on the positional relationship between the viewpoint and the root joint and the rotation amount of the extended 2D object performed around the root joint. At this time, if the reference vector coincides with a straight line connecting the root joint and the viewpoint, the extended two-dimensional object is in a state of facing the viewpoint (facing the front).

  First, for the sake of simplicity, a description will be given of processing when presenting a rendering expression in the front direction of an object when only an extended two-dimensional object is arranged in the three-dimensional space. As described above, when the extended two-dimensional object in the front direction is drawn, as shown in FIG. 3, the straight line 303 connecting the viewpoint 301 and the root joint 302, the reference vector 304 of the extended two-dimensional object, Are matched (the reference vector 304 overlaps a part of the straight line 303), and each part is arranged in the three-dimensional space according to the position, shape, and depth order defined for the front direction. FIG. 3 is an overhead view from a position different from the viewpoint so that the distribution in the depth direction between parts (direction from the viewpoint toward the root object) 305 can be easily grasped. Here, the depth direction 305 is determined only with respect to the positional relationship between the viewpoint 301 and the root joint 302, and is a concept different from the drawing direction in which the amount of rotation at the root joint can also be considered.

  Each part is placed in a three-dimensional space by first deforming the mesh of the part into a shape corresponding to the drawing direction (front direction) (changing the position of the mesh vertex), and then a flat plate of the same shape as the deformed mesh This is done by placing the object in a three-dimensional space and applying the deformed mesh (as a texture) to the flat object. At this time, the arrangement position of the flat object 307 is a canvas plane whose normal is parallel to the depth direction (for example, including the root joint, and the root joint 302 is the origin of the coordinate system (canvas coordinate system) of the canvas plane. In the depth direction, the projection position on the viewpoint 306 becomes the (two-dimensional) position of each part defined in the drawing direction (front direction), and the depth order is taken into consideration as shown in FIG. A depth value in direction 305 is defined. Here, the canvas plane 306 is a concept provided in this embodiment for deriving how the arrangement and deformation of the parts group of the extended two-dimensional object are performed, and is drawn in the actual drawing process. It is not an object to be processed, nor is it an essential concept for processing.

  Therefore, the flat object group 307 arranged in the three-dimensional space in order to realize the three-dimensional drawing expression of the extended two-dimensional object has each part in which the orthogonal projection onto the canvas plane 306 in the depth direction is determined with respect to the drawing direction. The surface of each flat object 307 is basically configured to be orthogonal to the depth direction 305. That is, the plane of the flat object group 307 is basically parallel between the objects.

  When an extended two-dimensional object of such a drawing method is arranged in a three-dimensional space together with a three-dimensional object, the depth direction of the flat object to which the mesh of each part is applied is considered in consideration of the shielding relationship with the three-dimensional object. The depth value needs to be changed. For example, as shown in FIG. 4 (a), parts such as back hair are shielded by a three-dimensional object 401 that is a torso. In the direction 305, it is only necessary to include distance information indicating how far away the arrangement is made.

  In the example of FIG. 4A, when the extended two-dimensional object is in a posture facing the front, that is, when a viewpoint is provided in front of the extended two-dimensional object and a rendering expression in the front direction is presented, the three-dimensional object 401 and In the description, the depth value information of the flat object 402 to which some parts of the extended two-dimensional object are applied is defined in advance so that there is no interference. On the other hand, as described above, the extended 2D object and the 3D object 401 have different drawing methods. Therefore, even if the extended 2D object itself does not move or the posture is changed, the viewpoint is moved. It is necessary to change the state of each part in order to present a drawing expression in a drawing direction according to a later viewpoint. More specifically, when the viewpoint 301 moves, the direction of the extended two-dimensional object (drawing direction) seen from the moved viewpoint 301 ′ and the depth direction connecting the viewpoint 301 and the root joint 302 change. It is necessary to change at least one of the shape (shape of each part), position, and depth order of the object 307. FIG. 4B shows an example in which the viewpoint of looking down obliquely from the upper front is set for the extended two-dimensional object and the three-dimensional object 401 shown in FIG.

  In FIG. 4B, the flat object 411 to which the two-dimensional image of the back hair part is applied is similar to FIG. 4A in the new depth direction 412 determined by the viewpoint 301 ′ and the root joint 302. A depth value farther from the viewpoint than the joint 302 is assigned. However, as shown in FIG. 4B, when the back hair part has a predetermined length in the height direction in the world coordinate system of the three-dimensional space, the three-dimensional object 401 is changed when editing the extended two-dimensional object. Since the shape of the part in the drawing direction is defined without consideration, the applied flat object 411 and the three-dimensional object 401 can interfere in the three-dimensional space. In such a case, as shown in FIG. 4 (b), there appears to be a hindrance between the back hair part and the body part (arm part in the example shown in the figure). Drawing expression is made.

  On the other hand, it can be avoided by changing the depth value in the depth direction as the viewpoint moves so that the flat object 411 does not interfere with the three-dimensional object 401. There is also a possibility of interference with the three-dimensional object.

  When editing an extended two-dimensional object, the extended two-dimensional object is drawn and presented in a parallel projection method so that the designer can easily draw the desired drawing and reduce the number of states to be defined. The designer is assumed to be configured to define the state of each part in a predetermined drawing direction regardless of the distance from the viewpoint. On the other hand, when rendering a three-dimensional space, each object arranged in the space is drawn in a perspective projection method in order to present perspective, but as described above, an extended two-dimensional drawing in which each part is rendered as a billboard Since the shape and the like of the object are originally defined by the parallel projection method, even if the object is drawn by the perspective projection method, it is difficult to give perspective to the viewer. For this reason, perspective projection is also possible for billboards by adjusting the part mesh and the shape (size) of the applied flat object according to the distance between the viewpoint and the extended 2D object (more specifically, each part). A process for forcibly generating perspective such as a method is applied. The occurrence of the above-mentioned interference problem can be reduced by such a size change of the flat object, but it is not a fundamental solution because it is performed according to the distance from the viewpoint.

<Definition of relief information>
In order to avoid interference between objects that may be caused by different drawing methods between the extended two-dimensional object and the three-dimensional object as described above, the drawing application according to the present embodiment has at least a part of the extended two-dimensional object. Is associated with the undulation information for giving the undulation to the flat object to which the mesh of the part is applied. The relief information is information provided separately from the mesh of the part to be associated, and is referred to in the process related to the flat object after the drawing direction is determined when associated with the part. In other words, a deformation process or the like that refers to the undulation information for the flat object to be applied is not performed for parts that are not associated with the undulation information.

  In this embodiment, as shown in FIG. 5, the undulation information is composed of a group of points (joints) connected to the root joint via bones, and each joint has information for specifying a position in a three-dimensional space. Configured. More specifically, in this embodiment, a bone is an object that binds between joints or between a joint and a root joint, and each joint is attached with information that can specify information on the relative position of the root joint in a three-dimensional space. It is assumed that The relative position information is defined for the state in which the extended two-dimensional object is not rotated at the root joint, and the world coordinates in the three-dimensional space of the root joint are determined, thereby determining the world coordinates of each joint. . Here, the information on the relative position may be included in each joint as a difference in position from the root joint, and in the present embodiment, from the series of joint groups bound through the bone, the information from the root joint is used. Each joint may have a difference in position with the previous joint (parent joint) in the binding order. In the latter case, the position of each joint can be specified by performing the position derivation process in order from the joint with the fewest number of bones bound in the binding order from the root joint. The information indicating the parent-child relationship between the joints and the binding relationship such as the binding order may be information that the bone has as the binding information. Therefore, in this embodiment, the undulation information always indicates a fixed coordinate group in the three-dimensional space unless the position and orientation of the extended two-dimensional object change, and does not undergo deformation depending on the viewpoint movement. A three-dimensional relief formed by bones.

  In the present embodiment, the undulation information is described as being composed of joints and bones connected to the root joint, but the implementation of the present invention is not limited to this. In other words, the relief information need not be made up of bones and joints as long as it gives three-dimensional relief information that does not depend on the drawing direction for the part. Any configuration is possible as long as it defines the relative positional relationship between

  Further, the relief information need not be defined for all parts constituting the extended two-dimensional object, and may be information defined for at least some parts. Preferably, a part that needs to consider a shielding relationship with another drawing object, or a dynamic change of a three-dimensional shape or position of the part as described in different embodiments described later is taken into consideration. The parts that need to be processed may be associated with each other. In the present embodiment, for simplicity, the shape of a flat object using undulation information in a mode in which a drawing direction change accompanying a viewpoint change is performed while excluding an element of a drawing direction change accompanying an orientation change of an extended two-dimensional object Control will be described.

<Shape control of flat object based on relief information>
Hereinafter, the undulation application process performed by the undulation application module 203 on the parts associated with the undulation information constituting the extended two-dimensional object will be described in detail with reference to the drawings.

  When there is undulation information associated with a part, a flat object to which the part is applied is a target of deformation performed based on the undulation information. The association of the undulation information with the part may be performed by adding information capable of acquiring the content of the undulation information to the information managed for the part. Here, the joint group connected via the bone from the root joint and all of the bone groups are attached to the part information as information referred to when the flat object is arranged in the three-dimensional space. There is no need to associate the undulation information. In particular, since the joint group and bone group included in the undulation information may be configured to be referred to in the deformation of the flat object related to a plurality of parts, the information attached to the part as a correspondence is Some of the undulation information may be specified. If only the joints included in the undulation information can be specified, the presence / absence of bones connected to the joint and information on the bones can be obtained from the undulation information. Any one of the joints may be specified.

  For example, as shown in FIG. 6A, in an aspect in which the extended two-dimensional object faces the viewpoint (the viewing direction vector of the viewpoint and the reference vector face the same straight line), the undulation information 601 When the information for identifying the joints 602b to 602d is attached to the back hair part (target part), the undulation application module 203 performs the undulation application process 203 on the flat object 604 that provides the mesh of the part. The contents will be described below.

  In order to give undulations based on the undulation information to the flat object 604, the undulation application module 203 first specifies the closest bone from the associated undulation information for each mesh vertex of the target part. Execute. In this embodiment, since the information of the joints 602b to 602d is attached to the target part, the associated undulation information is the joints 602b to 602d and the bones 603b to 603b that bind them. As described above, the flat object 604 to which the mesh of the target part is applied has the same shape as the mesh of the part in a state where the orthogonal projection shape on the canvas plane in the depth direction is determined according to the drawing direction. Therefore, in this embodiment, it is assumed that the flat object 604 is a polygon model showing a vertex distribution similar to that of the mesh so that inconsistency does not occur in the application of the two-dimensional image related to the mesh of the target part to the flat object 604. . Therefore, the undulation application module 203 starts with the vertices included in the mesh of the target part, that is, the vertices corresponding to the flat object 604 to which the mesh is applied, among the bones (or joints) closest to the undulation information bone. Is identified.

  For example, when the flat object 604 related to the target part and the undulation information (joint and bone) associated with the target part are projected on the canvas plane in the depth direction (gaze direction), the respective orthogonal projections are displayed in the canvas coordinate system. In FIG. 7, it is assumed as shown in FIG. At this time, the undulation application module 203 performs the following process to specify the nearest bone for each vertex (corresponding to the vertex of the applied mesh) included in the flat object 604. Details will be described below using the vertex 701 as an example.

  The undulation application module 203 sequentially selects the joints 602 included in the undulation information, and first derives the distance between the bone 603 and the vertex 701 that bind the joint (child joint) and the parent joint. First, paying attention to the bone 603b, the distance between the bone 603b and the apex 701 is formed by the bone 603b and a straight line obtained by extending the straight line related to the bone 603b in the direction of the child joint 602b, as shown in FIG. The line segment 702 that passes through the vertex 701 and is orthogonal to the line segment 702 on the canvas plane is specified, and the line segment 702 differs depending on whether the intersection 704 belongs to the bone 603b or the extension line. When the intersection 704 is on the bone 603b, the distance between the vertex 701 and the bone 603b is the distance between the vertex 701 and the intersection 704 in the line segment 703. On the other hand, when the intersection 704 is on the extension line (or the child joint 602), the distance between the vertex 701 and the bone 603b is the distance between the vertex 701 and the joint 602b. In the example of FIG. 7B, since the intersection 704 is on the extension line, the distance 705b is the distance between the vertex 701 and the joint 602b.

  In this way, by selecting all the joints included in the undulation information and specifying the distance from each bone as a child joint by the above method, as shown in FIG. 7C, each bone The distance between 603 and the vertex 701 can be derived. That is, when the undulation information and the flat object are in the form as shown in FIG. 7A, three kinds of distances 705b to 705d are obtained for the vertex 701 as shown in FIG. From the value distance 705d, the relief application module 203 can specify that the nearest bone of the vertex 701 is the bone 603d.

  When the nearest bone is specified for the vertex 701, the relief application module 203 determines a depth value to be given to the vertex 701 in the depth direction. As shown in FIG. 7D, the depth value in the depth direction is calculated based on the internal division ratio in the bone at the intersection obtained when the nearest bone is derived, and the two joints bound to the bone. It may be derived from the depth value in the three-dimensional space. Note that, as shown in FIG. 7 (e), as shown in FIG. 7 (e), a vertex whose intersection point is not on the closest bone (bone 603d) but on the extension line as in the vertex 706 shown in FIG. 7 (a). The depth value in the three-dimensional space of the joint 602d used for derivation may be determined as it is as the depth value of the vertex 706 in the depth direction.

  The undulation application module 203 deforms the flat object 604 based on the depth value in the depth direction (line-of-sight direction) of each vertex derived in this way, thereby causing the object to undulate as shown in FIG. A drawing object 605 that is raised according to information and is not a single plane can be used.

  Here, as is clear from the figure, since the depth value is determined in units of vertices, the undulation of the flat object 604 in the depth direction may not completely match the undulation indicated by the undulation information. Further, since the shape change of the flat object 604 performed by the undulation application module 203 is only performed by changing the depth value of the vertex in the object, the orthogonal projection shape of the object on the canvas plane in the depth direction does not change.

  In addition, as described above, if the extended two-dimensional object itself does not move or rotate, the undulation information is maintained regardless of the viewpoint movement. Therefore, a viewpoint that looks down obliquely from the upper front of the extended two-dimensional object is set. Even so, the undulation application module 203 performs the same processing on the back hair part. As a result, as shown in FIG. 6C, the flat object 607 to which the mesh of the back hair part is applied is also transformed into a drawing object 608 that follows the undulation information.

  As described above, according to the drawing application of the present embodiment, the drawing method is structurally different, and inconsistency in the shielding relationship may occur, and the extended two-dimensional object and the three-dimensional object are drawn together. In addition, by associating the undulation information, interference in the three-dimensional space can be avoided and a screen showing a suitable drawing expression can be provided.

《Display control processing》
Hereinafter, specific processing will be described with reference to the flowchart of FIG. 8 for the display control processing of the present embodiment, which is realized in the PC 100 when the drawing application having the above-described module configuration is executed. The processing corresponding to the flowchart can be realized by the control unit 101 reading, for example, a processing program corresponding to a drawing application stored in the recording medium 102, developing it in the memory 103, and executing it. This display control process will be described as being started, for example, when a drawing application is executed and repeatedly executed for screen drawing of each frame.

  Further, for the sake of simplicity in the present embodiment, a mode in which only the viewpoint movement is performed without the movement or posture change of the extended two-dimensional object or the three-dimensional object will be described. That is, in the mode described below, the position of the root joint of the extended two-dimensional object in the three-dimensional space is fixed, the extended two-dimensional object does not rotate at the root joint, and the reference posture (the amount of rotation of the reference vector) Indicates a state in which all axes are 0). Similarly, since the extended two-dimensional object has the reference posture, the undulation information can be derived based on the position of the root joint and the direction of the reference vector in the three-dimensional space. The world coordinates are fixed.

  In step S801, the control unit 101 determines whether viewpoint movement from the previous frame has occurred. The viewpoint movement may be performed based on, for example, an operation input, and the control unit 101 derives an event indicating that an operation input related to the viewpoint movement has been made based on the detection result of the operation input unit 106. This step may be determined depending on whether or not. If the control unit 101 determines that the viewpoint movement from the previous frame has occurred, the control unit 101 moves the process to S802. If the control unit 101 determines that the viewpoint movement has not occurred, the control unit 101 moves the process to S808 because the arrangement information of each object in the previous frame can be used. .

  In step S802, the drawing direction setting module 201 sets a drawing direction for the object based on the positional relationship between the moved viewpoint and the extended two-dimensional object, and the state of the extended two-dimensional object. More specifically, the drawing direction setting module 201 is based on viewpoint information indicating various parameters of the viewpoint after movement and information on the position and orientation (reference orientation) of the extended two-dimensional object, a vector from the viewpoint to the root joint, An angle formed with a reference vector indicating the front direction of the extended two-dimensional object is derived, and the drawing direction is determined and set. The set drawing direction information may be stored in the memory 103, for example.

  In step S <b> 803, the position shape determination module 202 first sets the mesh shape (position of each mesh vertex on the canvas plane) and the depth order of each part of the extended two-dimensional object in a state corresponding to the set drawing direction. The processing of this step differs depending on whether or not the interpolation processing is performed depending on whether or not the state of each part related to the drawing direction is defined for the extended two-dimensional object. Sets according to the information defined for the drawing direction corresponding to the extended two-dimensional object. Here, the information setting for each part corresponds to determining the shape of the flat object to which the mesh of the part is applied and the arrangement position in the depth direction. The position (two-dimensional) of the vertex in the canvas coordinate system and the depth value in the depth direction are determined “provisionally”. Note that the depth value in the depth direction is mechanically determined based on, for example, information on the arrangement interval in the depth direction set in advance, taking into account whether or not it is arranged closer to the viewpoint from the root joint, and the depth order. It may be a thing.

  In addition, as described above, each part of the extended two-dimensional object has the mesh shape defined by the parallel projection method, so that the perspective transformation can be realized in a pseudo manner by emphasizing the perspective. In the process of this step, a process of enlarging or reducing the shape of the part (and the corresponding flat object) may be performed according to the distance between each part and the viewpoint. For example, when the distance between the viewpoint and the extended two-dimensional object is far away, the difference in depth value between the parts can be ignored, so whether or not the process is performed according to the distance between the viewpoint and the root joint. It may be determined. Also, for example, when the distance between the viewpoint and the extended two-dimensional object is close, or when the viewpoint is a sharp angle or an overhead composition, the depth between the parts with respect to the distance between the viewpoint and the root joint Since the difference between the values cannot be ignored, it is only necessary to perform processing to reduce the shape of the part far from the viewpoint so that a pseudo-drawing rendering expression can be presented even for the extended two-dimensional object.

  In step S <b> 804, the position shape determination module 202 selects a part for which the “final” arrangement position of the corresponding flat object is not determined in the three-dimensional space as a processing target part (target part). In the drawing application of the present embodiment, for each part of the extended two-dimensional object, the following is performed while selecting the parts one by one in order to determine the final arrangement position in the three-dimensional space of the flat object to which the mesh of the part is applied. Steps S805 to S807 are performed.

  In step S805, the position shape determination module 202 determines whether there is undulation information associated with the target part. If the position / shape determination module 202 determines that the undulation information associated with the target part exists, the process proceeds to S807. If the position / shape determination module 202 determines that there is no undulation information, the process proceeds to S806.

  In S806, the position shape determination module 202 determines the final arrangement position of the flat object in the three-dimensional space based on the information determined for the flat object to which the mesh of the target part is applied in S803. That is, the position shape determination module 202 determines the canvas coordinate and the depth value in the depth direction determined for each vertex of the flat object to which the mesh of the target part is applied as final placement position information, and uses this as the world coordinate system. Convert to location information.

  On the other hand, when it is determined in S805 that there is undulation information associated with the target part, the undulation application module 203 in S807, for each vertex of the flat object to which the mesh of the target part is applied, the depth value based on the undulation information To determine the final position of each vertex. That is, since the position in the depth direction of each vertex of the flat object related to the target part is changed by the processing in this step, the shape of the flat object is changed to a shape according to the undulation information instead of a single plane. As described above, the undulation application module 203 determines the nearest bone for each vertex of the flat object related to the target part and determines the depth value based on the joint bound by the nearest bone. Further, similarly to S806, the undulation application module 203 converts the canvas coordinates and depth values finally determined by the processing of this step for each vertex of the flat object related to the target part into position information in the world coordinate system.

  Therefore, the final shape and arrangement position of the flat object to which the mesh of the target part is applied are determined by the processing of S805 to S807. That is, whether or not the flat object is to be deformed is determined based on whether or not the undulation information is associated, and the undulation application module 203 performs a process of changing the depth value for each vertex as necessary.

  In step S808, the position shape determination module 202 determines whether the final arrangement position of the corresponding flat plate object has been determined for all parts of the extended two-dimensional object. If the position / shape determination module 202 determines that the final placement position of the corresponding flat plate object has been determined for all parts, the process moves to S809, and a part for which the final placement position has not yet been determined is determined. If it is determined that it exists, the process returns to S804.

  In step S809, the arrangement module 204 arranges the extended two-dimensional object and the three-dimensional object in the three-dimensional space. Here, for each part of the extended two-dimensional object, the placement module 204 applies a mesh of each part based on the determined final placement position information (including a deformed flat object). Are arranged in a three-dimensional space.

  In step S810, the drawing module 205 draws each object (three-dimensional object and flat object group) arranged in the three-dimensional space based on the viewpoint information, and generates a screen to be displayed on the display unit 110. In the rendering process in this step, similarly to the rendering process in a general three-dimensional space, a depth buffer is sequentially formed, and rendering is performed in units of pixels while considering the shielding relationship.

  By doing in this way, even if it is an extended two-dimensional object which needs to change the flat object arrange | positioned in three-dimensional space according to viewpoint movement, suitable drawing expression which matched the shielding relationship with a three-dimensional object It becomes possible to handle so that it can be provided.

[Embodiment 2]
In the first embodiment described above, for the sake of simplicity, the extended two-dimensional object maintains the reference posture and the extended two-dimensional object and the three-dimensional object do not move, that is, the drawing information is static. A method of drawing an extended two-dimensional object that matches the shielding relationship associated with the change has been described. On the other hand, the drawing in which the extended two-dimensional object and the three-dimensional object according to the present invention coexist in the three-dimensional space is not limited to a static state of these drawing objects. Hereinafter, in the present embodiment, a mode for performing a state change in consideration of dynamic elements including a motion applied to the drawing object and a state change generated in the drawing object based on an external factor such as an obstacle. A method for drawing the extended two-dimensional object will be described. Note that the PC 100 that executes the program related to the drawing application of the present embodiment has the same configuration as that of the first embodiment, and description of each functional block is omitted.

  When a motion is generated in an extended two-dimensional object such as a character, most parts (each part of the face, contour, etc.) constituting the object follow the position change of the root joint and the rotation in the root joint. Although the arrangement position is changed depending on the shape, a mesh having a shape or a depth order determined for the drawing direction corresponding to the viewpoint is basically used for drawing. On the other hand, independent behaviors and shape changes are caused by movements around the root object (acceleration and angular acceleration (rotational acceleration)) that occur in the extended two-dimensional object, such as the character's hairstyle and long ears. There are also parts that preferably exhibit In this way, when an independent behavior or shape change is caused for some parts, unintended interference with a three-dimensional object that coexists in a three-dimensional space, inconsistency in a shielding relationship, or the like may occur. . Therefore, in the present embodiment, in order to reflect the influence of dynamic elements caused by the movement around the root object and the presence of gravity acceleration, wind, etc., the undulation information joints are positioned and Treated as a “physical point” that enables posture change.

<Module configuration>
Hereinafter, functional modules according to the present invention that are realized by executing a program according to the drawing application of the present embodiment will be described with reference to FIG. In the aspect of performing the state change in consideration of dynamic elements as in the present embodiment, the functional module further includes the configuration shown by using a broken line in FIG. 2 in addition to the configuration of the first embodiment (shown using a one-dot chain line). Configuration is not included). As in the first embodiment, in this embodiment, the following functional modules are described as being realized by software by a program related to a drawing application. However, some or all of the functions realized by each module are It may be provided by specific hardware having a function, or may be realized by using both software and hardware.

  The physical operation module 211 derives the behavior of each physical point when applying a dynamic element to the extended two-dimensional object. For the sake of simplicity in the present embodiment, when a predetermined motion is applied or a position / posture is changed for a drawing object composed of an extended two-dimensional object and a three-dimensional object, the physics operation module 211 performs the process. In consideration of external factors such as 3D space environment (existence of other objects, etc.), initial posture of the drawing object, wind and gravitational acceleration, the behavior of each physical point included in the relief information is derived dynamically. To do. At this time, the physics calculation module 211 performs not only the influence due to gravity but also so-called physics calculation that may take into account the resilience performance and elasticity due to the collision, etc. Derives point position and orientation changes.

  Based on the result of the physics calculation performed by the physics calculation module 211, the shape change module 212 determines the shape on the canvas plane for the mesh (or flat plate object) of the part associated with the undulation information for which the position and orientation have been changed. Make a change. In the first embodiment described above, the drawing process based on the undulation information is changed by the undulation application module 203 changing the depth value in the depth direction for each vertex of the flat object related to the part to which the undulation information is associated. Only described as being done. That is, in the first embodiment, since the static state in which the position and orientation of the extended two-dimensional object are not changed is assumed, the undulation information is a change in the concavo-convex shape of the flat object (change in the depth value in units of vertices). ) Was used only for the explanation. In this embodiment, in order to present a state change when a dynamic element is applied to an extended two-dimensional object, the shape change module 212 uses a shape predetermined for the drawing direction for the mesh of the part. An aspect will be described in which the relief application module 203 changes the uneven shape of the flat object to which the mesh whose shape has been changed in this way is applied while changing according to the dynamic element. In other words, in this embodiment, the undulation information includes two-dimensional deformation (or expression change) caused by application of dynamic elements to the mesh of the associated part, and the undulation that has changed after reflecting the deformation. The depth value of each vertex in the flat object to which the mesh of the part is applied is changed based on.

《Mesh shape change by physical point》
Here, the change in the mesh shape of the part associated with the undulation information, which occurs in response to the change in the undulation information caused by the application of the dynamic element, will be described.

  The undulation information is configured by a joint group connected to the root joint via a bone, as in the first embodiment described above. In this embodiment, these joints are handled as physical points, for example, an inertia expression or a gravity expression. Etc. can be reflected dynamically. On the other hand, as described above, the joint group indicated by the undulation information has a relative position with respect to the root joint in the three-dimensional space with respect to the reference posture of the extended two-dimensional object. Since the position is changed in accordance with the rotation of the extended two-dimensional object, it also has a side face such as ensuring a partial bulge expression at a position separated from the root joint regardless of the posture. Therefore, considering that the designer wants a three-dimensional expression that repels gravity, such as splashing hair and tying hair, it wants to change due to the application of dynamic elements. Information on whether or not to be affected by the dynamic element, that is, whether or not to maintain the relative position to the root joint (or parent joint) (for example, logical constraint information: true and not affected by the dynamic element, False and affected by dynamic elements). Therefore, the physical calculation module 211 derives the position in the three-dimensional space according to the application of the dynamic element only for the physical points whose associated constraint information is false among the physical points included in the undulation information.

  When an event for applying a dynamic element occurs, the physics calculation module 211 performs a physics calculation on the applied dynamic element for each physical point of the undulation information (constraint information is false) to determine the position after the change. decide. When applying the influence caused by the movement or posture change of the extended two-dimensional object, the physics calculation module 211 is bound by the bone related to the undulation information in order to express the propagation of acceleration and angular acceleration given to the root joint. The physical points may be selected in order from the closest to the root joint in the binding order, and the process of deriving the changed position may be performed. Here, the position derived by the physics calculation module 211 is any of world coordinates indicating the absolute position in the three-dimensional space, coordinates indicating the relative position with the root joint, and coordinates indicating the relative position with the physical point that is the parent joint. It may be derived as In this embodiment, when rotation around the root joint related to the posture change of the extended two-dimensional object is performed, the physical operation module converts the position information of each physical point of the undulation information after the rotation into world coordinates. Reference numeral 211 denotes that information on the position of each physical point of the undulation information after execution of the physical calculation is derived as world coordinates.

  When the undulation information after the change due to the application of the dynamic element is derived in this way, the shape change module 212 performs a process for changing the mesh shape of the associated part based on the undulation information after the change.

In changing the mesh shape of the associated part, the shape change module 212 first converts the change of the spatial coordinates generated at each physical point of the undulation information into the information of two-dimensional position change on the canvas plane. In other words, since the extended 2D object is basically drawn by the flat object group arranged in the depth direction from the viewpoint, the deformation of the relief information performed in 3D can be performed with the 2D image of the corresponding part. In order to apply to a certain mesh, the shape change module 212 converts the content of the change that has occurred at the physical point related to the relief information into change information that excludes movement in the depth direction. Specifically, the shape change module 212 projects the undulation information before and after the application of the dynamic element onto the canvas plane, and for each physical point. The dynamic element of the parent joint (or root joint) to which the physical point is bound Travel t from before application to after application
The difference θ between the rotation angle around the position of the parent joint (or root joint) where the physical point is bound before and after application of the dynamic element
Is derived. Here, for example, the rotation angle difference θ may be derived as the difference between the rotation amount from the parent joint before and after the application of the dynamic element based on any axis of the canvas plane (rotation by positive / negative). Direction can be determined). By doing in this way, the change which arises in the relief information by application of a dynamic element can be converted into the information for applying to the mesh of the applicable part which concerns on a drawing direction.

  When the change information (movement amount t and rotation angle difference θ) on the canvas plane for each physical point (including the one whose constraint information is true) is derived, the shape change module 212 undulates each vertex of the mesh of the corresponding part. A weight distribution indicating how much the influence from each physical point of information is reflected is derived. In the drawing application of this embodiment, in order to reflect the influence of the dynamic element on the mesh of the part, the change amount (movement and rotation) of the position performed for each vertex of the mesh is set for each physical point of the associated relief information. The change information obtained is derived by weighted addition. The weight distribution may be determined according to the distance between the vertex of the mesh and each physical point in the state before application of the dynamic element when projected onto the canvas plane, and changes related to physical points close to the vertex The information is determined so that the weight becomes higher (the sum of the weights is 1).

  When the shape change module 212 determines the weight distribution, the change information of each physical point is weighted and added to each vertex of the mesh of the corresponding part based on the weight distribution related to the vertex, and the vertex position after changing the dynamic element To decide. By doing so, vertices that exist around physical points that are not subject to application of dynamic elements do not move much, and vertices that exist around physical points that are subject to application of dynamic elements move so that the designer desires It is possible to realize part deformation by a dynamic element that guarantees the drawing expression to be performed.

  Here, for example, for the back hair part, as shown in FIG. 9A, undulation information 901 (physical points 902b-d and bone 903c) bound to the root joint via the bone 903a, the physical point 902a, and the bone 903b. And d) where the extended two-dimensional object is defined, consider the case where the rotation of the pitch component occurs in the extended two-dimensional object around the root joint. At this time, since the undulation information 901 defines the relative position with respect to the reference posture of the extended two-dimensional object, if the dynamic element is not adapted, as shown in FIG. Can interfere with 3D objects.

  On the other hand, in the undulation information 901, when the constraint information is associated with only the physical point 902b indicating true and the other physical points 902c and d are associated with false indicating the latter physical As for the point group, the position in the three-dimensional space is changed according to the application of the dynamic element. Therefore, by applying the dynamic element based on the physical calculation by the physical calculation module 211, the undulation information 901 becomes a state like the undulation information 901 'in FIG. 9C that does not interfere with the three-dimensional model.

  Therefore, since the three-dimensional shape of the undulation information 901 is changed by applying the dynamic element in this way, the depth of the flat object related to the associated part is based on this, as in the first embodiment. By changing the depth value of the direction, the flat object to which the mesh of the back hair part is applied as shown in FIG. 10 can be changed to a three-dimensional shape along the changed undulation information 901 ′. It is possible to present a suitable drawing expression while avoiding interference with the dimension object. Here, the shape of the orthographic projection onto the canvas plane in the depth direction of the flat object is obtained by applying deformation based on the relief information 901 and 901 ′ to the shape of the mesh of the part associated with the drawing direction. Suppose that it has a shape.

《Display control processing》
Hereinafter, specific processing of the display control processing of the present embodiment, which is realized in the PC 100 when the drawing application having the above-described module configuration is executed, will be described with reference to the flowchart of FIG. Similar to the first embodiment, the processing corresponding to the flowchart is realized by the control unit 101 reading, for example, a processing program corresponding to a drawing application stored in the recording medium 102, developing it in the memory 103, and executing it. be able to. This display control process will be described as being started, for example, when a drawing application is executed and repeatedly executed for screen drawing of each frame. Further, in the display control process of the present embodiment, the same reference numerals are assigned to the steps for performing the same process as the display control process of the first embodiment, and the description thereof will be omitted. Only will be described.

  In step S <b> 1101, the control unit 101 determines whether or not at least one of viewpoint movement from the previous frame, state change of a drawing object (extended 2D object and 3D object), and generation of an influencing dynamic element has occurred. Determine whether. As in the first embodiment, these elements may be determined based on the presence / absence of a predetermined operation input, or the posture of the drawing object may be changed, or motion is being applied to the drawing object. Or whether or not an external factor causing the movement of the physical point has occurred. If the control unit 101 determines that at least one of the viewpoint movement from the previous frame, the change of the state of the drawing object, and the generation of the dynamic element that has an influence has occurred, the process proceeds to S1102, and none has occurred. If it is determined, the process proceeds to S808.

  In step S1102, the drawing direction setting module 201 determines a drawing direction for the extended two-dimensional object based on the positional relationship between the current viewpoint and the extended two-dimensional object and the state of the extended two-dimensional object. Unlike Embodiment 1, in this embodiment, the orientation of the extended 2D object itself around the root joint is also changed (the direction of the reference vector is changed), so that the drawing direction setting module 201 uses the viewpoint information and the position of the extended 2D object. Based on the posture information, an angle formed by a vector from the viewpoint toward the root joint and a reference vector indicating the front direction of the extended two-dimensional object is derived to determine the drawing direction.

  In step S1103, the physical operation module 211 determines whether there is undulation information associated with any part of the extended two-dimensional object. If the physical operation module 211 determines that there is undulation information associated with any part, the process proceeds to S1104, and if it does not exist, the process proceeds to S803.

  In step S1104, the physics calculation module 211 derives the position (world coordinates) of each joint in the three-dimensional space of the current undulation information based on the information on the position and orientation of the current extended two-dimensional object.

  In step S <b> 1105, the physics calculation module 211 determines whether or not the undulation information includes a physical point whose constraint information is false and a dynamic element that affects the undulation information has occurred. If the physical calculation module 211 determines that a physical point that includes constraint information that is false and includes a dynamic element that affects the undulation information, the physical calculation module 211 moves the process to S1106, and the physical point that the constraint information is false. If it is determined that no dynamic element is included or no dynamic element has been generated, the process proceeds to S803.

  In S1106, the physical calculation module 211 performs physical calculation on each physical point of the undulation information based on the applied dynamic element, and further configures the undulation information after application of the dynamic element. At this time, it is assumed that undulation information before application is also retained for use in later processing.

  In step S <b> 1107, the shape change module 212 projects the undulation information before and after applying the dynamic element onto the canvas plane, and derives change information for each physical point.

  In step S803, the mesh shape and depth order of each part of the extended two-dimensional object are set to a state related to the determined drawing direction, and the position of each vertex of the flat object to which each mesh is applied and the depth value in the depth direction are provisional. In step S1108, the shape change module 212 deforms the mesh shape based on the derived change information and the plane shape of the flat object to which the mesh is applied. From the above description, it is easy to understand that the object of this deformation is a mesh of parts associated with undulation information and a flat plate object to which this is applied, and this step will not be performed for non-applicable parts. . In the process of this step, a weight distribution is generated for each vertex of the mesh before the deformation is executed.

  In this way, even in a mode including application of dynamic elements, when drawing an extended 2D object and a 3D object in a 3D space, the shielding relationship with the 3D object is matched. It is possible to provide a suitable drawing expression.

[Modification]
In Embodiment 2 described above, it has been described that the occurrence of a situation in which the extended two-dimensional object and the three-dimensional object interfere can be reduced by changing the undulation information by applying the dynamic element. However, depending on the motion applied to the three-dimensional object and the posture of the extended two-dimensional object, even if the undulation information is changed by applying a dynamic element, interference between objects may occur.

  For example, as shown in FIG. 9A, the character composed of the extended 2D object and the 3D object for which undulation information is defined is in a “bow” posture as shown in FIG. Is taken, the physical point for which the constraint information in the undulation information associated with the back hair part is false moves to a three-dimensional position closer to the viewpoint than the three-dimensional object as shown in the figure. However, when the operation of the bow is started from the reference posture in which the extended two-dimensional object is facing the front direction, the physical point of the undulation information moves from the back side to the front side of the three-dimensional object. In the process, a drawing expression in which the back hair part penetrates (passes through) the three-dimensional object can be made.

  For this reason, an object (so-called collision) for performing contact determination with the three-dimensional object is set at each physical point included in the undulation information, and the physical calculation module 211 is a collision set for the three-dimensional object in the physical calculation. And the collision set for the physical point are determined to intersect (overlapping), and if they intersect, the physical point in the three-dimensional space is not crossed (contacted). What is necessary is just to determine a position.

  Further, contact information between the undulation information and the three-dimensional object cannot always be determined by collision at a physical point. For example, in an aspect in which the extended two-dimensional object transitions from the reference posture to the posture shown in FIG. 12A, the portion of the relief information that first contacts the collision 1201 of the arm portion of the three-dimensional object in the transition process is a physical point. It can be a point on the bone that binds between the physical points, not the collision associated with 902b or the physical point 902c. Therefore, when there is a vertex of a flat object that determines a depth value based on a point on the bone, a drawing expression in which the back hair part penetrates the three-dimensional object is also made.

  Therefore, in the change transition of the relief information according to the application of the dynamic element, when the collision of the three-dimensional object and the bone first contact, the physics calculation module 211 adds a new physical at the position of the contact point on the bone. The undulation information may be changed so as to add a point, and the contact determination and the undulation information associated with the contact may be changed. For example, when this is applied to the mode of FIG. 12A, the physical calculation module 211 adds a new physical point 1202 as shown in FIG. 12B, and the collision 1203 of the physical point is an arm part. The position of the physical point 1202 in the three-dimensional space may be determined so as not to intersect with the collision 1201, and the positions of the physical points 902c and d may be determined by physical calculation after reflecting this.

  By defining contact information (collision determination) with the three-dimensional object for the undulation information in this way, defining the three-dimensional shape of the flat object of the parts in a shielding relationship so that inconsistent drawing expressions are not presented Is possible.

[Embodiment 3]
By the way, in the embodiment and the modification described above, when drawing an extended two-dimensional object, the drawing direction is set and set based on the positional relationship between the viewpoint and the root joint of the object and the posture of the object at the root joint. In the above description, the extended two-dimensional object is presented in a drawing expression defined for the drawing direction. That is, when the drawing direction is set, the mesh of all the parts of the extended two-dimensional object is transformed into a shape determined with respect to the drawing direction and is applied to the flat object having the same shape on the canvas plane. The mode of arrangement and drawing in the dimensional space has been described.

  Such an aspect is similar to the adjustment process for realizing the perspective projection rendering expression described above, and presents a suitable rendering expression when the distance between the viewpoint and the extended two-dimensional object is far away. However, when the viewpoint and the extended two-dimensional object are close to each other, or when the viewpoint is a sharp angle or an overhead composition, there is a possibility that a suitable rendering expression may not be obtained. This is because the drawing direction for all parts of the extended two-dimensional object is determined based on the root joint of the object.

  When the viewpoint and the extended 2D object are far apart, in the screen coordinate system drawn based on the viewpoint information, the root joint and the mesh (flat plate object) of each part arranged around the root joint are close to each other To do. In other words, since the area where the extended 2D object appears falls within a predetermined range on the screen, the difference in the viewing direction of each part of the extended 2D object from the viewpoint can be ignored, and the mesh of each part is drawn the same. Even if the shape is determined for the direction, it does not give the viewer a sense of incongruity.

  On the other hand, when the viewpoint and the extended two-dimensional object are close to each other, or when the viewpoint is a sharp angle or a bird's eye view composition, the screen joint is arranged around the root joint and the root joint. The mesh of each part is separated. In other words, since the area where the extended 2D object appears does not fit within the predetermined range on the screen, there is a difference that cannot be ignored in the viewing direction of each part of the extended 2D object from the viewpoint, and the mesh of each part has the same drawing direction. If the shape is determined for the viewer, the viewer may feel uncomfortable as shown in FIG. In particular, when the viewpoint moves closer to the drawing object or moves away from the drawing object, the perspective projection method draws different views depending on the positional relationship with the viewpoint or the shielding relationship is different. It is preferable that the expression is made, but such an expression cannot be performed in the extended two-dimensional object in which the mesh shape and the depth order are defined with respect to the drawing direction. Even if the viewpoint and the extended two-dimensional object are separated from each other, if a part where the mesh is developed is included in a position separated from the root joint in the screen coordinate system, a suitable drawing expression is not obtained.

  In other words, when a 3D object having a defined 3D shape and corresponding to a perspective projection method and an extended 2D object having a different drawing method are drawn together in a 3D space, it is provided as a screen. Within the angle of view, a process for presenting a perspective rendering suitable for the distance from the viewpoint is required. Therefore, in the present embodiment, a method for providing a suitable drawing expression by changing the drawing direction determined for drawing the extended two-dimensional object for each part constituting the object according to the state will be described. To do.

<Module configuration>
Hereinafter, a functional module according to the invention of the present embodiment realized by executing a program related to the drawing application of the present embodiment will be described with reference to FIG. In the aspect in which the drawing direction is changed according to the positional relationship between the arrangement position of the parts and the viewpoint as in the present embodiment, the functional module has a configuration shown by using a one-dot chain line in FIG. 2 in addition to the configuration of the first embodiment. (The configuration shown using a broken line is not included). That is, in this embodiment, for the sake of simplicity of explanation, the extended two-dimensional object retains the reference posture, the extended two-dimensional object and the three-dimensional object do not move, and no dynamic element is applied. To do.

  As in the above-described embodiment, in the present embodiment, the following functional modules are described as being realized by software according to a program related to a drawing application, but some or all of the functions realized by each module are as follows: It may be provided by specific hardware having the function, or may be realized by using both software and hardware.

  The drawing direction change module 221 determines, for each part of the extended two-dimensional object, whether or not to change the drawing direction (reference drawing direction) set by the drawing direction setting module 201 when presenting the part. A new drawing direction to be applied (consistent drawing direction) is determined. Whether or not to change the drawing direction for a part is determined by whether or not a condition defined for the state of the part is satisfied. In the present embodiment, for the sake of simplicity, the drawing direction change module 221 can be specified as being separated from the root joint by a predetermined distance, so that the drawing direction can be changed on the condition that undulation information is associated with the part. It shall be determined that

  When the matching drawing direction is determined for the part by the drawing direction changing module 221, the correction module 222 derives a correction amount for correcting the mesh and the flat object of the part to a position corresponding to the matching drawing direction. Here, the position, shape, and depth order determined for the part mesh may differ between the reference drawing direction set by the drawing direction setting module 201 and the matching drawing direction changed by the drawing direction change module 221. That is, when the arrangement position of the part mesh (and the plate object) is simply determined based on the information determined for the matching drawing direction, the arrangement position for the reference drawing direction that was originally set is determined with other parts. The correction module 222 performs correction to change the position of the mesh whose shape is changed in the matching drawing direction to a position corresponding to the reference drawing direction before the change. In the present embodiment, since the arrangement position of the mesh or the flat object to which the mesh is applied is determined based on the associated relief information joint, the correction module 222 has changed the drawing representation to the matching drawing direction. The arrangement position of the mesh is changed according to the position of the joint as the reference of the arrangement position, and the drawing expression is matched.

《Change drawing direction》
Here, a method for determining the matching drawing direction performed for the parts satisfying the condition by the drawing direction changing module 221 will be described with reference to FIG. In the example of FIG. 14, for the sake of simplicity of explanation, the line-of-sight direction vector 1401 related to the viewpoint and the reference vector 1402 of the extended two-dimensional object face each other. It is assumed that the undulation information composed of 1404b and c is associated. The figure shows these objects and undulation information in a bird's-eye view so that it is easy to grasp the determined matching drawing direction.

  As described above, in the example shown in FIG. 14, the line-of-sight direction vector 1401 and the reference vector face each other, so the drawing direction setting module 201 sets the drawing direction corresponding to the front direction as the reference drawing direction for the extended two-dimensional object. doing. Therefore, the mesh of each part is changed to a shape corresponding to the set reference drawing direction. On the other hand, in the undulation information associated with the back hair part, the straight line connecting the joint 1403b serving as a reference for the arrangement position of the upper part of the part and the viewpoint forms an angle φ with the straight line connecting the root joint and the viewpoint. That is, when the mesh of the back hair part is shaped according to the reference drawing direction, the drawing expression that will be presented when viewing the back hair part existing in the direction from the viewpoint toward the joint 1403b as the angle φ increases. Will deviate from.

  For this reason, the drawing direction change module 221 sets the drawing direction (consistent drawing direction) for the back hair part from the reference drawing direction set based on the positional relationship between the viewpoint and the root joint, and the positional relationship between the viewpoint and the joint 1403b. Change the direction based on. For simplicity, in this embodiment, when undulation information is associated with a part, the matching drawing direction determined based on one joint of the undulation information is applied to the part. However, the implementation of the present invention is not limited to this. That is, a plurality of matching drawing directions may be determined for the parts associated with the undulation information. For example, the parts are subdivided into parts corresponding to the bones of the undulation information, and each subdivided part is divided. The matching drawing direction determined based on the parent joint may be assigned to.

《Display control processing》
Hereinafter, specific processing of the display control processing of the present embodiment realized in the PC 100 when the drawing application having the above-described module configuration is executed will be described with reference to the flowchart of FIG. The processing corresponding to the flowchart is realized by the control unit 101 reading out a processing program corresponding to, for example, a drawing application stored in the recording medium 102 and developing the processing program in the memory 103 and executing the same as in the above-described embodiment. can do. This display control process will be described as being started, for example, when a drawing application is executed and repeatedly executed for screen drawing of each frame. Further, in the display control process of the present embodiment, the same reference numerals are assigned to the steps for performing the same process as the display control process of the first embodiment, and the description thereof will be omitted. Only will be described.

  After the reference drawing direction is set in S802, the drawing direction change module 221 determines in S1501 whether or not there is a part whose drawing direction is to be changed. In the present embodiment, as described above, the drawing direction change module 221 makes a determination in this step according to the presence / absence of a part associated with undulation information. If the drawing direction change module 221 determines that there is a part whose drawing direction is to be changed, the drawing direction changing module 221 moves the process to S1502, and if it determines that there is no part, moves the process to S803.

  In step S1502, the drawing direction change module 221 determines a matching drawing direction for each part whose drawing direction is to be changed. More specifically, the drawing direction change module 221 determines the matching drawing direction based on the angle formed by the straight line connecting the joint and the viewpoint included in the undulation information and the straight line connecting the root joint and the viewpoint.

  In step S1503, the position shape determination module 202 sets the mesh shape and depth order of each part of the extended two-dimensional object to a state related to the determined drawing direction, and the position and depth of each vertex of the flat object to which each mesh is applied. The depth value of the direction is tentatively determined. The processing in this step is basically the same as the processing described as being performed in S803. However, for parts determined to be changed in the drawing direction, the processing is performed based on the reference drawing direction. Instead, the process is performed based on the matching drawing direction determined in S1502.

  In step S <b> 1504, for the part that is determined to change the drawing direction, the correction module 222 changes the mesh position of the part on the cabas plane from the position that is determined for the matching drawing direction to the part that is determined for the reference drawing direction. A correction amount to be changed to the mesh position is derived. Then, based on the derived correction amount, the position shape determination module 202 changes the position of the mesh of the part and the flat object to which the part mesh is applied in the canvas space, and moves the process to S804.

  By doing so, it is possible to present a more suitable drawing expression according to the positional relationship with the viewpoint in the drawing of the extended two-dimensional object. For example, when all the parts of the extended two-dimensional object are drawn in a mesh shape determined with respect to the reference drawing direction, the perspective expression is not suitably achieved as the drawing expression shown in FIG. According to the drawing application of the present embodiment, since the drawing direction of the part associated with the relief information is changed so as to move away from the root joint, the drawing expression as shown in FIG. it can.

  In the present embodiment, it has been described that whether or not to determine a new drawing direction for a part is determined based on whether or not undulation information is associated with the part. It is not limited. As described above, in the method of determining the matching drawing direction based on the angle formed by the straight line connecting the viewpoint and the root joint, for example, it is referred to when the part related to the set reference drawing direction is arranged at any position. As long as the reference point in the three-dimensional space can be specified, it may be used instead of the joint included in the undulation information. That is, even if undulation information is not associated with a part, a straight line that connects a reference point and a viewpoint, which is a reference for determining a placement position of a mesh or a flat object related to the part, and a straight line that connects a root joint and a viewpoint The drawing direction change module 221 may determine the matching drawing direction based on the angle between the two.

  In addition, the matching drawing direction indicates how the parts are distributed in the screen coordinate system when drawing is performed based on viewpoint information, even if the reference points are not associated with the parts in this way. Any mode that can be identified can be determined in the same manner. In other words, in perspective projection drawing, on the screen for drawing one extended two-dimensional object, that is, within the angle of view related to the viewpoint, the preferred perspective depends on how each part is distributed with the root joint. Since the direction to be expressed and appreciated is determined, the drawing direction changing module 221 may determine the matching drawing direction according to the positional relationship between the root joint and each part in the screen coordinates. In such an aspect, even if the part close to the root joint in the screen coordinates is changed from the reference drawing direction, the resulting drawing expression difference can be regarded as a slight difference, so a new matching drawing direction is determined. In order to reduce the amount of calculation, the parts may be limited to those that are arranged at positions separated from the root joint by a predetermined distance in the screen coordinates.

  Further, even in the case of an extended two-dimensional object as in the present embodiment, if a method of determining the drawing direction for each part is adopted, the drawing object is not composed of the extended two-dimensional object and the three-dimensional object. It will be easily understood that even if all of the two-dimensional objects are configured, a drawing expression corresponding to the perspective projection method can be presented.

[Embodiment 4]
In the above-described Embodiments 1 to 3 and the modified examples, in order to briefly explain the characteristic functional configuration, an independent mode in which the effect of the corresponding functional configuration is likely to appear is given as an example. These functional configurations may be combined in any way.

  In this embodiment, a mode in which all functional configurations are combined will be described. That is, the functional module realized by executing the program related to the drawing application of the present embodiment includes all the configurations shown in FIG. 2 using solid lines, broken lines, and alternate long and short dash lines.

《Display control processing》
Hereinafter, specific processing of the display control processing of the present embodiment, which is realized in the PC 100 when the drawing application having the module configuration illustrated in FIG. 2 is executed, will be described with reference to the flowchart of FIG. Similar to the first embodiment, the processing corresponding to the flowchart is realized by the control unit 101 reading, for example, a processing program corresponding to a drawing application stored in the recording medium 102, developing it in the memory 103, and executing it. be able to. This display control process will be described as being started, for example, when a drawing application is executed and repeatedly executed for screen drawing of each frame. In the display control process of the present embodiment, the same reference numerals are assigned to the steps for performing the same processes as those of the display control processes of the first to third embodiments, and description thereof will be omitted. Only the processing will be described.

  In S1105, when it is determined that the undulation information includes a physical point whose constraint information is false and a dynamic element that affects the airflow information has occurred, the physics calculation module 211 determines in S1601 that the dynamic element to be applied Physics is performed based on the above, and the undulation information after application of the dynamic element is further configured. At this time, the physics calculation module 211 performs contact determination between the physical point or bone included in the undulation information and the three-dimensional object, and increases the physical point of the undulation information as necessary so as not to intersect with the three-dimensional object. Configure the undulation information of the state.

  If it is determined in S1501 that there is a part whose drawing direction is to be changed, the drawing direction change module 221 determines a matching drawing direction for each part whose drawing direction is changed in S1602. In the display control process of this embodiment, since application of dynamic elements is also taken into consideration, when the undulation information is changed, the front direction at each physical point may also change. That is, each physical point of the undulation information has a front direction defined in the same direction as the reference vector when the extended two-dimensional object is in a reference posture and is in a static state. When rotation around a parent joint or movement of a physical point of a child occurs due to posture change or application of a dynamic element, the front direction at the target physical point changes. In other words, when a dynamic element is applied, an effect such as so-called “twist” occurs in the undulation (three-dimensional shape formed by physical points and bones) indicated by the undulation information.

  For this reason, in the drawing application of this embodiment, the matching drawing direction for the part whose drawing direction is to be changed is not limited to the positional relationship in the three-dimensional space between the root joint and the physical point, but also the posture change at the physical point is considered. Then, the alignment drawing direction is determined.

  In addition, in S1503 and S1504 or S803, each vertex of the flat object to which each mesh is applied is set in a state related to the reference drawing direction or the matching drawing direction in which the mesh shape and the depth order of each part of the extended two-dimensional object are determined. If the position value and the depth value in the depth direction are tentatively determined, the shape changing module 212 deforms the mesh shape based on the derived change information and the plane shape of the flat object to which the mesh is applied in S1603. At this time, the weight distribution with respect to each vertex of the mesh generated before execution of the deformation is generated based on the mesh related to the matching drawing direction for the parts whose drawing direction has been changed.

  In this way, depending on the application of dynamic elements to relief information, the avoidance of interference between the extended 2D object and the 3D representation accompanying the application of dynamic elements, and the positional relationship with the viewpoint In addition, it is possible to present a screen showing a suitable drawing expression of the extended two-dimensional object in which the dynamic change of the drawing direction is realized in combination.

  For example, according to the above composite aspect, even in the following aspect, it is possible to realize a rendering expression desired by the designer. As shown in FIG. 17A, consider a mode in which a viewpoint 1701 facing the character top is set from the upper front when applying a “bow” motion to a character drawing object. In the configuration of the embodiment 2+ modified example, the group of parts of the extended two-dimensional object is deformed into a mesh shape as shown in FIG. When applied to a plate object 1703 having a shape along the undulation information 1702 as shown in FIG. 17 (b), as shown in FIG. That is, the flat object 1704 to which the mesh of the back hair part is applied is in a state where the y component does not spread in the drawing direction facing the top of the head, but the vertex position is changed in consideration of the dynamic element, Since it is enlarged in the canvas plane and the depth value is determined based on the undulation information 1702, it is presented in a state in which the drawing expression of the hair ends is lost. On the other hand, when the configuration of the third embodiment is further included, the alignment drawing direction corresponding to the physical point of the undulation information 1702 is set for the back hair part, so that the extension 2 as shown in FIG. A drawing expression in which the reference posture of the dimensional object is looked down from the upper front can be reflected in the mesh of the part. As a result, even if it is applied to the plate object 1703 having a shape along the undulation information 1702, as shown in FIG.

[Other Embodiments]
The present invention is not limited to the above-described embodiment, and various changes and modifications can be made without departing from the spirit and scope of the present invention. Further, the program according to the present invention can be provided / distributed by being recorded on a computer-readable recording medium or through a telecommunication line.

  100: PC, 101: control unit, 102: recording medium, 103: memory, 104: drawing unit, 105: display control unit, 106: operation input unit, 110: display unit, 201: drawing direction setting module, 202: position Shape determination module, 203: undulation application module, 204: arrangement module, 205: drawing module, 211: physical operation module, 212: shape change module, 221: drawing direction change module, 222: correction module

Claims (15)

A first type of drawing object that realizes a three-dimensional expression by a group of parts each composed of a two-dimensional image on a computer, and changes the shape and depth order of the parts group according to the drawing direction. Thus, a program that arranges and draws a first type of drawing object that realizes a three-dimensional representation of the direction and a second type of drawing object that defines a three-dimensional shape in a three-dimensional space. There,
The program is
For the first type of drawing object, a process for determining a drawing direction in which the object is drawn based on an arrangement position of the object in the three-dimensional space and viewpoint information indicating a viewpoint for drawing;
A process of changing the shape and depth order of each part constituting the drawing object of the first type according to the determined drawing direction;
A flat plate object having a plane orthogonal to the depth direction from the viewpoint toward the arrangement position of the drawing object of the first type, the two-dimensional image of each part constituting the drawing object of the first type having been changed To apply the first type drawing object in the three-dimensional space,
A process of arranging the second type of drawing object in the three-dimensional space;
A process of drawing the first type of drawing object and the second type of drawing object arranged in the three-dimensional space based on the viewpoint information;
To the computer ,
The process of arranging the first type of drawing object is based on undulation information including position information in the three-dimensional space associated with at least a part of the first type of drawing object. A program including a process of deforming the flat object to which the two-dimensional image of the part is applied.   The program according to claim 1, wherein the planar object deformed based on the undulation information does not change a surface shape in the depth direction before and after the deformation. The posture of the first type of drawing object is set so that the drawing object rotates around a reference point that determines an arrangement position of the object in the three-dimensional space,
3. The drawing direction according to claim 1, wherein the drawing direction is determined based on a positional relationship between the viewpoint and the reference point and a rotation amount of the first type of drawing object at the reference point. program. The program further causes the computer to execute a process of changing the state of at least one part constituting the first type of drawing object by applying a dynamic element,
The program according to claim 3, wherein the undulation information is changed by application of the dynamic element.   The process of changing the shape and depth order of each part constituting the first type of drawing object is associated with the undulation information according to the change of the undulation information by application of the dynamic element. The program according to claim 4, further comprising a process of changing at least one of a shape of a part and a depth order. The undulation information is information on a point group in which a relative position with respect to the reference point in the three-dimensional space is determined for the first type of drawing object in a state where the dynamic element is not applied, and Consists of binding information for binding the point cloud,
The position in the three-dimensional space of each point of the point group in a state where the dynamic element has been applied is the position of the reference point, the movement caused by the application of the dynamic element to the point, and the point. 6. The program according to claim 4, wherein the program is determined on the basis of the binding information relating to binding with a broken point. The point group is a joint group sequentially connected from the reference point through the bone indicated by the binding information,
Each joint is associated with information as to whether or not to maintain a relative position with respect to the reference point regardless of whether or not the dynamic element is applied to the first type of drawing object,
The program according to claim 6, wherein the change of the undulation information by the application of the dynamic element is performed on a joint associated with information that the relative position with respect to the reference point is not maintained.   The determination of the position of each joint in the three-dimensional space in a state where the dynamic element is applied is performed in order from a joint having a small number of bones existing between the reference point in the binding order. The program according to claim 7.   The program according to claim 7 or 8, wherein a position in the three-dimensional space of each joint in a state where the dynamic element is applied is determined based on a physical operation.   10. The position of each joint in a state where the dynamic element is applied is determined so as not to intersect with the second type of drawing object. The program according to item 1.   By determining the position of each joint in the state where the dynamic element is applied in the three-dimensional space, when any bone intersects the drawing object of the second type, a new one is added to the bone. The program according to claim 10, wherein a joint is added and the undulation information is changed so as not to intersect with the second type of drawing object.   The deformation of the flat object based on the undulation information is performed on the joint or bone closest to each vertex defined for the applied two-dimensional image when the flat object is placed in the three-dimensional space. The program according to any one of claims 7 to 11, wherein the program is executed by changing a depth value of the vertex in the depth direction according to a position of the point in the three-dimensional space.   The process of changing the shape and the depth order of each part constituting the first type of drawing object includes a process of changing the shape of the part according to the distance from the viewpoint. The program according to any one of 1 to 12. Each is a first type of drawing object that realizes a three-dimensional expression with a group of parts each composed of a two-dimensional image, and by changing the shape and depth order of the parts group according to the drawing direction, A drawing method in which a first type of drawing object that realizes a three-dimensional representation of the direction and a second type of drawing object that defines a three-dimensional shape are arranged and drawn in a three-dimensional space. ,
A determination step of determining a drawing direction in which the object is drawn based on a placement position of the object in the three-dimensional space and viewpoint information indicating a viewpoint for drawing the drawing object of the first type;
A change step of changing the shape and depth order of each part constituting the first type of drawing object according to the drawing direction determined in the determining step;
A two-dimensional image of each part constituting the first type of drawing object changed in the changing step is a plane orthogonal to the depth direction from the viewpoint toward the arrangement position of the first type of drawing object. A first placement step of placing the first type of drawing object in the three-dimensional space by applying to a flat object having;
A second arrangement process of arranging the second type of drawing object in the three-dimensional space;
A drawing step of drawing the first type of drawing object and the second type of drawing object arranged in the three-dimensional space based on the viewpoint information;
Have
The first placement step is based on undulation information including position information in the three-dimensional space, which is associated with at least some of the parts constituting the first type of drawing object. A drawing method comprising a step of deforming the flat object to which an image is applied.   The computer-readable recording medium which recorded the program of any one of Claims 1 thru | or 13.