JP2016122297A - Modeling system, modeling program, and modeling method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To create/edit freely a high-definition realistic 3D model with a simple operation without requiring a high level of skill or experience.SOLUTION: A modeling system for generating and editing modeling data on an avatar with a predetermined three-dimensional shape defined on a virtual space includes: a part generation section 312 which forms skeleton data by connecting multiple pieces of bone data defined by predetermined two points on the virtual space, groups skin data associated with the skeleton data and defining an external surface of an object with a polygon, according to a positional relationship, to generate part data by group; a motion management section 311 which generates information on a motion of the part data, as motion control data; and a dataset generation section 313 which stores the part data and the motion control data in a dataset according to a hierarchical structure based on the positional relationship thereof, to generate modeling data.SELECTED DRAWING: Figure 11

Description

  The present invention relates to a modeling system and a modeling program for generating and editing modeling data related to an avatar in which a predetermined three-dimensional shape is defined in a virtual space.

  Conventionally, in the field of computer graphics, when creating a 3D model in a virtual space, a technique using a bone structure called a skeleton configured by connecting bones by joints has been adopted. More specifically, first, skeleton data composed of a number of bones and a number of joints is built inside a three-dimensional model composed of polygons. Next, the skin, muscle, hair, face, and the like of the 3D model such as the human body are created with polygons associated with the skeleton data. Specifically, it is necessary for the skin to create control information for polygons that are deformed in conjunction with a bone structure generally called a weight.

  In recent years, in the fields of video games, Internet games, and the like, a form in which a user creates a 3D model, a so-called “avatar”, to become his or her own character and participates in a game or a service via this avatar is becoming widespread. For this avatar, it is required that the user freely design the face and style by changing the shape of the face and the color and shape of the parts such as eyes and nose (see, for example, Patent Document 1).

JP 2002-92641 A

  However, in order to edit a part as a strict 3D model, for example, when a person's model or a partial part is changed, not only the bone structure related to the part but also muscles for moving the part, The accompanying information such as operation control needs to be changed, and in some cases, the weight needs to be re-edited. Since such work is complicated, it is not only time-consuming but also requires a wealth of experience.

  For this reason, conventionally, when a user freely edits an avatar, a facial part or the like is set as two-dimensional data and is pasted on the surface of the 3D part of the facial part to make it pseudo 3D. However, in recent years, 3D video has become more refined, and there is an increasing demand for a system that can create a more realistic avatar by a simpler operation.

  Therefore, the present invention solves the above-described problems, and a modeling system capable of freely creating and editing a more detailed and realistic 3D model with a simple operation without requiring advanced skills and experience. An object is to provide a modeling program and a modeling method.

In order to solve the above problems, the present invention is a modeling system for generating and editing modeling data related to an avatar in which a predetermined three-dimensional shape is defined in a virtual space,
A plurality of bone data defined by two predetermined points in the virtual space are connected to form skeleton data, and skin data associated with the skeleton data and defining the outer surface of the object by polygons is defined according to the positional relationship. A parts generation unit that groups and generates part data for each group;
An operation management unit that generates information on the operation of each part data as operation control data;
A data set generation unit that stores part data and motion control data in a data set according to a hierarchical structure based on a mutual positional relationship and generates modeling data is provided.

Another invention is a modeling method for generating and editing modeling data related to an avatar in which a predetermined three-dimensional shape is defined in a virtual space,
(1) A plurality of bone data defined by two predetermined points on the virtual space are connected to form skeleton data, and skin data that is associated with the skeleton data and defines the outer surface of the object by polygons, A part generation step for grouping according to the positional relationship and generating part data for each group;
(2) an operation management step of generating weight data defining the degree of influence of each bone data on the skin data, and information relating to the operation of the part data as operation control data;
(3) A data set generation step of storing the part data and the motion control data in a data set according to a hierarchical structure based on a mutual positional relationship, and generating the modeling data.

  According to these inventions, each part (body, head, eyes, nose, mouth, etc.) constituting an avatar that is a three-dimensional shape in a virtual space is grouped according to the positional relationship, and part data and By doing so, the user can freely create an avatar of a desired design by selecting an arbitrary part by a simple operation of selecting and reading replacement part data. At this time, the necessary information such as the skeleton data that is the skeleton of the avatar, the consistency with the skin data that is the polygon that is the skin and the costume, and the motion control data that is necessary for the animation are based on the mutual positional relationship. Since it is stored in a data set having a hierarchical structure, a desired avatar can be created without requiring complicated work.

  In the above invention, any part data and operation control data corresponding to the part data are acquired as replacement data, and the part data and operation control data corresponding to the acquired replacement data are modeled for replacement. The data is selected from the data, the selected part data is cut out from the data set, and the replacement topology data, which is the information related to the data structure of the part data included in the replacement data, is acquired and is subject to replacement The basic data acquisition unit that acquires basic topology data, which is information related to the data structure of the modeling data, and the comparison topology data and basic topology data are compared, and based on the comparison result, the part data extracted by the part selection unit Related motion control data or exchange Operation control data in use data can be further provided a parts exchange processing unit to read by selecting.

  In this case, for example, the information included in the base model that is the basis for cutting out the parts is acquired as replacement data, or the replacement data prepared in advance is acquired and the modeling data to be replaced is obtained. Cut out the part data of the part corresponding to the replacement data from a certain base model, compare the cut out part data with the replacement data, and select the necessary information from either the base model or the replacement data. By extracting and combining, a new avatar in which arbitrary parts are exchanged can be created.

  Specifically, information related to the data structure of the modeling data, such as the relative positional relationship to the skeleton data, the polygon configuration, and the motion control data required for animation, is read as topology data. At that time, the newly loaded replacement topology By comparing the data with the basic topology data of the base model, the base model topology is used for information that is consistent with the base model, and the topology of the newly read part is used for different information. An avatar that reflects the characteristics of the new part can be created while maintaining consistency with the new part.

  In the above invention, based on the user operation, any part data is selected from the modeling data to be edited, and the selected part data and operation control data corresponding to the part data are set as data for editing. A part selection part to be cut out from the part, a part editing part for changing the part data or the operation control data included in the editing data, and an editing topology data which is information on the data structure of the part data included in the editing data In addition, the basic data acquisition unit that acquires basic topology data, which is information related to the data structure of the modeling data to be edited, is compared with the editing topology data and basic topology data, and based on the comparison result, the part selection unit For part data cut out by Operation control data, or it can further include a parts exchange processing unit to read by selecting the operation control data in the edit data.

  In this case, for example, the information included in the base model that is the basis for cutting out the parts is acquired as editing data, or the editing data prepared in advance is acquired and the modeling data to be edited is used. The part data corresponding to the editing data is cut out from a certain base model, and the cut-out part data is changed. Compare the cut-out part data with the new editing data that has been changed, select and extract the necessary information from either the base model or the editing data, and combine them into any part. You can create a new edited avatar.

  In the above invention, the polygon data included in an arbitrary part in the data set is compared with the polygon data of a part higher in the hierarchical structure to determine whether the coordinates of the vertices included in each polygon data match or not. It is possible to further provide a stitching portion that makes the matching vertices identical.

  In this case, when assembling a replacement part to the base model, by rendering the polygon vertices included in the joined parts identical to each other with the same coordinates, useless rendering when displaying graphics Can be omitted, the processing speed can be increased, and operation control for unnecessary vertices can be omitted, reducing the probability of polygon inconsistencies when parts are replaced. can do.

  By using the above modeling program, the above-described modeling system can be realized in various information processing apparatuses without requiring a special processing apparatus. That is, by installing this modeling program on a general-purpose computer or IC chip and executing it on the CPU, a modeling system having the above-described functions can be easily constructed. This program can be distributed through a communication line, for example, and can be transferred as a package application that operates on a stand-alone computer. Such a modeling program can be recorded on a computer-readable recording medium, and the above-described system and method can be implemented using a general-purpose computer or a dedicated computer. Storage, transportation and installation can be performed easily.

  As described above, according to the present invention, in generating and editing modeling data related to an avatar in which a predetermined three-dimensional shape is defined in a virtual space, a more detailed and realistic 3D model can be converted into an advanced skill. You can create and edit freely with simple operations without requiring any experience.

It is explanatory drawing which shows the starting screen of the modeling program which concerns on embodiment. It is explanatory drawing which shows the hierarchical structure of the modeling data in the modeling program which concerns on embodiment. It is a flowchart which shows the procedure of the modeling method which concerns on embodiment. (A) It is explanatory drawing which shows the skeleton data which concern on embodiment, (b) is explanatory drawing which shows a body part. (A) It is explanatory drawing which shows the decorative part which concerns on embodiment, (b) is explanatory drawing which shows the state which combined the decorative part with the body part. (A) It is explanatory drawing which shows the body part which concerns on embodiment, (b) is explanatory drawing which shows a head part. (A) It is explanatory drawing accompanying the head part which concerns on embodiment, (b) is explanatory drawing which shows the state which incorporated the eye part in the head part. In the modeling method which concerns on embodiment, it is explanatory drawing which shows the procedure which cuts out parts of eyes and a mouth from head parts. It is explanatory drawing which shows the state which visualized Skin_Weight data in the modeling method which concerns on embodiment. It is a conceptual diagram which shows the whole structure of the modeling system which concerns on embodiment. It is a block diagram which shows the internal structure of the modeling production | generation server which concerns on embodiment. It is a block diagram which shows the internal structure of the modeling delivery server which concerns on embodiment. It is a block diagram which shows the internal structure of the user terminal which concerns on embodiment.

  Exemplary embodiments of a modeling system, a modeling method, and a modeling program according to the present invention will be described below in detail with reference to the accompanying drawings. In the present embodiment, the modeling system is a system that generates and edits modeling data related to an avatar in which a predetermined three-dimensional shape is defined in a virtual space, and is constructed by executing the modeling program of the present invention.

(Outline of modeling system and modeling program)
The modeling system according to the present embodiment is realized by installing and executing the modeling program according to the present embodiment on a general-purpose computer such as a personal computer or a server device. FIG. 1 is an explanatory diagram showing a startup screen of a modeling program according to the present embodiment.

  This modeling program is a program for generating and editing modeling data related to an avatar in which a predetermined three-dimensional shape is defined, such as a human being, an animal, and a robot, and an avatar A1 is displayed on the right side of the screen 10 as shown in FIG. In addition, GUIs 101 to 103 for performing operations on the avatar A1 are arranged.

  The avatar A1 is roughly divided into a head part P1 and a body part P2. The head part P1 is accompanied by a hair part P11 and an eye part P13, and the body part P2 is a decorative part such as clothes or shoes. P3 is attached. Then, by operating the GUIs 101 to 103, replacement of the above-described parts, replacement of body parts such as hair, change of the size or shape of the avatar parts such as the whole body of the avatar, the chest and the face (morphing), eyes Changes such as color (texture replacement) can be made.

  In the present embodiment, modeling data relating to the avatar is configured by storing part data and motion control data in a data set according to a hierarchical structure 100 based on a mutual positional relationship on the body as shown in FIG. Yes. This data set is stored in a predetermined file format (for example, FBX format), and the texture to be pasted on the surface of each part is stored in an image file format. For this texture, one image file is associated with each part. If a plurality of textures are used, they are integrated into one image file.

(1) Parts data The parts data is the bone data of the human body and the character's head and eyes in addition to the skin data that forms the outer surface around the bone data of each part of the human body (excluding the head in this embodiment). Polygon data, etc. that do not have a direct relationship with are grouped according to the relative positional relationship, and are one element of a data set that is grouped as an avatar part for each group, and are handled as a single object in the virtual space . The modeling data of the present embodiment is composed of polygon data as well as the body skin data in addition to the parts such as the head and eyes, and the polygon data is triangular polygons or square polygons. The number of vertices of the polygon is set to 42,000 or less.

  In this embodiment, as shown in FIG. 4B, the head part and the body part are roughly divided, and the head part mainly includes polygon data having no direct relationship with bone data. The body part has skin data that forms the outer surface around bone data as the main data element. In each part, the shape of the part in the minimum state, the median state, and the maximum state is created and stored as a set so as to predetermine the deformable range.

(2) Skeleton data Bone data is data that is defined by two predetermined points in the virtual space and has a predetermined length and serves as an avatar bone. As shown in FIG. A plurality of data B1 to 242 are connected to form skeleton data that is a skeleton of the avatar. The bone data includes joint data corresponding to joints at both ends thereof, the master-slave relationship of the connected bones is determined by this joint data, and the relative movement range of the subordinate bones with respect to the parent bone is defined.

  The skin data (polygon data) of each part is determined by the coordinates of each vertex according to the relative position with the skeleton data, either directly or indirectly through other parts, depending on the movement of the bone in the skeleton data. Each vertex of the skin data (polygon data) is also moved. For example, the body parts below the neck of the avatar contain skeleton data, and the head part above the neck and the parts such as the eyes, nose and mouth associated with the head are only relative to the bone data of the neck. The association with the skeleton data varies depending on the part characteristics.

(3) Skin data In this embodiment, skin data is associated with one or a plurality of bone data, such as body parts, and the outer surface of an object (including parts and avatars themselves) is displayed. Polygon data to be defined. Specifically, it is polygon data having a polyhedral shape defined by a large number of vertex coordinates, and each vertex coordinate defines a relative positional relationship with respect to predetermined bone data and a relative movement range.

  The polygon data forming each part or avatar is defined by topology data, and the way of assembling (mesh structure including the number of vertices, the arrangement order, and the structure of edges connecting the vertices) is defined.

(4) Motion control data (Skin_Weight data and Blend_Shape data)
The motion control data is not directly related to the bone data such as the weight data (Skin_Weight data) that defines the degree of influence on the skin data associated with each bone data, or the head and eyes. And information (Blend_Shape data) on the operation of the part data whose operation is indirectly defined. Skin_Weight data is mainly data for controlling the movement of the avatar's body, and Blend_Shape data is data for controlling the movement of the face part and each part associated with the face. Such motion control data is stored or associated in a data set according to a hierarchical structure based on the mutual positional relationship together with the part data, and constitutes modeling data.

(Outline of modeling method)
Next, the modeling method in this embodiment will be described in detail. FIG. 3 is a flowchart showing the procedure of the modeling method according to the present embodiment.

(1) Initialization process Various data is initialized at the start of avatar creation / variation work. First, an FBX file and a texture file in which all parts are stored are read (S101). The hierarchical level of each part is acquired from the data set included in the read file (S102), and the parent ID of each part is acquired. The parent ID is an ID for identifying a part located at an upper level in accordance with the hierarchical level. The master-slave relationship and the positional relationship of each part are determined by the parent ID.

  Next, the number of vertices of the skin data (polygon data) of each part is acquired, the vertices are compared for the polygon data of the corresponding part of the base model, and the same coordinates are calculated for each vertex (S105). That is, the coordinates of the vertices of the parts having the same coordinates as the vertices of the body parts of the base model are searched, and the number is counted. At this time, if the coordinates match, they are counted as the same vertex, and if they do not match, they are counted as different superpoints.

  Next, parts that can be replaced and parts that have overlapping parts are registered (S106 and S107). More specifically, if the number of different vertices is less than or equal to the threshold according to the number of coincidence / non-coincidence performed in step S105, it is regarded as the same as the part of the base model, and “same” for the part. If there is a “same” vertex as the body part of the higher hierarchy (parent) for each vertex of the body part of the base model, it is registered as “Replacement”. On the other hand, if some vertices of the body part exist as “same vertex”, the vertex is registered as “sewing”. If the lower body part (child) body part has a blank with respect to the parent body part, “Connect” is registered for the connection process described later.

(2) Input calculation of each frame of animation For the part model, the morphing size parameter, the topology of the selected part, and the animation file (joint data, Blend_Shape data) are read. The animation data may not be acquired in a file format, and may be a method in which data is sequentially acquired by streaming distribution, for example.
Then, it is determined whether or not there is a change in the part or topology (S108). If there is a change, the process proceeds to step S109, and if there is no change, the process proceeds to replacement of the part without deformation (S112).

(3) Part Connection In the above step S109, Blend_Shape data is calculated and applied to all topologies and mutations. Specifically, Blend_Shape data defines the amount of movement for all vertices of each topology, and the position of the new vertex is calculated by the following equation.

  Next, deformation by morphing and change by size change are executed (S110 and S111). Specifically, the amount of deformation and the size are determined by the value input by the user. At this time, the size of the part attached to the part whose size has been changed is also changed. For example, when the size of the head is increased, the size of parts such as eyebrows attached to the head is also increased.

  In particular, in this morphing, the vertex, line, face and body motion control data (Blend_Shape data, Skin_Weight data) of each part is interpolated between the maximum model and the minimum model so that it can be smoothly scaled. To do. Specifically, after executing the Blend_Shape data calculation process, if the model is mp, t, k, the variant group is Gp, t, g = {mp, t, k0, ..., mp, t, kn}. Here, p is a part number, t is a topology, k is a deformation amount (user is input), and g is a group number.

  For each deformation group, when the deformation amount is input by the user operating the slider, for example, Sp, t, g are acquired as slider values. Here, it is assumed that the slider value is Sp, t, gε [0, n]. Where n is a variant group number.

The above interpolation uses linear interpolation and linearly interpolates between coordinates. It is obtained by the following equation of this interpolation process.
Here, r∈ {0,..., N}, and r ≦ Sp, t, g <r + 1. For all vertices, calculate new vertices according to the following formula.

Further, as described above, the processing when changing the size of the part accompanying the part whose size has been changed is as follows.

  For example, when the eyebrows when the head is enlarged is enlarged together, if the vertex coordinates are moved by calculation or morphing of Blend_Shape data, the shape is different from the original shape. As a result, twisting may occur in the 3D space. In the present embodiment, the twist that occurs during the size change is corrected by the following method.

First, let δva, i be the movement from the original coordinates of the vertex vpi of body part p to the coordinates after morphing. If A is the set of parents of all body parts p, the new vertex is calculated as follows:
In the original position, neither movement based on Blend_Shape data nor movement due to morphing is assumed.

  Next, part replacement is executed (S112), and then the vertex coordinates are copied to the same coordinates as the upper (parent) part, Stitching is executed (S113), and the child parts are sewn together. Thereafter, an optimization process (Global optimization) is executed to smoothly change the mesh.

  In the above part replacement (Replacement), when the user performs part replacement, stitching processing (Stitching) is automatically executed. In this replacement, the same vertices in the skin data of the base model and the replacement part are replaced.

  Also, in the above stitching process (Stitching), when the user replaces the parts, the outline that is the outer edge of the cut-out skin data and the outline corresponding to the outer edge on the base model side are overlapped, compared, and stitched. Do. At this time, only the vertices included in the replacement part are employed in order to eliminate unnecessary rendering.

  When the coordinates of the outline of the part to be exchanged differ from the outline described above, the Connect process is performed in which a vertex and an edge are generated and connected. Specifically, for each vertex vcoi on the outer edge (Outline) of the lower part, the closest vertex of each vertex vaoj on the outer edge (Outline) of the upper part is calculated. At this time, using KNN, if the distance is closer than a certain threshold with respect to the k nearest vertices vaoj, a vertex is generated between them. New vertices are generated until the interval between the newly generated vertices becomes smaller than the threshold value, and the generated vertices are connected by lines so as to form a triangle.

  Thereafter, the parameter of the operation control data is duplicated (S114). More specifically, the value of Blend_Shape data, which is a parameter for moving the face part, is duplicated from the corresponding part of the base model. At this time, when the topology is the same as the base part, the Blend_Shape data of the base model is used as it is, and when the topology is different, the Blend_Shape data of the part is used. Along with the duplication of Blend_Shape data, Skin_Weight data, which is a parameter for moving the body, is duplicated from the corresponding part of the base model. At this time, if the topology is the same as the base part, the Skin_Weight data of the base model is used as it is, and if the topology is different, the Skin_Weight data of that part is used.

  If the completed avatar has an operation operation for animation (“Y” in S115), the avatar is moved (S116), and finally the stitched parts, parameters, etc. are made into one full model as an FBX file. (S117).

(How to create replacement parts)
A method for creating a replacement part used in the modeling method described above will be described in detail below.

  First, in order to prepare parts, a base model is created. The base model is a full model of the avatar that is the basis of the replacement part to be created, and the replacement part is created by modifying the part cut out from the base model. The full model is basic data including all elements necessary for movement such as skeleton data, motion control data (Skin_Weight data, Blend_Shape data), topology data such as a mesh structure.

  Multiple types of this base model can be created, and common skeleton data is always introduced to all base models, and joint data and smoothing connections that define the necessary master-slave relationship of the bones are included in the common skeleton. Smooth Bind data has been set by the process, and adjustment of skin data for the common skeleton has been completed.

  Next, a part to be changed is cut out from the full model, and a new shape is created based on the cut out part. At this time, the topology may or may not be the same. The cut-out parts are placed in a hierarchical structure to show where the parts are attached (eg, the eyes are parts attached to the face).

The following describes how to cut out parts related to each part of the avatar for each part.
(1) Cut out parts from base model ○ Cut out skeleton (create master skeleton)
A skeleton data of a necessary part as shown in FIG. 4A is cut out from the base model, and a master skeleton common to each part used when creating the part is created.

Cut out skin data Select and cut out a predetermined part as a part from the base model, and create part data for replacement. The data name of each created part is given according to a predetermined rule.

  For each part created here, the shape of the parts in the minimum state, median state and maximum state is created as a set so as to predetermine the deformable range, and each data name is also the minimum, The name is such that the state of the deformation amount such as the maximum can be understood, and when other features or the associated topology data are changed, the name is given so that it can be understood.

  Topology data corresponding to the cut-out part is created. Regarding the generation of this topology, the topology of the base model and the topology of the cut out deformed part must match, so no vertices or edges are added to the skin data of the cut out part. The base model is copied and the vertex is moved, and a necessary part of the base model topology is duplicated to create a deformed part topology.

○ Extraction of body part As shown in FIG. 4 (b), the body part (Body) excluding the head is handled as a group of "body parts". At this time, Body performs the process in a naked state with other parts such as clothing removed. Cut out clothing separately.

  For clothing parts as shown in FIGS. 5 and 6A, polygons other than the Body are cut out and created as Cloth. At this time, a polygon of the clothing shape (common to the topology) is separately prepared and read together with the body weight data, and the body weight data is applied to the clothing polygon. After that, delete the Body polygon and save only the Cloth as a clothing part. For clothing having different topologies, file names including names of different topologies are attached to the clothing parts, and the topology and clothing parts are associated with each other.

Cut out face part For the face part as shown in FIG. 6B, all polygon groups in the skin data associated with the Blend_Shape data are cut out from the base model as outline parts of the face part. Use as a part. Specifically, “Parentization” is performed for defining the master-slave relationship under the neck joint of the common skeleton with the polygon group including Blend_Shape data. At this time, only Parenting for the Neck joint is performed.

Cutting out each part from the face Next, as shown in FIG. 7, each part such as eyes and mouth is cut out from the face.

  Perform separation processing (Separate) from the necessary polygon group of FBX, and cut out the eye area. Here, the group information of the polygons constituting the part and the transform information are maintained. If the cut-out part has the same name as the polygon used in the base model, the polygon name is appropriately changed.

  Specifically, the eye area is cut out by extracting group polygons associated with the Blend_Shape data of the face and polygons included in the area to be cut out. In this extraction process, a Face group in which Blend_Shape data is set is selected, and a separation process (Separate) is performed.

  In order to extract skin data (faces) related to the eyes, first, as shown in FIG. 8, in the face part, apexes at the outer edge of the area to be cut out are taken as edges (Outline), and unnecessary face polygons around the edges are extracted. Is deleted. Further, separation processing (separate) is performed to extract the face of the eye, and the name of the extracted face polygon part is changed to a unique polygon name (for example, EyeLeftFace). Here, the unique polygon name is a name that does not overlap with polygon names in other files when reading a plurality of FBX files.

  Then, a median model (Base model), maximum model, and minimum model of the extracted EyeLeft and EyeRight are created. Specifically, first, the created EyeLeft.mb is read, the polygon to be enlarged / reduced is selected, and moved in the direction of enlargement / reduction. At this time, the transformation information when the Face polygon (group) used for the processing based on the Blend_Shape data is separated is maintained. The maximum model and the minimum model are created without changing the polygon configuration. In addition, the polygon (Outline) located at the outer edge that is the cut end is not deformed.

Next, the textures used for the eyes are integrated into one sheet.
After that, UV development is performed. Specifically, read the master skeleton, create joint data (master-detail relationship and movable range) for the neck part (Neck joint) or the bone that follows the neck (EyeLeft joint), and if necessary, combine processing Run.

○ Extracting the mouth and nose from the face When changing the shape to create different parts, the outline is not changed, and only the polygon inside the edge is deformed. If you change the topology (number of vertices), do not change the outline shape.

  The process of combining the parts prepared in this way is performed according to the following procedure. First, the face and body parts are each independently morphed (smoothly connected between the maximum and minimum). Next, the parameters for moving the face (Blend_Shape data value) are copied from the corresponding parts of the full model that is the base, and the parameters for moving the body (Skin_Weight data) are the full model that is the base of the part Copy from. At this time, the topology may be different.

  Then, based on the user operation, the parts selected by the user are exchanged. At this time, the stitching process is automatically executed for the replaced parts. If necessary, optimize the entire body.

(Modeling system structure)
Next, FIG. 3 is a conceptual diagram showing the overall configuration of the modeling system according to the present embodiment. In the present embodiment, the modeling system is a system that generates and edits modeling data related to an avatar in which a predetermined three-dimensional shape is defined in a virtual space. Connected to the communication network 5 are a user terminal 1 possessed by a user, a modeling generation server 3 that generates modeling data, and a data distribution server 2 that stores and distributes the modeling data generated by the modeling generation server 3. Yes.

  The communication network 5 is an IP network using the communication protocol TCP / IP, and various communication lines (public lines such as telephone lines, ISDN lines, ADSL lines, optical lines, private lines, wireless communication networks) are mutually connected. It is a distributed communication network constructed by connecting. The communication network 5 includes a LAN such as an intranet (in-house network) or a home network based on 10BASE-T, 100BASE-TX, or the like.

  The user terminal 1 and the manager terminal 3 are arithmetic processing units equipped with a CPU, and can be connected to a communication network such as the Internet 5 by a communication function. The display information is received and displayed by browser software or the like. In addition, it has a function of transmitting a user operation signal. The information terminal can be realized by a general-purpose computer such as a personal computer or a dedicated device with a special function, and includes a mobile computer, a PDA (Personal Digital Assistance), and a mobile phone.

  The modeling generation server 3 is a server device that generates and manages modeling data in accordance with an operation of the system administrator, and can be connected to an information processing terminal possessed by the system administrator. The modeling data generated in the modeling generation server 3 is transmitted to the data distribution server 2.

  The data distribution server 2 is a server device that controls user management, distribution of modeling data, and the like. The data distribution server 2 includes a Web server, and a server computer that transmits information such as an HTML (HyperText Markup Language) file, an image file, or a music file in a document system such as WWW (World Wide Web) or the like. It is a functional software that stores modeling data and other information in the modeling database 2a, accepts modeling editing operations according to the requirements of applications executed on the user terminal 1, and performs modeling after editing. Data is distributed to the user terminal 1.

(Internal structure of each device)
Next, the internal structure of each device constituting the above-described modeling system will be described. FIG. 11 is a block diagram showing the internal configuration of the modeling generation server 3 according to this embodiment, FIG. 12 is a block diagram showing the internal configuration of the modeling distribution server 2 according to this embodiment, and FIG. It is a block diagram which shows the internal structure of the user terminal 1 which concerns on this embodiment. The “module” used in the description refers to a functional unit that is configured by hardware such as an apparatus or a device, software having the function, or a combination thereof, and achieves a predetermined operation. .

(1) Internal Configuration of Modeling Generation Server 3 First, the internal configuration of the modeling generation server 3 will be described. The modeling generation server 3 can be composed of a plurality of server groups such as a Web server and a database server in addition to a single server device. In the present embodiment, as shown in FIG. 32, a storage unit 33, and an input / output interface 34.

The storage unit 33 is a database group that accumulates various types of information related to the system, and includes a modeling database 331 here. Each database may be configured as a single database, or relationships may be set between a plurality of databases.
The modeling database 331 is a database that stores modeling data generated by the modeling generation module group 310.

  The communication interface 31 is a communication interface for performing data communication, and can be connected to the modeling distribution server 2 and an information processing terminal possessed by an administrator via the communication network 5. The input / output interface 34 is an interface connected to an information processing terminal possessed by an administrator, and an operation signal from an operation device such as a mouse or a keyboard of the information processing terminal possessed by the administrator is input as a user operation. The modeling data is displayed on the monitor of the information processing terminal possessed by the administrator.

  The control unit 32 is a computation configured by a processor such as a CPU or DSP (Digital Signal Processor), memory, hardware such as other electronic circuits, software such as a program having the function, or a combination thereof. It is a module, and various function modules are virtually constructed by appropriately reading and executing a program, and various processes for operation control of each part and administrator operations are performed by the constructed function modules. In the present embodiment, the control unit 32 includes a modeling generation control unit 310, a modeling edit control unit 320, and a modeling data distribution unit 330.

The modeling generation control unit 310 is a module group that generates modeling data, and includes a part generation unit 311, an operation management unit 312, and a data set generation unit 313.
The parts generation unit 311 forms a skeleton data by connecting a plurality of bone data defined by two predetermined points in the virtual space, and defines skin data associated with the skeleton data and defining the outer surface of the object by polygons. This is a module for grouping according to the positional relationship and generating part data for each group.
The motion management unit 312 is a module that generates weight data that defines the degree of influence of each bone data on the skin data and information related to the motion of the part data as motion control data.
The data set generation unit 313 is a module that stores part data and motion control data in a data set according to a hierarchical structure based on the mutual positional relationship, and generates modeling data.

  The modeling editing control unit 320 is a group of modules for exchanging / editing the generated modeling data. In this embodiment, the modeling editing control unit 320 edits the part of the generated modeling data and the exchange function for exchanging the parts of the generated modeling data. Editing function.

  First, the parts exchange function of the modeling edit control unit 320 will be described. As a parts exchange function, the modeling editing control unit 320 includes a parts selection unit 321, a basic data acquisition unit 322, a parts exchange processing unit 323, and a stitching unit 324.

  The part selection unit 321 obtains arbitrary part data and operation control data corresponding to the part data as replacement data, and uses part data and operation control data corresponding to the acquired replacement data as replacement targets. This is a module that selects from the modeling data and cuts out the selected part data from the data set.

  The basic data acquisition unit 322 acquires replacement topology data that is information related to the data structure of the part data included in the replacement data, and acquires basic topology data that is information related to the data structure of the modeling data to be replaced. It is a module to do.

  The parts replacement processing unit 323 compares the replacement topology data with the basic topology data, and based on the comparison result, the operation control data related to the part data cut out by the parts selection unit 321 or the replacement data in the replacement data This module selects and reads operation control data.

  The stitching unit 324 compares the polygon data included in any part of the data set with the polygon data of the part higher in the hierarchical structure, and determines whether the coordinates of the vertices included in each polygon data match or not. This is a module for identifying identical vertices.

  On the other hand, the modeling editing control unit 320 as a part editing function includes a part selection unit 321, a basic data acquisition unit 322, a part replacement processing unit 323, and a stitching unit 324.

  The part selection unit 321 selects arbitrary part data from modeling data to be edited based on a user operation, and selects the selected part data and operation control data corresponding to the part data as editing data. This module is cut out from the data set. Here, the parts selection unit 321 includes a parts editing unit 322a. The part editing unit 322a is a module that modifies part data or operation control data included in editing data.

  The basic data acquisition unit 322 generates editing topology data that is information related to the data structure of the part data included in the editing data, and acquires basic topology data that is information related to the data structure of the modeling data to be edited. It is a module to do.

  The part replacement processing unit 323 compares the topology data for editing with the basic topology data, and based on the comparison result, the operation control data related to the part data cut out by the parts selection unit 321 or the editing data in the editing data This module selects and reads operation control data.

  In addition, the stitching unit 324 compares the polygon data included in any part in the data set with the polygon data of the part higher in the hierarchical structure, and determines whether the coordinates of each vertex included in each polygon data match. Judgment is made and identical vertices are identified.

The modeling data distribution unit 330 is a module that distributes the modeling data generated by the content generation control unit 310 to the content distribution server 2 through the communication interface 31. (2) Internal Configuration of the Modeling Distribution Server 2 Next, the modeling distribution server 2 The internal structure of will be described. The modeling distribution server 2 can be composed of a plurality of server groups such as a Web server and a database server in addition to a single server device. In the present embodiment, as shown in FIG. 22 and a database 2a.

  The database 2a is a database group that accumulates various types of information related to this system, and includes a modeling database 201 and a member database 202 in this example. Each database may be configured as a single database, or relationships may be set between a plurality of databases.

  The modeling database 201 is a database that accumulates modeling data generated by the modeling generation server 3, and has a data configuration similar to that of the modeling database 331.

  The member database 202 is a database for accumulating information about customers who own the user terminal 1, and in this embodiment, a user ID (such as the IP address of the user terminal 1) and password for identifying the user terminal 1, a telephone number, In addition to personal information such as e-mail address, user name, age, gender, and address, modeling ID for identifying the created modeling data, payment information, and the like can be recorded in association with each other.

  The communication interface 21 is a communication interface for performing data communication, and can be connected to the user terminal 1 via the communication network 5.

  The control unit 22 includes a processor such as a CPU or DSP (Digital Signal Processor), a memory, hardware such as other electronic circuits, software such as a program having the function, or a combination thereof. It is a module, and various function modules are virtually constructed by appropriately reading and executing a program, and various processes for operation control of each part and administrator operations are performed by the constructed function modules. In the present embodiment, the control unit 22 includes an authentication unit 26, an operation signal acquisition unit 25, an edit control unit 23, and a modeling data distribution unit 24.

  The authentication unit 26 is a computer that verifies the legitimacy of the accessor or software having the function thereof, and executes authentication processing based on a user ID that identifies each user. In addition, the commission unit 26 has a function of processing member registration of a user who uses the system, and accepts access from the user terminal 1 to perform member registration. Specifically, the member registration unit 221 first acquires a user ID or the like for specifying the user terminal 1 and records it in the member database 231. Thereafter, when there is personal information input from the user, Information related to the user terminal 1 possessed by the user (e.g., user terminal 1 mail address, telephone number, user name, age, address, gender, payment information, etc.) is associated with the user ID in the member database 231. Can be recorded. The authentication unit 26 records a modeling ID for identifying modeling data edited by the user in association with the member database 202.

  The operation signal acquisition unit 25 is a module that receives an operation signal from the user terminal 1 and outputs a control signal corresponding to the operation signal to each unit. Based on the control signal from the operation signal acquisition unit 25, the modeling data in the modeling database 201 is distributed, or the editing control unit 23 executes editing processing of the modeling data.

  The modeling data distribution unit 24 is a module that distributes modeling data to the user terminal 1 in accordance with a user operation, and distributes the entire modeling data and part data selected by the user operation so as to be displayed on the screen of the user terminal 1. .

  The edit control unit 23 is a group of modules that accepts editing of modeling data in response to a user operation. In this embodiment, the part selection unit 231, the part editing unit 232, the basic data acquisition unit 233, and the part replacement processing unit 234 and a stitched portion 235.

  The part selection unit 231 selects arbitrary part data from modeling data to be edited based on a user operation, and selects the selected part data and operation control data corresponding to the part data as editing data. This module is cut out from the data set.

  The part editing unit 232 is a module that changes part data or operation control data included in editing data.

  The basic data acquisition unit 233 generates editing topology data that is information related to the data structure of the part data included in the editing data, and acquires basic topology data that is information related to the data structure of the modeling data to be edited. It is a module to do.

  The parts replacement processing unit 234 compares the editing topology data with the basic topology data, and based on the comparison result, the operation control data related to the part data cut out by the parts selection unit 231 or the editing data in the editing data This module selects and reads operation control data.

  The stitching unit 235 compares the polygon data included in an arbitrary part in the data set with the polygon data of the part higher in the hierarchical structure, and determines whether the coordinates of the vertices included in each polygon data match or not. This is a module for identifying identical vertices.

(3) Internal Configuration of User Terminal 1 Next, the internal configuration of the user terminal 1 will be described. The internal configuration of the user terminal 1 will be described. As shown in the figure, the user terminal 1 includes a communication interface 11, an input interface 12, an output interface 13, an application execution unit 14, and a memory 15.

  The communication interface 11 is a communication interface for performing data communication, and has a function of performing contact (wired) communication by wireless non-contact communication or a cable, adapter means, or the like. The input interface 12 is a device that inputs user operations such as a mouse, a keyboard, operation buttons, and a touch panel. The output interface 13 is a device that outputs video and sound, such as a display and a speaker. In particular, the output interface 13 includes a display unit 13a such as a liquid crystal display.

  The memory 15 is a storage device that stores an OS (Operating System), programs for various applications, other data, and the like. The memory 15 stores modeling data acquired from the modeling distribution server 2.

  The application execution unit 14 is a module that executes an application such as a general OS or browser software, and is usually realized by a CPU or the like. The application execution unit 14 communicates with the modeling distribution server 2 by executing the modeling program according to the present invention. For example, the modeling data to be edited and the part data are selected and the part data is edited. The display information corresponding to each operation is displayed on the display unit 13a.

(Modeling program)
The modeling system method according to the present embodiment described above can be realized by executing a modeling program described in a predetermined language on a computer. That is, the program according to the present embodiment is a modeling program for generating and editing modeling data related to an avatar in which a predetermined three-dimensional shape is defined in a virtual space, and
(1) A plurality of bone data defined by two predetermined points in the virtual space are connected to form skeleton data, and the skin data that is related to the skeleton data and defines the outer surface of the object by polygons is positioned. Parts generation step for grouping and generating part data for each group,
(2) an operation management step of generating weight data defining the degree of influence of each bone data on the skin data and information on the operation of the part data as operation control data;
(3) Part data and operation control data are stored in a data set according to a hierarchical structure based on the mutual positional relationship, and a process including a data set generation step for generating modeling data is executed.

In addition, this modeling program is a function for exchanging parts of modeling data.
(1) Arbitrary part data and operation control data corresponding to this part data are acquired as replacement data, and part data and operation control data corresponding to the acquired replacement data are converted into modeling data to be replaced. A part selection step for selecting the selected part data from the data set,
(2) Basic data acquisition for acquiring replacement topology data, which is information regarding the data structure of part data included in replacement data, and acquiring basic topology data, which is information regarding the data structure of modeling data to be replaced Steps,
(3) Compare the topology data for replacement with the basic topology data, and select the operation control data related to the part data extracted in the part selection step or the operation control data in the replacement data based on the comparison result. Then, a part replacement processing step to be read is further executed.

In addition, this modeling program is a function that edits parts of modeling data.
(1) Based on a user operation, arbitrary part data is selected from modeling data to be edited, and the selected part data and motion control data corresponding to the part data are selected from the data set as editing data. A part selection step to cut out;
(2) a part editing step for changing the part data or motion control data included in the editing data;
(3) Basic data acquisition for generating editing topology data, which is information related to the data structure of part data included in editing data, and acquiring basic topology data, which is information related to the data structure of modeling data to be edited Steps,
(4) Compare the topology data for editing with the basic topology data, and select the motion control data related to the part data cut out in the part selection step or the motion control data in the editing data based on the comparison result. Then, a part replacement processing step to be read is further executed.

In the above processing, the modeling program is stored in the computer.
Compare the polygon data contained in any part in the data set with the polygon data of the part higher in the hierarchical structure, determine whether the coordinates of each vertex contained in each polygon data match, and match the vertices A stitching step is performed to identify the same.

  Then, by installing this modeling program on a computer such as a user terminal or a Web server or an IC chip and executing it on the CPU, a system having the above-described functions can be easily constructed. This modeling program can be distributed through a communication line, for example, and can be transferred as a package application. Such a modeling program can be recorded on a recording medium readable by a personal computer, and the above-described system, apparatus, and server can be implemented using a general-purpose computer or a dedicated computer. The modeling program can be easily stored, transported and installed.

A1 ... Avatar B1-242 ... Bone data P1 ... Head part P11 ... Hair parts P13 ... Eye parts P2 ... Body parts P3 ... Decoration parts 2 ... Content distribution server 2a ... Modeling database 3 ... Administrator terminal 5 ... Internet 10 ... Screen 11 ... Communication interface 12 ... Input interface 13 ... Output interface 13a ... Display unit 14 ... Application execution unit 15 ... Memory 21 ... Communication interface 22 ... Control unit 23 ... Editing control unit 24 ... Modeling data distribution unit 25 ... Operation signal acquisition unit DESCRIPTION OF SYMBOLS 26 ... Authentication part 31 ... Communication interface 32 ... Control part 33 ... Memory | storage part 34 ... Input / output interface 100 ... Hierarchical structure 101-103 ... GUI
DESCRIPTION OF SYMBOLS 201 ... Modeling database 202 ... Member database 221 ... Member registration part 231 ... Parts selection part 232 ... Parts edit part 233 ... Basic data acquisition part 234 ... Parts exchange process part 235 ... Sewing part 310 ... Modeling generation module group 311 ... Part generation part 312 ... Operation management unit 313 ... Data set generation unit 320 ... Modeling editing control unit 321 ... Parts selection unit 322 ... Basic data acquisition unit 322a ... Parts editing unit 323 ... Parts exchange processing unit 324 ... stitching unit 330 ... modeling data distribution unit 331 ... Modeling database

Claims (12)

A modeling system for generating and editing modeling data related to an avatar in which a predetermined three-dimensional shape is defined in a virtual space,
A plurality of bone data defined by two predetermined points in the virtual space are connected to form skeleton data, and skin data associated with the skeleton data and defining the outer surface of the object by polygons is defined according to the positional relationship. A parts generation unit that groups and generates part data for each group;
An operation management unit for generating information on the operation of each part data as operation control data;
A modeling system comprising: a data set generation unit configured to store the part data and operation control data in a data set according to a hierarchical structure based on a mutual positional relationship, and generate the modeling data. Arbitrary part data and motion control data corresponding to this part data are acquired as replacement data, and part data and motion control data corresponding to the acquired replacement data are selected from modeling data to be replaced. , A part selection part that cuts out the selected part data from the data set,
A basic data acquisition unit that acquires replacement topology data, which is information related to the data structure of part data included in the replacement data, and acquires basic topology data, which is information related to the data structure of modeling data to be replaced When,
Comparing the replacement topology data and the basic topology data, and based on the comparison result, the operation control data related to the part data cut out by the part selection unit, or the operation control data in the replacement data The modeling system according to claim 1, further comprising a parts replacement processing unit that is selected and read. A part that selects arbitrary part data from modeling data to be edited based on a user operation, and cuts out the selected part data and operation control data corresponding to the part data from the data set as editing data. A selection section;
A part editing unit for changing the part data or the operation control data included in the editing data;
A basic data acquisition unit that generates editing topology data that is information related to the data structure of part data included in the editing data, and that acquires basic topology data that is information related to the data structure of modeling data to be edited When,
Comparing the editing topology data and the basic topology data, and based on the comparison result, the operation control data related to the part data cut out by the part selection unit, or the operation control data in the editing data The modeling system according to claim 1, further comprising a parts replacement processing unit that is selected and read.   The polygon data contained in any part in the data set is compared with the polygon data of the parts higher in the hierarchical structure, and the coordinates of the vertices contained in each polygon data are judged to match or not match. The modeling system according to claim 1, further comprising a stitching unit that makes vertices identical. A modeling program for generating and editing modeling data related to an avatar in which a predetermined three-dimensional shape is defined in a virtual space,
A plurality of bone data defined by two predetermined points in the virtual space are connected to form skeleton data, and skin data associated with the skeleton data and defining the outer surface of the object by polygons is defined according to the positional relationship. A part generation step for grouping and generating part data for each group;
An operation management step for generating information on the operation of each part data as operation control data;
A modeling program, comprising: storing the part data and operation control data in a data set according to a hierarchical structure based on a mutual positional relationship, and executing a process including a data set generation step of generating the modeling data. Arbitrary part data and operation control data corresponding to this part data are acquired as replacement data, and part data and operation control data corresponding to the acquired replacement data are determined as replacement targets based on user operations. A part selection step of selecting from modeling data to be selected, and cutting out the selected part data from the data set;
A basic data acquisition step of acquiring replacement topology data, which is information related to the data configuration of part data included in the replacement data, and acquiring basic topology data, which is information related to the data configuration of modeling data to be replaced When,
Comparing the replacement topology data and the basic topology data, and based on the comparison result, the operation control data related to the part data cut out in the part selection step, or the operation control data in the replacement data The modeling program according to claim 5, further comprising a part replacement processing step of selecting and reading. A part that selects arbitrary part data from modeling data to be edited based on a user operation, and cuts out the selected part data and operation control data corresponding to the part data from the data set as editing data. A selection step;
A part editing step for changing the part data or the operation control data included in the editing data;
Basic data acquisition for generating editing topology data, which is information related to the data structure of the part data data included in the editing data, and acquiring basic topology data, which is information related to the data structure of the modeling data to be edited Steps,
Comparing the editing topology data with the basic topology data, and based on the comparison result, the motion control data related to the part data cut out in the part selection step, or the motion control data in the editing data The modeling program according to claim 5, further comprising a part replacement processing step of selecting and reading.   The polygon data contained in any part in the data set is compared with the polygon data of the parts higher in the hierarchical structure, and the coordinates of the vertices contained in each polygon data are judged to match or not match. The modeling program according to claim 5, further comprising a stitching step for making the vertices identical. A modeling method for generating and editing modeling data related to an avatar in which a predetermined three-dimensional shape is defined on a virtual space,
Skin data in which a part generator forms a skeleton data by connecting a plurality of bone data defined by two predetermined points in the virtual space, and defines an outer surface of an object associated with the skeleton data by a polygon Parts generation step for grouping them according to the positional relationship and generating part data for each group;
An operation management step for generating information on the operation of each part data as operation control data;
A data set generation unit storing the part data and the motion control data in a data set according to a hierarchical structure based on a mutual positional relationship, and executing a process including a data set generation step of generating the modeling data. A characteristic modeling method. The part selection unit acquires arbitrary part data and operation control data corresponding to the part data as replacement data, and the part data and operation control data corresponding to the acquired replacement data are to be replaced. A part selection step of selecting from modeling data and cutting the selected part data from the data set;
The basic data acquisition unit acquires replacement topology data that is information related to the data configuration of the part data included in the replacement data, and basic topology data that is information related to the data configuration of the modeling data to be exchanged A basic data acquisition step to acquire;
The part replacement processing unit compares the replacement topology data with the basic topology data, and based on the comparison result, operation control data related to the part data cut out in the part selection step, or the replacement data The modeling method according to claim 9, further comprising a part replacement processing step of selecting and reading operation control data within the model. The part selection unit selects arbitrary part data from the modeling data to be edited based on a user operation, and the selected part data and the operation control data corresponding to the part data are used as editing data. A part selection step to cut out from the data set;
A part editing step in which the part editing unit changes the part data or the operation control data included in the editing data;
The basic data acquisition unit generates editing topology data that is information on the data structure of the part data included in the editing data, and is basic topology data that is information on the data structure of the modeling data to be edited A basic data acquisition step for acquiring
A part replacement processing unit compares the editing topology data with the basic topology data, and based on the comparison result, operation control data related to the part data cut out in the part selection step, or the editing data The modeling method according to claim 9, further comprising a part replacement processing step of selecting and reading operation control data within the model.   The stitching unit compares the polygon data contained in any part in the data set with the polygon data of the parts higher in the hierarchical structure, and determines whether the coordinates of the vertices contained in each polygon data match or not. The modeling method according to claim 9, further comprising a stitching step for identifying identical vertices.