JP4977742B2 - 3D model display system - Google Patents

Description

  The present invention provides a three-dimensional model display device that allows even a beginner to easily edit a three-dimensional model and edit and view a moving image using the three-dimensional model while maintaining harmony between the model, texture, and motion. The present invention relates to a three-dimensional model display system.

  Conventionally, communication via the Internet has been performed one-on-one, but in recent years, in a shared virtual three-dimensional space on a network, it has been performed simultaneously with a plurality of users. At this time, an avatar is used as a virtual character expressing each user.

  Avatars used in such a communication field are mainly humanoid characters. Since an avatar is used as a user-specific character, parts such as eyes, nose and mouth prepared for each part of the face used for the human character are combined by the user's operation, and the avatar resembles the user himself / herself Has been made (see, for example, Patent Document 1). In this way, a distinction has been made from avatars used by other users in a virtual three-dimensional space. On the other hand, if it is a humanoid character that represents the physical features excluding the face, in addition to the difference in physique among women, men or adults, and children, by allowing the avatar to wear clothes, Each individuality is expressed (for example, Patent Document 2).

  By the way, the constituent elements of the 3D character include a model which is solid figure information, a texture which is pattern information attached to the model, and a motion which is information defining an action path of the model. These do not exist independently but are organically related to each other. This is why it is difficult to edit 3D characters. Consider the case of editing a model. For example, in a humanoid character, only the foot length of the body is changed. Then, it is necessary to decide how to handle the texture (such as a pants pattern) mapped to the foot. This is because the texture is defined relative to a model having a predetermined size and shape, so if the size and shape of the model change, the reference for the location definition is lost. This is because the texture cannot be displayed. Similarly, when editing a model, it is necessary to decide how to handle the motion. This is because a motion defines a movement trajectory for a model having a predetermined size, a joint distance, and the like, and if the model changes, the definition target is lost. As described above, it is difficult for a 3D character to edit while maintaining harmony between the model, texture, and motion, and it is difficult for beginners to handle.

  Under such circumstances, in order to give a complex motion to a CG model such as an avatar using an input means with a simple configuration, a plurality of independent recording tracks corresponding to each joint of the model are set and each recording track is set. By setting record enable / disable information indicating whether or not recording is possible and recording time series data only on the recording tracks that are set as recordable based on the input control amount, the time series data of the joint angle is jointed. It is disclosed that additional recording is performed every time (for example, see Patent Document 3).

  In addition, in order to build a reliable item transaction involving money exchange, the purchase amount is subtracted from the cash of the player who purchased the item, and whether or not the donation flag of the player who is the seller is ON If the donation flag is ON, the donation amount corresponding to the sales amount is sent to the donation management server, and the donation management server receives this donation amount and updates it by adding it to the current donation amount. Is disclosed (for example, see Patent Document 4).

JP 2008-61896 A JP 2008-510563 A Japanese Patent Laid-Open No. 10-302085 JP 2009-050602 A

  The present invention provides a three-dimensional model display device that allows even a beginner to easily edit a three-dimensional model and edit and view a moving image using the three-dimensional model while maintaining harmony between the model, texture, and motion. An object is to provide a three-dimensional model display system.

  The present invention is a three-dimensional design support apparatus that supports creation of a surface design of a three-dimensional model, and stores model data for storing model data of each component constituting a three-dimensional model arranged in a virtual three-dimensional space. Change the model data of each component stored in the model data storage means by changing the virtual skeleton of each component set for the three-dimensional model according to the means and the input device operation by the user Means, a model data calculation means for calculating the model data of the three-dimensional model according to the changed model data of each component, a model data of the three-dimensional model calculated by the model data calculation means, and rendering a two-dimensional image A three-dimensional design support apparatus comprising: a three-dimensional model display means for displaying on a display device as To.

  According to the present invention, the three-dimensional model can be easily edited simply by enlarging / reducing or changing the ratio of each component of the three-dimensional model by the model data changing means. For example, a three-dimensional model is divided into three components: the head, neck to bottom (other than the chest), and chest. Head size, height to head length ratio (head and body), bust size Etc. can be changed. When changing the size of the head, the entire head is enlarged or reduced. When changing the ratio of height to head length, the size of the body can be adjusted while maintaining the size of the head of the three-dimensional model. It is possible to edit 6 to 8 characters that are close to real humans. When changing the bust size, the bust size is changed by deforming the virtual skeleton of the bust portion among the virtual skeletons constituting the three-dimensional model.

  Furthermore, a development view storage means for storing a development view in which the surface shape of the three-dimensional model is developed in two dimensions, a development view correspondence storage means for storing the correspondence between the model data of each component and the development view, and a user A development view editing means for editing the development view stored in the development view storage means in accordance with the operation of the input device by the model, and a model data editing for editing the model data stored in the model data storage means in accordance with the operation of the input device by the user An editing method switching means for switching whether the editing by the input device can be executed using the development drawing editing means or the model data editing means according to the operation of the input device by the user, and the model data editing means. The edited model data, the developed view edited by the developed view editing means, and the model stored in the developed view correspondence storage means According to the corresponding relationship between the data and the developed view, it is preferable to provide a model data calculating means for calculating a model data of a three-dimensional model. By enabling switching between 2D (2D) editing and 3D (3D) editing using a development view, it is possible to perform editing while checking the editing result in 3D, without performing complicated operations. However, even beginners can work intuitively.

  Furthermore, based on the model data of the three-dimensional model calculated by the model data calculation means, the motion program storage means for storing the motion program for giving a predetermined motion to the three-dimensional model in the virtual three-dimensional space, It is preferable to include a motion program execution means to execute. Since the 3D model's proportions and designs can be edited in parallel while actually making the 3D model move, it is displayed when the 3D model has a specific motion. The user can confirm in real time whether or not the user can begin editing.

  Further, a development view storing means for storing a development view in which the surface shape of the three-dimensional model is developed in two dimensions, model data of each component stored in the model data storage means, and a development view stored in the development view storage means Development map correspondence storage means for storing a correspondence relationship between the two, a two-dimensional image storage means for storing a two-dimensional image arbitrarily selected by the user, a development chart and a two-dimensional image storage stored in the development chart storage means An overlay display means for superimposing and displaying the two-dimensional image stored in the means on the display device, and a developed view and a two-dimensional image superimposed by the overlay display means according to an operation of the input device by the user In accordance with the correspondence between the position changing means for changing the position of at least one of the models and the model data of each component stored in the development correspondence storage means and the development. The image pasting means for pasting the two-dimensional image displayed superimposed on the developed view on the model data stored in the data storing means, and the model data on which the two-dimensional image is pasted by the image pasting means are displayed. It is preferable to include image pasting model display means to be displayed on the apparatus. A user can design a surface design of a 3D model with an arbitrary image by a simple operation that anyone can simply align an arbitrary 2D image with respect to a developed view of the 3D model. It becomes like this. In addition, since the selection of the two-dimensional image is arbitrary, the width of the design is not reduced.

  The present invention is a program for causing a computer device to create a surface design of a three-dimensional model, and stores model data of each component constituting a three-dimensional model arranged in a virtual three-dimensional space Model data for changing the model data of each component stored in the model data storage unit by changing the virtual skeleton of each component set for the three-dimensional model according to the operation of the input device by the user with the storage unit A change means, a model data calculation means for calculating the model data of the three-dimensional model according to the changed model data of each component, a model data of the three-dimensional model calculated by the model data calculation means, and rendering two-dimensional To cause a computer device to execute a three-dimensional model display means for displaying on a display device as an image About the program.

The present invention relates to a three-dimensional model display system comprising a three-dimensional model display device for displaying a three-dimensional model assigned to each user, and a three-dimensional model display server connected to the three-dimensional model display device through a communication line. A three-dimensional model display device configured to edit the setting data relating to the size of each component constituting the three-dimensional model and the display data of each component according to the operation of the input device by the user; A model data transmitting means for transmitting the setting model data edited by the model data editing means to the three-dimensional model display server, and a model data transmitting means for transmitting the edit model data relating to the display data of each component to the input device by the user Wearing item selection receiving means for receiving selection of a wearing item to be worn by the three-dimensional model according to the operation, and wearing A wearing item information transmitting unit that transmits the wearing item information related to the wearing item received by the item selection receiving unit to the 3D model display server, and the 3D model display server receives the edited model data from the 3D model display device. Model data receiving means, model data storage means for storing edited model data received by the model data receiving means, wearing item display data storage means for storing display data of a plurality of wearing items, each wearing item and three-dimensional The wear item correspondence storage means storing the correspondence with each component constituting the model, the wear item information receiving means for receiving the wear item information from the three-dimensional model display device, and the wear item information receiving means About wearing items corresponding to wearing item information Stored by the wear item display data storage means according to the setting relating to the size of each component stored in the model data storage means and the relationship between the wear item and each component stored in the wear item correspondence storage means. Wear item display data changing means for changing the display data of the worn items, settings relating to the size of each component stored in the model data storage means, display data for each component, and change of the wear item display data Based on the display data of the wearing item changed by the means, model display data specifying means for specifying the display data of the three-dimensional model, and display data of the three-dimensional model specified by the model display data specifying means Model display data transmitting means for transmitting to the display device, and the three-dimensional model display device The display data of the three-dimensional model received from the Dell display server is displayed on the display device as a two-dimensional image , and includes a wearing item editing unit that edits the display data of the wearing item, and is selected by the wearing item selection receiving unit. The present invention relates to a three-dimensional model display system in which a wear item is a wear item whose display data is edited by a wear item editing unit in another three-dimensional model display device .

  The three-dimensional model display device according to the present invention and the three-dimensional model display server are connected by a communication line such as the Internet. The user can edit the three-dimensional model (avatar) using the three-dimensional model display device. In addition, a user accesses a 3D model display server (website) through a browser from a 3D model display device, and purchases clothes, items, accessories, etc. (hereinafter referred to as items) to be worn by the 3D model. Can do. At this time, there is a need for the user not to purchase items etc. to be worn on the three-dimensional model, but to try and see how they are displayed.

  By the way, the three-dimensional model display apparatus according to the present invention can easily edit a three-dimensional model only by enlarging / reducing or changing the ratio of each component of the three-dimensional model. The three-dimensional model is divided into three components: the head, neck to bottom (other than the chest), and chest, and the head size, the ratio of height to head length (head and body), bust size, etc. Changes can be made.

  In this way, not only the expression and gender of the avatar's face, but also the diversity of the avatar by changing the size of the head, the ratio of head to head length (head and body), bust size, etc. Wearing items that can be purchased through the website may be unnatural depending on the avatar's physique, because the size is not appropriate. Therefore, if it can be worn regardless of the avatar's physique, it will lead to the user's purchase of items. In addition, regardless of the avatar's physique, if it is possible to wear all items, etc., depending on the avatar's physique, the display mode of the worn item may be significantly different from the mode displayed before purchase, It is desirable to be able to confirm at the fitting stage how it is displayed when it is worn by its own avatar.

  In the three-dimensional model display device, each component changed according to the correspondence between each component (for example, the head, the torso, and the chest) constituting the three-dimensional model and the wearing item, and the operation of the input device by the user The display size of the display data of individual wearing items (for example, hairstyle, outerwear, pants, accessories, etc.) is changed according to the setting related to the size of the part, and the three-dimensional model is based on the changed display data. The entire display data is specified. That is, when the item to be worn is a hairstyle or accessory worn on the head, the display size of the hairstyle or accessory increases in proportion to the size of the head. The hairstyle and accessories worn on the head are not affected by the ratio between the height and head length (head and body). On the other hand, if the item to be worn is a jacket worn on the upper body of the 3D model, the display size of the jacket increases in proportion to the ratio between the height and the head length, but the head size changes. Is not affected.

  Even when the user accesses the 3D model display server and tries on a worn item, information about the 3D model that the user has (head size, ratio of height to head length (head to body) , Bust size, etc.) to the 3D model display server, or if these pieces of information are stored in advance in the 3D model display server, the correspondence between each component constituting the 3D model and the wearing item And the display data of each wearing item is changed according to the setting regarding the size of each changed component. Since the display data of the entire 3D model is specified based on these changed display data, it is possible to try on any item regardless of the avatar's physique and how it is displayed after wearing. A preview display can be confirmed via the browser.

  There are services that can be purchased on the website for clothes, items, accessories, etc. to be worn by the 3D model, but these clothes etc. are provided by the website operator and can be fully enjoyed by users. It was not just rich in diversity and individuality. The three-dimensional model display device according to the present invention has a function of editing display data of a worn item, and the worn item is an item or the like edited by another user's three-dimensional model display device. Therefore, boasting items that have been edited by individuals, letting more people know, and for items with excellent design created by other users, such items are also worn by their avatars. It becomes possible to enjoy. Moreover, because it is possible to edit the design of items etc. based on items with excellent design created by other users, it is possible to easily edit items etc. of complicated designs, It is possible to provide a three-dimensional model display system having diversity and individuality that can be fully enjoyed by the user.

The present invention relates to a three-dimensional model display system comprising a three-dimensional model display device for displaying a three-dimensional model assigned to each user, and a three-dimensional model display server connected to the three-dimensional model display device through a communication line. The three-dimensional model display device edits the setting relating to the ratio of the size of the virtual skeleton of each component part constituting the three-dimensional model and the display data of each component part according to the operation of the input device by the user Model for editing model data editing means, setting regarding ratio of size of virtual skeleton of each component edited by model data editing means, and edit model data regarding display data of each component to 3D model display server Accepts the selection of the video program to be executed by the 3D model according to the data transmission means and the input device operation by the user The 3D model display server includes a moving image program selection receiving unit and a moving image program information transmitting unit that transmits the moving image program information related to the moving image program received by the moving image program selection receiving unit to the 3D model display server. Model data receiving means for receiving edited model data from a display device, model data storage means for storing edited model data received by the model data receiving means, and a moving picture for storing a moving picture program for causing a three-dimensional model to execute a predetermined motion Corresponding to the video program information received by the video program information receiving means among the program storage means, the video program information receiving means for receiving the video program information from the 3D model display device, and the video program stored in the video program storage means A moving image data specifying means for specifying moving image data when the moving image program is executed according to the editing model data stored in the model data storage means; and the moving image data specified by the moving image data specifying means A three-dimensional model display device for displaying the moving image data received from the three-dimensional model display server as a two-dimensional image on the display device ; A moving image program editing means for editing, and the moving image program moves the virtual joints constituting the virtual skeleton set in the three-dimensional model to different positions as the execution time of the program elapses. Motion is added to the virtual skeleton at a predetermined virtual joint. The virtual joint is moved to a different position according to the angle of the angle formed , and the moving picture program selected by the moving picture program selection accepting means is edited by the moving picture program editing means in another three-dimensional model display device. The present invention relates to a three-dimensional model display system which is a moving image program .

  In the three-dimensional model display system according to the present invention, the moving image data when the moving image program is executed is specified in accordance with the setting relating to the size of each component constituting the three-dimensional model. Therefore, even if the shape of the three-dimensional model is changed, the moving image program is executed without a sense of incongruity. Even when the user accesses the 3D model display server and displays a preview of a moving image program that the user wants to purchase, the model data of the user's 3D model (settings related to the size of each component) is 3D. If the information is transmitted to the model display server or if these pieces of information are stored in advance in the 3D model display server, regardless of the body shape of the 3D model, the user can apply his / her 3D model and display the preview without any sense of incongruity. It becomes possible. Even after purchasing the moving image program, the 3D model display device can apply the 3D model and display it without any sense of incongruity.

  Even in this case, each of the components constituting the three-dimensional model (for example, the head, the torso, the chest, etc.) and the corresponding relationship between the items to be worn, and each changed according to the operation of the input device by the user The display data of individual wearing items (for example, hairstyle, outerwear, trousers, accessories, etc.) is changed according to the setting related to the size of the component, and the entire three-dimensional model is changed based on these changed display data. The display data is specified. Even when the user accesses the 3D model display server and requests a preview display of the motion data that he / she wishes to purchase, the 3D model is included in each component part and the moving image program constituting the 3D model. The display data of each wearing item is changed according to the correspondence with the item worn by the wearer and the size of the component of the three-dimensional model. And, since the display data of the entire 3D model is specified based on these changed display data, regardless of the avatar's physique, after letting the avatar wear items in a natural manner without discomfort, The video program is executed.

In the present invention, video program, the angle after movement before and the movement of the virtual joints for the angle formed by the virtual backbone in the virtual function section, and, according to the angular velocity at the time of the movement of the virtual joints, the virtual joints different positions It is preferable to move it.

  When previewing a video program that you want to purchase, move the virtual joint to a different position according to the predetermined angle of the angle formed in the virtual joint and the angular velocity of the angle when moving the virtual joint. By doing so, the moving distance and moving speed of the virtual joint can be changed according to the setting relating to the size of each component while maintaining the direction in which the virtual joint moves, so that the own joint can be changed regardless of the body shape of the three-dimensional model. By applying a three-dimensional model, it becomes possible to display a preview without a sense of incongruity. Even after purchasing the moving image program, the 3D model display device can apply the 3D model and display it without any sense of incongruity.

  In the present invention, the moving image program generates a sound based on predetermined audio data as the program execution time elapses, displays text sentences as the program execution time elapses, and / or executes the program. It is preferable that the position, focus, or orientation of the virtual camera for displaying the two-dimensional image change as the time elapses.

  The movie program is not only a motion program that allows a 3D model to simply execute a predetermined motion, but also applies to a movie program that includes the generation of sound by voice data, the display of text sentences, and changes in the viewpoint of a virtual camera. Is possible.

  In the present invention, the three-dimensional model display device includes a moving image program editing means for editing the moving image program, and the moving image program selected by the moving image program selection accepting means is selected by the moving image program editing means in the other three-dimensional model display device. An edited moving image program is preferred.

  Need to create videos using their own avatars and show them to other users and enjoy them, or to make their own avatar appear in interesting videos created by other users There are also needs. However, creating such a moving image from scratch is burdensome for the user. With the 3D model display system of the present invention, it is possible to purchase video programs created by other users regardless of the avatar's body shape, and to display previews by applying their avatars to these video programs. It becomes possible.

  The function of the three-dimensional model display device (three-dimensional design support device) of the present invention will be described below. The 3D model display apparatus of the present invention includes a motion editing function for editing the motion itself of the 3D model, as well as a model editing function, an in-motion editing function, and a 2D / 3D switching editing function described below. It also has a movie editing function that can give speech to the dimensional model by voice data or text sentences.

1. Model editing function (1) The target for changing model data is limited to the head and body, bust, head, and the like. That is, the model data is divided and managed in three parts: the head, the neck to the bottom (other than the chest), and the chest, and these can be individually enlarged and reduced. By enlarging / reducing these three parts individually, most variations of the humanoid character can be covered.
(2) The reason for the above classification is that the motion data does not affect each other. For example, if you edit the model of arms and legs separately, you must reconstruct the data for most motions, such as running motions and dancing motions. On the other hand, as in the present invention, if only the head model or only the neck to the lower model is used, the motion data can be dealt with by simple reduction / enlargement.
(3) Another reason for the above classification is that the texture to be mapped does not extend over both sections, or even if they are spread over, there is little influence. For example, if the model of the torso and the foot are edited separately, for example, when texture mapping is performed on a one-piece pattern, the enlargement / reduction size of the pattern becomes different between the torso and the foot, which is unnatural. On the other hand, in the present invention, it can be dealt with only by simply enlarging / reducing the texture according to the model (the enlargement / reduction of the chest part is not conspicuous because the rate of change is not large).

2. Editing during motion As a function for further exerting the effect of the “model editing function” as described above according to the present invention, there is “editing during motion”. By editing while actually moving the model, even beginners can intuitively grasp the results of editing, so that the model, texture, and motion can be maintained while maintaining harmony.

3.2 2D / 3D switching editing Since the texture itself is 2D data, editing by 2D display is fundamental for accurate and precise editing. However, in this case, when editing while maintaining harmony of the model, texture, and motion, it is not possible to work while actually confirming the editing result in 3D. “2D / 3D switching editing” is intended to enable even beginners to work intuitively. Conventionally, there is no 2D / 3D switching editing because the entire rendering must be performed for each switching, so that the reading waiting time for switching is too long. Even with the current high-spec machine performance, it is difficult to provide services at a practical level. In this regard, if it is “only for avatars”, since the CG data to be handled is small, the problem of processing speed does not occur in the first place.

It is a block diagram which shows the structure of the three-dimensional design assistance apparatus concerning embodiment of this invention. It is a flowchart at the time of performing the edit process of the clothes which an avatar wears. It is a figure which shows the corresponding | compatible relationship table of the clothing model 202 and the type | mold 203. FIG. It is a figure which shows the correspondence of each polygon of the clothing model 202, and the part of the type | mold 203. FIG. It is a figure showing the change of the display screen 114 at the time of switching between 3D layer and 2D layer. It is a flowchart at the time of performing the change process of model data. It is a figure showing the change of the avatar in the display screen 114 before and after editing of model data. It is a figure which shows an example of the window (character editor) displayed on the display screen 114 in order to edit an avatar. It is a figure which shows an example of the window (clothing editor) displayed in the display screen 114 in order to edit the clothing etc. which the avatar is wearing. It is a figure which shows an example of the window (proportional editor) displayed on the display screen 114 in order to edit model data. It is a figure which shows an example of the window (motion editor) displayed on the display screen 114 in order to edit the motion of an avatar. It is a figure which shows an example of the window (face editor) displayed on the display screen 114 in order to edit the face of an avatar. It is an example of the display screen at the time of editing the character by a proportion editor. It is an example of the display screen at the time of editing a texture using a 2D layer and a 3D layer. It is an example of the display screen at the time of editing a texture, making a character perform predetermined motion. It is a figure which shows an example of the window (timeline window) displayed on the display screen 114 in order to create a moving image program. It is an example of the display screen 114 when a timeline window is opened. It is a figure which shows a moving image program management table. It is a figure which shows a user management table. It is a flowchart at the time of displaying the preview which applied own avatar to the item or moving image program which the user selected. It is a figure showing the change of the virtual skeleton at the time of changing the magnitude | size of an avatar, and a virtual joint. It is an example of the display screen of the three-dimensional model display apparatus which concerns on embodiment of this invention. It is an example of the display screen of the three-dimensional model display apparatus which concerns on embodiment of this invention. It is an example of the display screen of the three-dimensional model display apparatus which concerns on embodiment of this invention. It is an example of the display screen of the three-dimensional model display apparatus which concerns on embodiment of this invention. It is an example of the display screen of the three-dimensional model display apparatus which concerns on embodiment of this invention. It is an example of the display screen of the three-dimensional model display apparatus which concerns on embodiment of this invention. It is an example of the display screen of the three-dimensional model display apparatus which concerns on embodiment of this invention.

  Embodiments of the present invention will be described below with reference to the accompanying drawings. FIG. 1 is a block diagram showing a configuration of a three-dimensional model display device applied in this embodiment. As shown in the figure, the three-dimensional model display device includes a CPU (Central Processing Unit) 101, a main memory 102, an input device 103, a display device 104, a hard disk drive (HDD) 105, and a CD-ROM / DVD drive 106. And. The display device 104 includes a display screen 114, and a recording medium (DVD-ROM or CD-ROM in this embodiment) 121 can be worn on the DVD / CD-ROM drive 106.

  The CPU 101 executes a program stored on the HDD 105 or the recording medium 121 to control the apparatus main body. The main memory 102 is a work area of the CPU 101, and information related to texture data and the like being edited by the user is temporarily stored in the main memory 102. The HDD 105 is used as a storage area for storing programs and data.

  The DVD / CD-ROM drive 106 reads programs and data from the recording medium 121. The input device 103 is a mouse used as a pointing device, a keyboard having direction keys, or the like. The keyboard is used for text input and the like, and further, the drag operation and the drop operation of the mouse enable the movement of the object and the pasted image on the display screen 114. Then, input data from the input device 103 is output to the main memory 102, and the CPU 101 interprets it and executes arithmetic processing.

  Programs and data executed by the 3D model display device are stored in the recording medium 121. The data stored in the recording medium 121 includes an avatar that exists in a virtual three-dimensional space, graphic data for configuring a clothing model, a cutting diagram corresponding to the clothing model, and an avatar for executing a predetermined motion. Motion programs are included. The program and data stored in the storage medium 121 are read by the DVD / CD-ROM drive 106 at the time of execution and loaded into the main memory 102. The CPU 101 processes the program and data loaded in the main memory 102 and outputs a drawing command to the display device 104. Intermediate data while the CPU 101 is performing processing is stored in the main memory 102.

  The CPU 101 expands the image data and displays an image on the display screen 114 of the display device 104. One frame time of the image output from the CPU 101 is, for example, 1/60 second. The CPU 101 generates image data of a two-dimensional image obtained by perspective-transforming an object (avatar, clothes model, etc.) existing in a virtual three-dimensional space with a virtual camera, and displays the image data together with other image data used for a user operation. 114 is displayed. In such image processing, a control device for image processing (including GPU, ROM, etc.) may be used.

  The three-dimensional model display device according to the present invention supports the creation of a design of a character that can be operated by a user as an avatar in a virtual three-dimensional space (which will be described below as a humanoid character expressed in three dimensions). To do. FIG. 2 is a flowchart when executing an editing process of clothes worn by an avatar in the three-dimensional model display device of the present invention. The display screen 114 of the three-dimensional model display device displays a two-dimensional image obtained by perspective-transforming the avatar in the virtual three-dimensional space using a virtual camera, and allows the user to edit the clothes worn by the avatar. A window for performing (a 3D clothing model or a 2D type corresponding to the clothing model is displayed in the window) is displayed (step S101). Next, it is determined whether or not an instruction to edit the clothing model has been input from the user (step S102). If an instruction to edit the clothing model is input (“YES” in step S102), the clothing model is edited (step S103). That is, image pasting, figure drawing, texture deletion, and the like by the user's operation are reflected in the clothes model.

  FIG. 9 is a diagram illustrating an example of a window (clothes editor window) displayed on the display screen 114 for editing clothes or the like worn by the avatar. When the clothes editor window 305 is displayed, the texture of the clothes worn by the avatar can be edited. In the clothes editor window 305, a hairstyle selection box 306a (selection of long hair, short hair, etc.) that can select a pre-registered hairstyle, and an upper body clothes selection box 307a (T-shirt, tank top, Blazers, wizard clothes, etc.), lower body clothes selection box 308a (long skirt, tight skirt, etc. can be selected), shoes selection box 309a (sneakers, pumps, short) Boots, wizard shoes, etc. can be selected), and an accessory selection box 310a (bangle, ribbon, bracelet, etc. can be selected) for selecting accessories is provided. When the user selects the edit buttons 306b, 307b, 308b, 309b, and 310b related to the hairstyle, upper body change, lower body change, shoes, and accessories, the data selected in the selection boxes 306a, 307a, 308a, 309a, and 310a are displayed. Based on the 3D clothes model and the 2D clothes model corresponding to the model, the avatar clothes can be edited.

  As shown in FIG. 3, a clothing model expressed in three dimensions is developed into a two-dimensional shape corresponding to the clothing model. It is prepared for each model. Each type is divided for each part (sleeve, body part, etc.) of the clothes model, and is arranged on a plane within one frame.

  FIG. 4 shows the correspondence between the polygon of the clothing model 202 and the mold 203. The figure shows the clothing model 202 and the front side of the body of the mold 203. First, the clothing model 202 is composed of a plurality of triangular or quadrangular polygons, and a plurality of them are connected to each other and represented as a three-dimensional clothing model 202. The polygons with numbers on the surface of the clothing model 202 composed of a plurality of polygons correspond to each other with the same numbers in the two-dimensional type 203. It is attached. As a result, the content edited by the mold 203 represented in two dimensions is reflected on the surface of the clothing model 202 represented in three dimensions.

  FIG. 5 is a diagram illustrating a change in the display screen 114 when switching between the 3D layer and the 2D layer. In the present invention, based on the correspondence between the 3D layer and the 2D layer, these layers can be switched during editing. In FIG. 5A, a texture editor window 327 and a layer window 329 for editing the avatar 201 and clothes are displayed on the display screen 114. In the texture editor window 327, a clothing model 202 and a tool window 328 are displayed. The user uses the tool window 328 to edit the clothing model 202. The tool window 328 includes a pen tool (pen drawing tool), an eraser tool (a tool for erasing an object drawn on a layer and making it transparent), a fill tool (a tool for filling a layer), and a stamp tool (for a specific image). Tools for drawing an image while copying it to the mouse click / drag destination) are provided, and texture editing can be performed using these tools. It is also possible to adjust the size of the pen tip when using a pen tool, an eraser tool, or the like.

  In addition, an image pasting tool (a tool capable of pasting a user-selected favorite image to the mold 203), a pattern paper moving tool (a tool for moving the mold 203 in the 2D layer), a pattern paper rotating tool (the mold 203 in the 2D layer) A tool to rotate), etc. are provided, and when attaching an image to the mold 203, the image is attached so that the joint of the developed view does not become unnatural by using the pattern movement tool and the pattern rotation tool. Or, the user's favorite design can be adopted for each part from the design of the pasted image. Further, the pattern 203 whose arrangement has been changed can be stored as data in the same manner as storing the clothes data edited by the user. In this case, in the texture editor window 327, a favorite image selected by the user is displayed superimposed on the mold 203, and the user can select at which position to paste this image.

  The user can paste a plurality of pasted images on the mold 203 and can paste arbitrary images for each part. Therefore, the user can create a self-made pattern having a different pattern or color for each part of the clothing model 202. The clothes model 202 can be easily created. In addition, in pasting such a plurality of pasted images, a part of the pasted images may be transmitted, or a plurality of pasted images may be pasted by changing the transmittance. In editing such as these, it is possible to edit the pasted image itself such as enlargement, reduction, deformation or color change with respect to the read pasted image, and the state of the editing before and after the editing is possible. It may be displayed on the clothes model 202.

  The pasted image is not only a still image stored in advance in the HDD 105 or the like, but also a moving image of a moving image shot using a digital camera or the like, by capturing a still image of a desired frame by a user operation. It may be read into a three-dimensional design apparatus and used as a pasted image. In addition, by allowing the pasted image to be taken in from the outside of the three-dimensional design apparatus as described above, the degree of freedom in editing the user's clothing design is further increased, and more personalized clothing can be made by himself.

  When a camera that captures a moving image is connected to the three-dimensional model display device, a still image of a desired frame may be captured from the moving image captured in real time by the camera. Alternatively, a still camera may be connected to the three-dimensional model display device, and an image captured thereby may be stored in the HDD 105 or the like and used as a pasted image. Thereby, even when abundant images are not prepared in advance, the user can take a desired image and perform a three-dimensional design such as an avatar clothes.

  The layer window 329 is provided with selection buttons 329a and 329b for the user to select which of 3D layer and 2D layer is used for editing. When the user selects the selection button 329b for switching to the 2D layer, as shown in FIG. 5B, the texture editor window 327 in the display screen 114 is switched to the editing screen for the 2D layer. In the texture editor window 327, the types 203a, 203b, 203c, and 203d corresponding to the clothing model 202 are displayed. These types 203a, 203b, 203c, and 203d can be edited using the tool window 328. When the user selects the selection button 329a in the layer window 329, as shown in FIG. 5A, the texture editor window 327 in the display screen 114 is switched to the editing screen in the 3D layer.

  In addition, the display magnification of the clothing model 202 displayed in the texture editor window 327 can be changed. When editing a detailed portion of the clothing model 202, the display magnification is increased, and the clothing model 202 is edited while overlooking the entire clothing model. The display magnification may be lowered.

  The surface of the clothing model 202 is mapped by bump mapping. Here, the bump mapping is a mapping technique that expresses pseudo unevenness on the surface of the object by shifting the normal line for each pixel of the texture mapped on the polygon of the object. In other words, the reflected light from the light source in the virtual three-dimensional space is shifted by shifting the normal line for each pixel. Therefore, in the image obtained by changing the perspective of the image, the shadow of the object surface changes. Apparent irregularities are expressed. In addition, irregularities such as clothes wrinkles caused by the movement of the avatar are expressed by this bump mapping together with the change of the polygon of the clothes model according to the movement. Further, as will be described later, the avatar 201 can be caused to perform a predetermined motion, and the clothes model is deformed in accordance with such an operation, and a plurality of polygons in the clothes model are deformed accordingly. By performing bump mapping, movements such as wrinkles and shimmering are confirmed in the clothes worn by the avatar 201.

  If it is determined in step S103 that the clothing model has been edited, or if it is determined in step S102 that an instruction to edit the clothing model has not been input, it is determined whether or not the motion function is being executed ( Step S104). When the motion function is being executed (“YES” in step S104), the operation of the avatar 201 is executed (step S105). Execution of the operation of the avatar 201 is determined according to a predetermined algorithm provided in advance, and the user can select what kind of motion (operation) to perform. For example, the user can select “walk”, “run”, “dancing”, “throw”, and the like. By enabling the selection of the motion of the avatar 201, it is possible to easily confirm how the edited avatar 201 is displayed in a specific operation.

  FIG. 11 is a diagram illustrating an example of a window (motion editor) displayed on the display screen 114 in order to edit the motion of the avatar 201. When the motion of the avatar 201 is edited, a motion editor window 316 for editing the motion is displayed on the display screen 114. In the center of the motion editor window 316, a motion selection box 317 is provided. When the user selects the motion selection box 317, a list of pre-registered motions is displayed, and the user can select which motion is to be executed by the avatar 201. For example, “walking”, “running”, “dancing”, “throwing”, and the like can be selected. A motion speed adjustment slider 318a that can adjust the speed at which the avatar 201 operates is provided below the motion selection box 317. When the pointer 318b displayed in the motion speed adjustment slider 318a is moved to the right, the operation speed of the avatar 201 is increased. Conversely, when the pointer 318b is moved to the left, the operation speed of the avatar 201 is increased. Become slow. On the right side of the motion speed adjustment slider 318a, motion operation buttons 319a, 319b, 319c, and 319d are provided. When the motion operation buttons 319a and 319d are selected by a user operation, the motions that can be selected in the motion selection box 317 are changed to motions registered before and after the motion that the avatar 201 is currently executing. When the motion operation button 319b is selected, the motion of the avatar 201 is stopped, and when the motion operation button 319c is selected, the motion of the avatar 201 is temporarily stopped. By enabling the motion of the avatar 201 to be temporarily stopped, it is possible to easily confirm how the edited avatar 201 is displayed at a specific moment in a specific operation.

  If the operation of the avatar 201 is executed in step S105, or if it is determined in step S104 that the motion function is not executed, a perspective transformation process is performed based on the virtual camera (step S106). Based on the result of the process, the content displayed on the display screen is changed (step S107).

  The position of the virtual camera can be changed by a user operation. Therefore, it is possible to arrange and edit a virtual camera at a position closer to the avatar 201, and it is also possible to edit while viewing the entire avatar 201. It is also possible to change the position of the virtual camera while using the avatar 201 as a reference point. The viewpoint of the avatar 201 viewed from above, the viewpoint viewed from below, the viewpoint viewed from the side instead of the front, and viewed from behind. The viewpoint and the avatar 201 can be seen from various viewpoints. Therefore, it is possible to confirm how the edited avatar 201 is displayed from a specific direction or position. Also, in the virtual three-dimensional space, the position of the light source is fixed or changed, and the shadow of the clothes worn by the avatar 201 represented by the light source and the shadow of the avatar 201 including the clothes are displayed via the display screen 114. Thus, the user may be able to visually recognize it. This light source is, for example, the sun, lighting, or the like used to more realistically represent the space in the shared virtual space. As described above, when the clothes design is edited, the reproduction of the shadow in the shared virtual space is easy for the user to imagine how the avatar 201 wearing the user's own clothes looks in the shared virtual space. This saves the effort of trial in the shared virtual space.

  The processing from step S102 to step S107 is executed for each frame and is continued until the user finishes editing the clothing model. That is, when the content of the display screen is changed in step S107, it is determined whether or not an input for ending the editing of the clothing model is made by an input from the user (step S108), and the editing of the clothing model is ended. Is not input (“NO” in step S108), the processing from step S102 is continued. On the other hand, when an input for ending the editing of the clothing model is made (“YES” in step S108), the edited result is stored in the main memory 102 (step S109).

  FIG. 6 is a flowchart when the model data changing process is executed. First, a model editing window is displayed (step S201). Next, it is determined whether or not the model data has been changed by a user operation (step S202). If the model data has been changed (“YES” in step S202), the model data is edited (head / body, head size, bust size) (step S203).

  FIG. 10 is a diagram showing an example of a window (proportional editor) displayed on the display screen 114 for editing model data. When editing the model data, a proportion editor window 311 for editing the model data is displayed on the display screen 114. In the upper part of the proportion editor window 311, a face type selection box 312 for selecting the face type (face type) of the avatar 201 is provided, and any of the face types registered in advance is used. The user can select whether to edit. For example, a face type such as a round face or a face length can be selected. Below the face type selection box 312, a head / body adjustment slider 313 a that can adjust the head / body of the avatar 201, a head size adjustment slider 314 a that can adjust the head size of the avatar 201, and the avatar 201. A bust size adjustment slider 315a that can adjust the bust size is provided. By moving the pointer 313b, the pointer 314b, and the pointer 315b displayed at the center of each of the head and body adjustment slider 313a, the head size adjustment slider 314a, and the bust size adjustment slider 315a to the left and right, The size can be adjusted.

  FIG. 7 is a diagram illustrating changes in the avatar 201 in the display screen 114 before and after editing the model data. On the display screen 114, the avatar 201 existing in the virtual three-dimensional space is displayed as a two-dimensional image. For example, consider FIG. 7A as a reference. The number of avatars 201 displayed on the display screen 114 in FIG. 7A is about three. If the pointer 313b is moved to the right in the head-and-body adjustment slider 313a, the display screen 114 in FIG. Like the displayed avatar 201 (about 5 heads and bodies), the ratio of the whole body with respect to the head of the avatar 201 becomes larger. In this case, the ratio of the whole body to the head is increased by increasing only the portion (body part) located below the head without changing the size of the head. On the other hand, when the pointer 313b is moved to the left in the head-and-body adjustment slider 313a, the head of the avatar 201 becomes more like the avatar 201 (about two bodies) displayed on the display screen 114 in FIG. The ratio of the whole body to is small. Also in this case, the ratio of the whole body to the head is reduced by reducing only the body part without changing the size of the head. The ratio of the whole body with respect to the head of the avatar 201 can be adjusted between 2 and 8 by the head-and-body adjustment slider 313a.

  In order to change the size of the body part of the avatar 201, it is necessary to change the size of the virtual skeleton set for the avatar 201, that is, to change the joint distance of the virtual skeleton. In addition to the height direction, the joint distance in a direction perpendicular to the height may be changed at a predetermined ratio. Then, by performing skinning based on the changed virtual skeleton, skins constituting the upper body and lower body of the avatar 201 are formed following the virtual skeleton. Even if the size of the body part of the avatar 201 changes, the virtual skeleton of the head does not change and the positional relationship between the head and the body part is maintained, so only the size of the body part changes. Avatar 201 can be obtained.

  When changing the size of the body part using the head-and-body adjustment slider 313a, the clothes worn by the avatar 201 on the body part are also changed in accordance with the change in the size of the body part of the avatar 201. It is necessary to display on the display screen 114. That is, even if the body part of the avatar 201 becomes large by changing the size of the polygons constituting the clothes model 202 worn by the avatar 201 in accordance with the rate of change of the body part of the avatar 201, the avatar The clothing model 202 can be displayed while maintaining the positional relationship and the size relationship with the 201.

  When the pointer 314b is moved to the right in the head adjustment slider 314a, the size of the head of the avatar 201 displayed on the display screen 114 in FIG. 7A is changed to the display screen 114 in FIG. 7D. (In FIG. 7A, the width of the head of the avatar 201 is slightly shorter than the waistline in FIG. 7A, but in FIG. 7D, the width of the head is increased. Is about the same length as the waistline). In this case, only the size of the head is increased without changing the size of the body part. On the other hand, when the pointer 314b is moved to the left on the head adjustment slider 314a, the size of the head of the avatar 201 displayed on the display screen 114 in FIG. 7A is changed to the display screen 114 in FIG. (In FIG. 7A, the width of the head of the avatar 201 is slightly shorter than the waist in the two-dimensional image, but in FIG. 7E, the head is small. The width of the part is about half the length of the waist.) Also in this case, only the size of the head is reduced without changing the size of the body part. Even if the head size of the avatar 201 is changed, the virtual skeleton of the body part is not changed, and the positional relationship between the head and the body part is maintained, so that the avatar 201 having only the head size changed is obtained. be able to.

  The bust size is changed by deforming the bones that make up the avatar 201. When the avatar 201 is a female character, the bust size can be changed. When the avatar 201 is a male character, the bust size cannot be changed. When changing the bust size, the bust size is changed by deforming the virtual skeleton of the bust portion among the virtual skeletons constituting the three-dimensional model. When increasing the bust size, the position of the bust part of the virtual skeleton is changed further away from the center of the body, and skinning is performed based on the changed virtual skeleton, so that the skin constituting the bust part is A three-dimensional model formed following the virtual skeleton and having a large bust size can be obtained.

  As described above, if the editing of the model data is executed in step S203, or if it is determined in step S202 that the model data is not changed, it is determined whether the motion function is executed. Is performed (step S204). When the motion function is being executed (“YES” in step S204), the operation of the avatar 201 is executed (step S205). Execution of the operation of the avatar 201 is determined according to a predetermined algorithm provided in advance, and the user can select what operation to perform. For example, the user can select “walk”, “run”, “dancing”, “throw”, and the like. When editing the motion of the avatar 201, the motion editor window 316 described above is used.

  Since the motion program defines the movement trajectory for a three-dimensional model having a predetermined size and joint distance, when the proportion of the avatar 201 is edited, the definition target is lost. It is necessary to build a motion program again. In the motion program in the embodiment of the present invention, the angle formed by each joint point of the virtual skeleton of the avatar 201 before and after the motion (for example, formed by three joint points of the elbow, the shoulder, and the neck portion). The angle of the shoulder portion) and the angular velocity at the time of motion for the angle are determined, and the proportion of the avatar 201 is changed to cause the avatar 201 to execute a predetermined motion according to the angle and the angular velocity. However, there is no need to rebuild the motion program.

  If the operation of the avatar 201 is executed in step S205 or if it is determined in step S204 that the motion function is not executed, a perspective conversion process is performed based on the virtual camera (step S206). Based on the result of the processing, the content displayed on the display screen is changed (step S207). As described above, the position of the virtual camera can be changed by a user operation, and it is possible to confirm how the edited avatar 201 is displayed from a specific direction and position. is there. Also, in the virtual three-dimensional space, the position of the light source is fixed or changed, and the shadow of the clothes worn by the avatar 201 represented by the light source and the shadow of the avatar 201 including the clothes are displayed via the display screen 114. Thus, the user may be able to visually recognize it.

  The processing from step S202 to step S207 is executed for each frame and is continued until the user finishes editing the model data. That is, when the content of the display screen is changed in step S207, it is determined whether or not an input for ending the editing of the model data is made by an input from the user (step S208), and the editing of the model data is ended. Is not input ("NO" in step S208), the processing from step S202 is continued. On the other hand, when input for ending the editing of the model data is made (“YES” in step S208), the editing result is stored in the main memory 102 (step S209).

  FIG. 8 is a diagram illustrating an example of a window (character editor) displayed on the display screen 114 for editing the avatar 201. When editing the character of the avatar 201, a character editor window 301 for editing the character is displayed on the display screen 114.

  Above the character editor window 301, a proportion selection box 302a and a proportion edit button 302b are provided. When the user selects the proportion selection box 302a, a list of proportion data registered in advance (portion data of four heads, proportion data of eight heads, etc.) is displayed, and any of the proportion data is used for the avatar 201. The user can select whether to edit. When the user selects the proportion edit button 302b, a proportion editor as shown in FIG. 10 is displayed, and the proportion of the avatar 201 can be edited based on the proportion data selected in the proportion selection box 302a. Become.

  Below the proportion selection box 302a and the proportion edit button 302b, a face selection box 303a and a face edit button 303b are provided. When the user selects the face selection box 303a, a list of pre-registered face data (for example, a friendly face, a girl-like face, a cheerful face, etc.) is displayed. The user can select whether to edit. When the user selects the face edit button 302b, the face of the avatar 201 is obtained using the 3D face model and the 2D face type corresponding to the face model based on the face data selected in the face selection box 303a. Can be edited. The face editing using the face model and the face type is performed by the same method as the above-described editing of the clothing model using the clothes model and the type corresponding to the clothes model. Further, when the user selects the face edit button 302b, a face editor window 320 as shown in FIG. 12 may be displayed so that the face of the avatar 201 can be edited.

  Below the character editor window 301, a body selection box 304a and a body edit button 304b are provided. When the user selects the body selection box 304a, a list of body data registered in advance (for warriors, for waitresses, etc.) is displayed, and the user selects which body is used to edit the avatar 201. can do. The body data decorates a layer closer to the skin portion of the avatar 201 than the above-described change of upper body, lower body, accessories, etc. (corresponding to underwear, stockings, etc. that are in close contact with the skin of the avatar 201). When the user selects the body edit button 304b, the body of the avatar 201 is obtained using the 3D body model and the 2D body type corresponding to the body model based on the body data selected in the body selection box 304a. Can be edited. The body editing using the body model and the body type is performed in the same manner as the clothing model editing using the clothing model and the model corresponding to the clothing model.

  In the present invention, it is possible to adjust and edit the ratio of each part of the face of the avatar 201 as well as the head, body, and chest of the avatar 201. FIG. 12 is a diagram illustrating an example of a window (face editor window) displayed on the display screen 114 for editing the face of the avatar 201. The face editor window 320 includes a head size adjustment slider 321a, a head width adjustment slider 322a, an eye height adjustment slider 323a, a nose height adjustment slider 324a, a nose position adjustment slider 325a, and a jaw height adjustment slider 326a. Is provided. The face of the avatar 201 can be edited by moving the pointers 321b, 322b, 323b, 324b, 325b, and 326b displayed on these sliders to the left and right. In this case, by moving the point of each slider, the virtual skeleton provided in the avatar 201 is deformed, and the face of the avatar 201 changes. For example, by moving the pointer 324b of the nose height adjustment slider 324a to the right, the height of the nose portion of the virtual skeleton increases. By skinning based on the changed virtual skeleton, a skin constituting the face of the avatar 201 is formed following the virtual skeleton, and the avatar 201 having a high nose face can be obtained.

  FIG. 13 is an example of a display screen when a character is edited by a proportion editor. In both of FIGS. 13A and 13B, a two-dimensional image in the virtual three-dimensional space is displayed with the virtual camera existing in the virtual three-dimensional space as a viewpoint. In the center of the display screen, a window related to the proportion editor is displayed. A three-dimensional model arranged in the virtual three-dimensional space is displayed at the lower left of the window, and a background of a building or the like in the virtual three-dimensional space is displayed around the model. This three-dimensional model is to be edited. The proportion editor displays a box for selecting a face type (for example, standard, round face, face length, etc.) and a slider for adjusting the head, body, head size, and bust size. These sliders can move the pointer to the left and right in response to an input from the user. When the pointer is moved, the model data of the three-dimensional model is calculated according to the position of the pointer and reflected in the proportion of the three-dimensional model on the display screen in real time. For example, when the head-body adjustment slider is moved rightward, only the body part below the head is enlarged while the size of the head of the three-dimensional model is maintained. When the body part is enlarged, the position of the head connected to the body part naturally changes. That is, as the head-body adjustment slider is moved to the right, the position coordinates of the head maintain the connection with the part corresponding to the neck of the body as the body part expands (the correspondence between the body part and the head is changed). While maintaining). In FIG. 13A, the head-and-body adjustment slider is located on the leftmost side, and the displayed three-dimensional model is close to two, but in FIG. 13B, the head-and-body adjustment slider is on the right side from the center. The three-dimensional model is 5-6 heads. When the three-dimensional model has long hair, even if the position of the head-and-body adjustment slider is changed, model data or the like is not particularly changed for the hair around the head. However, the hair data located below the head may be changed in model data so that the length of the hair becomes longer as the body expands. When the head size adjustment slider of the proportion editor is moved to the right, only the head is enlarged while the size of the body part is maintained. Further, when the bust size adjustment slider related to the bust size is moved to the right, the size of the bust portion is enlarged while maintaining the size of the head and body parts (excluding the bust portion).

  FIG. 14 is an example of a display screen when a texture is edited using a 2D layer and a 3D layer. In FIG. 14A, the texture is edited using the 3D layer, and in FIG. 14B, the texture is edited using the 2D layer. 14A and 14B, a texture editor window related to the texture editor for editing the texture is displayed at the center of the display screen, and a layer window related to the layer is displayed on the right side of the display screen. Has been. In the layer window, tags for selecting whether to edit in the 3D layer or 2D layer are provided. By selecting these tags, the user can select the texture in the 3D layer or 2D layer. It is possible to switch whether to edit. Even when editing is performed on the 3D layer and the editing is switched to the 2D layer in the middle, the editing result on the 3D layer is also reflected on the editing screen (texture editor window) by the 2D layer. It is also possible to switch between the 3D layer and the 2D layer according to the editing content, and advanced editing is possible even for beginners.

  14A and 14B, as in FIG. 13, a two-dimensional image in the virtual three-dimensional space is displayed with the viewpoint of the virtual camera existing in the virtual three-dimensional space (texture editor). Most of it is hidden on the display screen and hidden by the window). The user can move or enlarge / reduce the texture editor window using the input device, and depending on the position and size of the texture editor window, the 3D model in the virtual 3D space can be displayed on the display screen. is there. Regardless of whether the 3D layer or 2D layer is used to edit the texture, it is reflected in real time on clothes, accessories, etc. worn by the 3D model. Editing work can be performed while checking whether it is displayed.

  FIG. 15 is an example of a display screen when editing a texture while causing a character to execute a predetermined motion. In FIGS. 15A and 15B, as in FIGS. 13 and 14, a two-dimensional image in the virtual three-dimensional space is displayed. A plurality of windows for editing the 3D model are displayed on the right side of FIG. 15A, and a motion editor window for selecting a motion of the 3D model is displayed on the lowermost side. The motion editor window has a box that allows you to select multiple motions. For example, you can make the 3D model perform actions such as “walking”, “running”, “throwing”, and “dancing” according to the motion program. . In FIG. 15B, while the predetermined motion is executed on the 3D model, the clothes worn by the 3D model are edited in the texture editor window. The texture editing in the texture editor window is reflected in real time on clothes, accessories, etc. worn by the 3D model, so the user can change the texture when the 3D model performs a predetermined motion. The editing operation can be performed while checking whether the display is displayed. In FIG. 15B, the texture is edited using the 3D layer. However, it is also possible to edit the texture using the 2D layer while executing a predetermined motion in the 3D model. Layer editing is reflected in the 3D model in real time. It is also possible to adjust the head, head size, and bust size with the slider of the proportion editor while executing the predetermined motion on the three-dimensional model, and the editing by the proportion editor is reflected in the three-dimensional model in real time. Is done.

  In the above embodiment, the case of editing a human-type character has been mainly described. However, the three-dimensional model display device according to the present invention can also be applied to an animal-type character. That is, it is possible to edit an animal-type character while performing a predetermined motion, and the size of each part can be adjusted by dividing it into a head and other parts.

  In the above embodiment, the program and data of the three-dimensional model display device are stored in the recording medium 121 and distributed. On the other hand, when the 3D model display device is connected to a server device existing on an external network and has a communication interface for communication, these programs and data are stored in the fixed disk device of the server device. In addition, it may be distributed to the three-dimensional model display device via a network. In the three-dimensional model display device, the program and data received from the server device by the communication interface can be stored in the HDD 105 and loaded into the main memory 102 at the time of execution.

  The three-dimensional model display device according to the present invention supports creation of an avatar video program. FIG. 16 is a diagram showing an example of a window (timeline window) displayed on the display screen 114 in order to create a moving image program. FIG. 17 is an example of the display screen 114 when the timeline window is opened. When the moving image program creation mode is selected in the three-dimensional model display device, a timeline window 330 as shown in FIG. 16 is displayed on the display screen 114. In the timeline window 330, a current time display 331 indicating the current time of the moving image displayed on the display screen 114, and an environment setting for displaying an area for setting an environment such as a camera, sound, and background in the moving image. A display 332, a character setting display 336 for indicating that the character (avatar) arranged in the virtual three-dimensional space is an area for setting a comment, a motion, a position, and the like, a video is played back, stopped, etc. A moving image control button 345 for performing the above control and a timeline display area 346 indicating the passage of time of the moving image are displayed.

  Below the environment setting display 332, a camera setting display 333 that displays an area for setting the position, orientation, focus, and the like of the virtual camera in the virtual three-dimensional space, BGM, sound effects, etc. when listening to a moving image A sound setting display 334 that displays an area for setting the sound of the sound and a background setting display 335 that displays an area for setting the background of the virtual three-dimensional space are displayed. On the right side of the camera setting display 333, the position and orientation of the virtual camera composed of a plurality of horizontally long rectangles surrounded by a dotted line (a dotted line for showing a timeline and a dotted line for distinguishing each setting area) A camera setting area 333a for setting the focus and the like is provided. Similarly, a sound setting area 334a for setting a sound is provided on the right side of the background setting display 335 on the right side of the sound setting display 333. In addition, a background setting area 335a for setting the background of the virtual three-dimensional space is provided.

  Below the character setting display 336, a character 1 setting display 337 for displaying that it is an area for setting a comment, motion, position, etc. of the character 1 arranged in the virtual three-dimensional space, and a virtual three-dimensional A character 2 setting display 341 is provided for displaying that the region is a region for setting a comment or the like of the character 2 arranged in the space. In addition, although the case where the motion setting etc. of two characters of the character 1 and the character 2 is possible is demonstrated, it can also be set as the structure which can perform the motion setting etc. of only one character or three or more characters.

  Below the character 1 setting display 337, a comment setting display 338 for displaying an area for setting the comment display of the character 1 in the moving picture, and an area for setting the motion of the character 1 in the moving picture are displayed. A motion setting display 339 and a position setting display 340 for displaying an area for setting the position of the character 1 in the virtual three-dimensional space are displayed. Similarly, below the character 2 setting display 341, a comment setting display 342, a motion setting display 343, and a position setting display 344 regarding the character 2 are displayed.

  To the right of the comment setting displays 338 and 342, comment setting areas 338a and 442a for setting a character comment display are provided, which are composed of a plurality of horizontally long rectangles surrounded by dotted lines. On the right side of the motion setting displays 339 and 343, there are motion setting areas 339a and 443a for setting the character motion, and on the right side of the position setting displays 340 and 344 are positions for setting the character position. Setting areas 340a and 344a are provided.

  When the play button 345c is clicked among the movie control buttons 345 at the bottom of the timeline window 330, the movie is played on the display screen 114 according to the settings of the current movie program. The timeline cursor 346 that traverses each setting area such as camera, sound, background, comment, motion, and position, the current time display 331, and the content of the moving image on the display screen 114 have a corresponding relationship, and the moving image is reproduced. As time passes, the current time display 331 changes from “00.00.0”, and the timeline cursor 346a moves from the left side to the right side. When the pause button 345d and the stop button 345e are clicked, the reproduction of the moving image on the display screen 114 is interrupted, and the change of the number on the current time display 331 and the movement of the timeline cursor 346a are also stopped.

  A plurality of star-shaped key icons 347 scattered in each setting area such as camera, sound, background, comment, motion, and position are set for the camera, sound, background, comment, motion, position, and the like. It is an icon indicating that For example, in the camera setting area 333a, key icons 347a and 347b are displayed at the positions of 0 sec and 20 sec in the timeline display area 346. The key icon 347a relates to setting of the position and orientation of the virtual camera from 0 sec to 20 sec when the next key icon 347b is displayed. On the other hand, the key icon 347b relates to the setting of the position, orientation, etc. of the virtual camera from 20 sec to the end of the moving image. Therefore, it can be seen that the settings such as the position and orientation of the virtual camera are changed in 20 seconds.

  Next, a method for adding the key icon 347 will be described. When the reproduction of the moving image is temporarily stopped or stopped, the timeline cursor 346a can be moved to the right side and the left side by dragging and dropping. When the timeline cursor 346a is moved, the content of the moving image displayed on the display screen 114 also changes accordingly. In order to edit the moving image program, the user moves the timeline cursor 346a while checking the two-dimensional image displayed on the display screen 114, and moves the timeline cursor 346a to the time at which the key icon 347 is desired to be added. Then, a key icon addition button (not shown) provided on the right side of each setting display is clicked. For example, when it is desired to add a key icon 347 for a virtual camera, a camera addition button provided on the right side of the camera setting display 333 is clicked. Then, when the camera addition button is clicked, a new window is displayed, and what is the focus of the virtual camera (for example, whether the character 1 is the focus or the character 2 is the focus), the time lapse of the virtual camera Added an auto camera setting that moves the virtual camera according to a predetermined setting, such as how the position changes according to (for example, rotate around the focus, zoom as the time elapses toward the focus) can do. In addition, manual setting that allows the user himself / herself to set all the positions and orientations of the virtual camera in detail is also possible. When the setting is completed, a key icon 347 is displayed at a position where the virtual camera setting area 333a and the timeline cursor 346a intersect. When the reproduction button 345c is clicked after the addition of the key icon 347 is completed, the moving image is reproduced based on the setting added on the display screen 114. In this case, the setting of the virtual camera after the added time is changed by the added key icon 347, and the setting is made until the video ends unless there is another key icon 347 at the later time. It will continue.

  Similarly, it is possible to add a setting by adding a key icon 347 to each setting area. For example, when the key icon 347 is added to the sound setting area 334a, it is possible to select favorite audio data from the audio data stored in the 3D model display device in advance, and the key icon is displayed in the background setting area 335a. When adding 347, it is possible to select favorite image data from image data stored in the 3D model display device in advance. For these audio data and image data, audio data and image data that the user owns can be used.

  In addition, when the key icon 347 is added to the comment setting areas 338a and 342a, a comment displayed until a predetermined time elapses from the time indicated by the timeline cursor 346a can be edited. Comments are made by entering text. When the comment display setting is performed, when a moving image is reproduced, a balloon 204 appears above the head of the avatar 201a and the comment is displayed in the balloon 204 as shown in FIG.

  When the key icon 347 is added to the motion setting areas 339a and 343a, the motion of the avatar 201 from the time indicated by the timeline cursor 346a to the time when the next key icon is set can be edited. As the motion, a plurality of motions stored in the three-dimensional model display device can be selected. For example, motions such as “run”, “walk”, and “dancing” can be selected. By setting a plurality of key icons 347 in the motion setting areas 339a and 343a, it becomes possible to cause the avatars 201a and 201b to execute complicated motions by a combination of simple motions. The set motion is repeatedly executed by the avatar 201 until the content of the motion is changed by the key icon 347.

  Furthermore, the position of the avatar 201 in the virtual three-dimensional space can be changed by adding a key icon 347 to the position setting areas 340a and 344a. In this case, by selecting an arbitrary position in the display screen 114, the position where the avatar 201 stands can be changed according to time.

  Even after the setting of the key icon 347 is completed and the key icon 347 is displayed in the timeline window 330, the setting can be changed again by clicking the key icon 347.

  The moving image program created in this way can be stored in the three-dimensional model display device, and can also be purchased by other users by uploading it on the website.

  When the edited moving image program is uploaded so that other users can purchase it, the moving image program is stored in a moving image program management table set in the HDD of the three-dimensional display server. FIG. 18 is a diagram showing a moving image program management table according to the embodiment of the present invention. The moving image program management table 401 stores a setting time 402 and detailed settings 403 for the camera, sound, background, character comment, motion, and position for each moving image program. For example, in the camera, the setting time 402 is “0 sec”, the setting 403 is “focus: character 1, rotation”, the setting time 402 is “20 sec”, and the setting 403 is “focus: character 2, zoom”. It has become. In this case, the virtual camera focuses on the character 1 and rotates around the character 1 until 20 seconds have elapsed since the start of the moving image. After 20 seconds, the character 2 becomes the focus, and the character 2 is kept in time. The image is enlarged and displayed gradually. Thus, one moving picture program is composed of a combination of settings such as a plurality of cameras, sounds, backgrounds, character comments, motions and positions.

  In addition, a user management table is provided in the HDD of the three-dimensional display server, and information on each user is managed. FIG. 19 is a diagram showing a user management table according to the embodiment of the present invention. The user management table 404 includes a user ID 405 assigned to each individual user, a head size 406 representing each component of the avatar owned by the user, a bust size 407, a head body 408, a head of the avatar (face and hairstyle ), Head data ID 409 for the design, edit data ID 410 for the wear items and moving picture programs edited by the user, and virtual currency 411 currently held by the user. In the three-dimensional display device, when trying to try on an item or displaying a preview for previewing a moving image, display data is specified based on these model data.

  Next, processing when the user selects an item or a moving image program on the website and displays the preview will be described. The user accesses the 3D model display device from the 3D model display device via the Internet. The user can log in to a website where items and video programs can be purchased by inputting a user ID and password assigned to each user.

  FIG. 20 is a flowchart for displaying a preview in which the user's own avatar is applied to an item or video program (hereinafter referred to as an item or the like) selected by the user. When the user logs in to the website, the user operates the input device 103 to accept selection of an item for which preview display is desired (step S301). Then, information regarding the selected item or the like is transmitted from the 3D model display device to the 3D model display server (step S302). When information about an item or the like is received by the 3D model display server (step S303), display data to be displayed on the 3D model display device is specified (step S304). The specified display data is transmitted to the 3D model display device (step S305). When the 3D model display device receives the display data (step S306), the selected item is worn on the display screen 114 by the user's own avatar. Or a preview when a character appearing in the selected video program is applied to its avatar is displayed.

  When displaying a preview in which an item is worn by an avatar owned by the user himself, the display data in step S304 is specified by the head size 406, bust size 407, and head and body 408 stored in the user management table 404. 3D model display data is specified based on model data such as head data ID 409 for specifying the size of the part and design data such as the avatar's face and hairstyle, and the display data of the wearing items Is done. That is, it is necessary to change the size of the wearing item in accordance with the change in the size of the head size 406, the bust size 407, and the head body 408 of the avatar. For example, if the item to be worn is a hat, even if the head of the avatar grows by changing the size of the polygon that makes up the hat according to the size of the head, the positional relationship with the avatar , Maintain large and small relationship. Then, display data is specified by performing skinning in accordance with a change in the size of the virtual skeleton. Depending on the type of item being worn, the display data depends on the size of the bust size 407 and head body 408 in the case of a jacket and the size of the head body 408 in the case of pants. Whether or not is specified is preset. As for the positional relationship between the avatar and the item, the relationship between the coordinates of the virtual skeleton and the positional coordinate of the item may be set in advance.

  When an item is purchased, display data of the purchased item is downloaded to the 3D model display device. In the three-dimensional model display device, the user can display his / her avatar wearing the purchased item on the display screen based on the size of each component of the avatar owned by the user. It is also possible to re-edit purchased items and re-sell them.

  When displaying a preview in which a moving image program created by another user is applied to an avatar owned by the user himself, the display data in step S304 is identified by the head size 406, the bust size 407, the head of the user management table 404. Model data such as head data ID 409 for specifying the size of each component stored in the body 408 and design data such as the avatar's face and hairstyle, display data of items worn by the avatar, and The display data of the three-dimensional model is specified based on the moving image program.

  When a video program created by another user is purchased, a video program (a program in which settings for camera, sound, background, character comment, motion, position, etc.) in the video program management table 401 are downloaded. The Therefore, in the 3D model display device, when the purchased video program is applied to the user's own avatar, the size of each component of the user's avatar and the design data such as the avatar's face and hairstyle are stored. Display data is specified based on model data such as head data for specifying, display data of items worn by avatars, and downloaded video programs.

  FIG. 21 is a diagram illustrating changes in the virtual skeleton and the virtual joints when the size of the avatar is changed. The avatar virtual skeleton model 451c in FIG. 21C is obtained by changing the size of the avatar's head and body in the virtual skeleton model 451a in FIG. 21A to 50%. Therefore, the virtual skeleton model 451a and the virtual skeleton model 451c are in a correspondence relationship. The virtual skeleton model 451b in FIG. 21B is obtained by moving the left hand of the virtual skeleton model 451a outward and upward by a motion program. The virtual skeleton model 451d in FIG. 21D is obtained by changing the size of the avatar's head and body in the virtual skeleton model 451b in FIG. 21B to 50%. The virtual skeleton model 451b and the virtual skeleton model 451d have a correspondence relationship, and the virtual skeleton model 451d is obtained by moving the left hand of the virtual skeleton model 451c by a motion program. The virtual skeleton model 451 includes, for example, a plurality of virtual joints 452 (indicated by circles in FIG. 21) provided on movable parts such as shoulders, elbows, and wrists, and virtual joints 452 corresponding to upper arms, lower arms, hands, and the like. Are composed of a linear virtual skeleton 453 (represented by straight lines in FIG. 21).

  In the motion program used when setting the motion of the avatar using the timeline window 330 described above, the virtual skeleton 453 before and after the movement of the virtual joint 452 is virtualized as time passes. The virtual joint 452 is moved according to the angle of the angle formed by the joint 452 and the angular velocity at the time of movement of the virtual joint 452, and motion is given to the avatar. Here, it is assumed that the virtual skeleton model 451a in FIG. 21A has a reference body part size. In the virtual skeleton model 451a of FIG. 21A, a virtual joint 452a corresponding to the neck (hereinafter referred to as a virtual joint of the neck) and a virtual joint 452b corresponding to the left elbow (hereinafter referred to as the left elbow). An angle X formed by a virtual skeleton that connects a virtual joint) and a virtual joint 452c (hereinafter referred to as a left shoulder virtual joint) corresponding to the left shoulder is 90 °. By executing the motion program, the left arm of the virtual skeleton model 451 moves outward and upward, and its angle Y is about 120 °.

  If the coordinates of the neck virtual joint 452a in the virtual three-dimensional space are (x, y, z) = (0, 0, 0), the virtual joint 452b (hereinafter referred to as the left elbow) corresponding to the left elbow. The coordinates (3, 0, -3) of the left elbow virtual joint move to (3, 0, -2.7) after 1 second. Similarly, in the virtual skeleton model 451c of FIG. 21C, when the coordinates in the virtual three-dimensional space of the neck virtual joint 452a are (x, y, z) = (0, 0, 0), The coordinates of the virtual joint 452b of the left elbow are (x, y, z) = (1.5, 0, −1.5). In this case, the angle X, the angle Y, and the angular velocity before and after the execution of the motion are set to predetermined values, so that the movement is made to (1.5, 0, -1.35). Therefore, the movement distance of the left elbow virtual joint 452b in the virtual skeleton model 451c is 50% of the virtual skeleton model 451a, as is the ratio of the size of the body part. Therefore, by adopting such a method, the moving distance and moving speed of the virtual joint are maintained in accordance with the size of the component stored in the user management table 404 while maintaining the moving direction of the virtual joint in the motion program. Can be changed, and the motion of the avatar can be displayed without a sense of incongruity.

  FIG. 22 is an example of the display screen 114 of the three-dimensional model display device according to the embodiment of the present invention. The 3D model display device connected to the 3D model display server according to the present invention via a communication line accesses the 3D model display server via a browser. A user who has accessed the 3D model display server can log in to the user's own management screen (my page) by inputting the user ID and password assigned to each user. A user management table is set in the three-dimensional model display server, and a user ID, a password corresponding to the user ID, a user name, and the like are stored. When the user ID and password entered by the user match the password corresponding to the user ID stored in the user management table, the user is logged in to the management screen unique to the user and the display screen 114 as shown in FIG. 22 is displayed. The

  A user name registered by the user and an icon 501 selected or created by the user are displayed on the upper left side of the display screen 114 in FIG. 22. A user name 502 is displayed below the icon 501. In addition, slightly on the left side of the upper center of the display screen 114 is a “My Gallery” screen for managing the clothes, hairstyles, items and accessories, motions, and movies (hereinafter referred to as design, etc.) worn by the user's own character. The hyperlink 503a for displaying is pasted. In addition, on the right side of “My Gallery”, there are a hyperlink 503b for displaying a “market” screen on which designs and the like created by other users can be purchased, and a “community” screen for participating in various communities. A hyperlink 503c for displaying, and a hyperlink 503d for displaying a “ranking” screen on which popular items or videos can be viewed are pasted.

  In the central portion of the display screen 114 of FIG. 22, “New Gravity”, “Pink Sword”, “Ken 4”, which are design items 504 (created by other users) of newly arrived items that can be purchased most recently. ”Is displayed, a new arrival corner display area 505 is provided. By clicking on these images such as “Gravea”, a screen for purchasing each design etc. 504 is displayed. Also, an unillustrated latest information corner is provided below the new arrival corner display area 505, and information such as services provided in this website is displayed in time series. A daily ranking display area 506 is provided on the right side of the display screen 114 in FIG. 22, and among the designs 504 that can be purchased, items having a high purchase frequency or a high evaluation of the purchased user (“Piston Ozawa”) 506a, “GRAVIA” 506b, “Pink Sword” 506c, etc.) are displayed. By clicking these images, a screen for purchasing each design etc. 504 is displayed. Further, although not shown in the drawing, “My Friend List” for displaying a list of other familiar users, “User Friend” for displaying a list of users who are better friends than those registered in “My Friend List”. “Favorite members” and “community list” tags for displaying a list of communities to which the user belongs are displayed. By clicking these tags, the respective contents are displayed on the display screen 114. .

  FIG. 23 is an example of the display screen 114 of the three-dimensional model display device according to the embodiment of the present invention. As described with reference to FIG. 22, when the hyperlink 503a for displaying the “My Gallery” screen displayed at the top of the display screen 114 is clicked, the display screen 114 as shown in FIG. 23 is displayed. A plurality of designs 504 created by the user himself / herself are displayed at the bottom of the display screen 114. Of the designs etc. 504 displayed on the display screen 114, the second design etc. 504f from the right is made public so that other users can purchase it. Nothing is displayed. On the other hand, other designs etc. 504d, 504e, 504g are not made public so that other users can purchase them at the present stage, and “not yet” is displayed above the images of these designs etc. 504d, 504e, 504g. “Public” is displayed. The design name (or motion name / movie name) set in the design etc. 504 is displayed at the bottom of each design etc. 504. Note that the user management table stores edit data IDs for designs 504 created by the user, and based on these edit data IDs, the clothes, hairstyles, and items worn by the character created by the user. And data such as accessories, motion data, and movie data are specified.

  When the user clicks an image of an unpublished design or the like 504, a display screen 114 as shown in FIG. 24 is displayed. In this case, “Coordinate A”, which is a design in which clothes, accessories, hairstyles, and the like worn by the character are coordinated in total, will be described. “Coordinate A” is displayed in the content display area 507 on the left side from the center of the display screen 114. On the right side of the display screen 114, selection buttons 508 a, 508 b, 508 c, 508 d, and 508 e such as “Purchase”, “Try on”, “Introduce in album”, “Sale”, “Edit information” and the like are displayed. It is displayed. When the “sale” selection button 508a is clicked, a screen for managing sales information as shown in FIG. 25 is displayed. “Coordinate A” is composed of a plurality of design data such as hairstyles, accessories, and clothes, and can be sold for each design data. “Coordinate A” is displayed in the upper part of the content display area 507b, and designs “504h” and “504i” such as “black” and “white” constituting “Coordinate A” are displayed below the content display area 507b.

  For each design data, a sales status 509 (sold, currently in sale or before sale), number of sales 510, and price 511 are displayed. The price 511 is determined based on the virtual currency “Mt”, and the virtual currency “Mt” can be used to purchase and sell design data, motion data, and movie data (design data, etc.). With respect to design data whose sales status 509 is pre-sale, the user can arbitrarily set the number of sales 510 and the price 511. When the user inputs the number of sales 510 and the price 511 and clicks a confirmation button not shown in FIG. 25, a confirmation screen is displayed. The user confirms the confirmation screen, and confirms whether the number of sales 510 and the price 511 of each design data are input as intended. When the determination button is clicked, the design data constituting “coordinate A” designated by the user is disclosed to other users. These design data can be purchased until the number purchased by another user reaches the number of sales 510 set by the user.

  When the user clicks on the hyperlink 503b for displaying the “market” screen provided at the top of the display screen 114, the design data published by other users and the user himself / herself can be confirmed in the content display area 507. it can. In FIG. 26, images about a plurality of design data and the like are displayed in the content display area 507, and it can be seen that “coordinate A” (second column from the top, second from the left) can be purchased. Below the image displayed for each design data, the design name and the price are displayed. When an image displaying “Coordinate A” in FIG. 26 is clicked, a screen as shown in FIG. 27 is displayed.

  Select buttons 508a, 508b, 508c, 508f, 508e such as “Purchase”, “Try on”, “Introduce in album”, “Cancel sales”, “Edit information”, etc., provided on the right side of FIG. Among them, when the user himself has created “Coordinate A”, it is possible to select the selection button 508f of “withdraw sales”. By clicking the “cancel sales” selection button 508f and determining to cancel the sales, it is possible to make the published design data once again unpublished.

  When the user clicks the “Purchase” selection button 508a, the user can purchase design data or the like. The user management table stores the amount of virtual currency that the user currently holds, and purchases design data, motion data, and movie data (hereinafter referred to as design data) that are more expensive than the amount of the virtual currency. Can not do it. Further, when design data or the like created by the user himself / herself and started to be sold is purchased by another user, the virtual currency possessed by the user of the selling source is added by the set price for each sales number. . Conversely, the virtual currency possessed by other users who have purchased the design data is subtracted by the set price.

  The design data and the like purchased through the 3D model display server are created by other users, but can be re-edited by the purchased user using the 3D model display device. The re-edited design data or the like can be sold by the re-edited user. If it is not desired that other users edit the design data or the like edited by the user, it is possible to start selling after setting the other users so that they cannot be edited.

  When the user clicks the “try on” selection button 508b, a preview display is displayed as to what is displayed when the user's own avatar wears clothes, hairstyles, items, accessories, etc. to be tried on. Is made. Since the shape and expression of the avatar's face and the size of the avatar's head, trunk, and chest are different for each user, it can be confirmed by fitting whether or not it matches the user's own avatar. The size of the avatar's head, torso, and chest that the user has is managed in the user management table, and the display data related to the preview display displayed on the display screen 114 of the 3D model display device is stored in the user management table. Are dynamically generated by the three-dimensional model display server based on the sizes of the head, torso, and chest that are managed in this manner. For example, if the design data to be displayed for preview is related to a hairstyle, the size of the hairstyle for preview display is determined according to the size of the avatar's head, and the preview is displayed.

  When the design data to be previewed is related to the upper body and the lower body, the size of the clothes for the preview display is determined according to the size of the body part of the avatar, and the preview is displayed. In the present invention, the size of the body part of the avatar can be changed by the three-dimensional model display device, but the ratio of the distances between the virtual joints constituting the virtual skeleton provided in the avatar is always constant. Kept. That is, even if the size of the avatar's torso is changed, for example, the distance between the virtual joints of the wrist and elbow parts of the virtual skeleton and the distance between the virtual joints of the elbow parts and the shoulder parts is always a constant ratio. It remains. Therefore, when previewing the avatar's appearance, if the size of the clothing display data to be previewed is determined according to the size of the torso, the length of the clothing is good but the sleeves are short Such a problem will not occur. Even when the purchased design data is edited or viewed on the 3D model display device without using the 3D model display server, the avatar using the purchased design data is displayed in the same manner. .

  Up to this point, the description has mainly focused on selling and purchasing design data. However, as shown in FIG. 28, motion data (or movie data) edited by the user can also be sold. On the right side of the display screen 114 of FIG. 28, selection buttons 508g, 508h, 508i such as “Purchase”, “View”, “Introduce in album”, etc. are provided. By clicking 508g, it is possible to purchase the motion data displayed in the content display area 507.

  In addition, by clicking the “view” selection button 508h, a preview display is made as to what is displayed when the same motion is executed by the user's own avatar. Since each user has a different avatar face shape and expression, avatar head, body, and chest size, it is possible to check whether the motion matches the user's own avatar or is interesting. It becomes. The size of the head, torso, and chest of the avatar that the user has is managed in the user management table, and the motion data related to the preview display displayed on the display screen 114 of the 3D model display device is stored in the user management table. Are dynamically generated by the three-dimensional model display server based on the sizes of the head, torso, and chest that are managed in this manner.

  By the way, depending on the movie data, a plurality of characters may appear in the movie. Therefore, when the “view” selection button 508h is selected for the movie data and the preview display is performed, it is also possible to select which character to be played by the user's avatar. For example, all the characters may be avatars that the user has, or one of the characters may be an avatar that the user has, and other characters may use characters as set in the movie data. When the user has a plurality of avatars, it is also possible to assign an avatar for each character in the movie.

  In order to publish or sell design data and character data edited using a 3D model display device on a website, it is necessary to upload these data to a 3D model display server. In this case, the edited design data is transmitted together with the user ID, and the design data and the corresponding edited data ID are managed in the user management table of the three-dimensional model display server. On the other hand, when re-editing design data purchased via a website using a 3D model display device, it is necessary to download these design data and the like from the 3D model display server. In this case, the user ID is transmitted from the 3D model display device to the 3D model display server, and the design data and the like possessed by the user are downloaded to the 3D model display device.

101 CPU
102 Main memory 103 Input device 104 Display device 105 HDD
106 CD-ROM / DVD drive 114 Display screen 121 Recording medium 201 Avatar 202 Clothing model 203 Type 301 Character editor window 305 Clothing editor window 311 Proportion editor window 316 Motion editor window 320 Face editor window 327 Texture editor window 328 Tool window 329 Layer window 330 Timeline Window 401 Movie Program Management Table 404 User Management Table 451 Virtual Skeleton Model

Claims (4)

A 3D model display system comprising a 3D model display device for displaying a 3D model assigned to each user, and a 3D model display server connected to the 3D model display device via a communication line,
3D model display device
In accordance with the operation of the input device by the user, a setting relating to the size of each component constituting the three-dimensional model, and model data editing means for editing display data of each component,
Model data transmission means for transmitting the setting related to the size of each component edited by the model data editing means and edit model data related to the display data of each component to the three-dimensional model display server;
Wearing item selection receiving means for receiving selection of a wearing item to be worn by the three-dimensional model according to the operation of the input device by the user;
Wearing item information transmitting means for transmitting the wearing item information related to the wearing item received by the wearing item selection receiving means to the three-dimensional model display server;
3D model display server
Model data receiving means for receiving edit model data from the three-dimensional model display device;
Model data storage means for storing edited model data received by the model data receiving means;
Wear item display data storage means for storing display data of a plurality of wear items;
Wearing item correspondence storage means in which the correspondence between each wearing item and each component constituting the three-dimensional model is stored;
Wearing item information receiving means for receiving wearing item information from the three-dimensional model display device;
For the wearing item corresponding to the wearing item information received by the wearing item information receiving means, the setting relating to the size of each component stored in the model data storage means, and the wearing item stored in the wearing item correspondence storage means Wear item display data changing means for changing the display data of the wear item stored by the wear item display data storage means according to the relationship with each component,
3D based on the settings related to the size of each component stored in the model data storage means, the display data of each component, and the display data of the wear item changed by the wear item display data change means A model display data specifying means for specifying the display data of the model;
Model display data transmitting means for transmitting the display data of the three-dimensional model specified by the model display data specifying means to the three-dimensional model display device,
3D model display device
Display the display data of the 3D model received from the 3D model display server on the display device as a 2D image;
A wearing item editing means for editing display data of the wearing item,
A three-dimensional model display system in which a wear item selected by a wear item selection receiving unit is a wear item whose display data is edited by a wear item editing unit in another three-dimensional model display device. A 3D model display system comprising a 3D model display device for displaying a 3D model assigned to each user, and a 3D model display server connected to the 3D model display device via a communication line,
3D model display device
Model data editing means for editing the setting regarding the ratio of the size of the virtual skeleton of each component constituting the three-dimensional model and the display data of each component according to the operation of the input device by the user
Model data transmitting means for transmitting the setting relating to the ratio of the size of the virtual skeleton of each component edited by the model data editing means, and edit model data regarding the display data of each component to the three-dimensional model display server;
A moving image program selection receiving means for receiving selection of a moving image program to be executed by the three-dimensional model according to an operation of the input device by the user;
Moving image program information transmitting means for transmitting moving image program information related to the moving image program received by the moving image program selection receiving means to the three-dimensional model display server;
3D model display server
Model data receiving means for receiving edit model data from the three-dimensional model display device;
Model data storage means for storing edited model data received by the model data receiving means;
Moving image program storage means for storing a moving image program for causing a three-dimensional model to execute a predetermined motion;
Moving image program information receiving means for receiving moving image program information from the three-dimensional model display device;
Of the moving image programs stored in the moving image program storage means, the moving image data corresponding to the moving image program information received by the moving image program information receiving means is stored in the model data storage means when the moving image program is executed. Video data specifying means for specifying according to the edited model data,
Moving image data transmitting means for transmitting the moving image data specified by the moving image data specifying means to the three-dimensional model display device;
3D model display device
The moving image data received from the 3D model display server is displayed on the display device as a 2D image,
Furthermore, a video program editing means for editing the video program is provided,
The moving image program adds motion to the three-dimensional model by moving the virtual joints constituting the virtual skeleton set in the three-dimensional model to different positions as the execution time of the program elapses. The virtual joint is moved to a different position according to the angle of the angle formed by the virtual skeleton in the virtual joint ,
A three-dimensional model display system in which the moving picture program selected by the moving picture program selection receiving means is a moving picture program edited by a moving picture program editing means in another three-dimensional model display device. The moving image program moves the virtual joint to a different position according to the predetermined angle before and after the movement of the virtual joint about the angle formed by the virtual skeleton in the virtual joint, and the angular velocity at the time of the movement of the virtual joint. The three-dimensional model display system according to claim 2, wherein In the video program, sound is generated by predetermined sound data as the program execution time elapses, text sentences are displayed as the program execution time elapses, and / or as the program execution time elapses 4. The three-dimensional model display system according to claim 2, wherein the position, focus, or orientation of the virtual camera for displaying the two-dimensional image is changed.

Images