JPWO2020009066A1 - Virtual fitting device, virtual fitting method, and virtual fitting program - Google Patents

Abstract

A virtual fitting technique capable of generating a composite image of three-dimensional images with a low load. The virtual fitting apparatus includes a model information receiving unit that receives a head image of a model and body type information of the model from a terminal device, a plurality of arbitrary clothes in the same body part, and a clothing order that receives the arbitrary clothing order. A two-dimensional image corresponding to an arbitrary plurality of clothes is extracted from the information receiving unit and an image information database obtained by converting the clothing state of a plurality of clothes into a two-dimensional image, and the two-dimensional image is superposed based on the clothing order. And a conversion processing unit that converts the superimposed image into a three-dimensional image based on the body shape information, and a transmission unit that transmits the three-dimensional image and the head image to the terminal device. ing.

Description

The present invention relates to a virtual fitting device, a virtual fitting method, and a virtual fitting program.

Trying on clothes is usually done when purchasing clothes. In order to try on clothes, the purchaser goes to a store that sells clothes, selects clothes, moves to a space provided for try-on, and tries on clothes. The purchaser must undress the clothing they were wearing to try it on, and doing this in a tight fitting space can be difficult and can add stress to the purchaser. ..

On the other hand, in recent years, it has become commonplace to purchase clothes at an internet shop that is not restricted by the timing or place of purchasing clothes. However, in this case, the buyer cannot try on the product he is wondering whether or not to purchase it, so if he/she decides not to make a decision, he/she gives up the purchase, or even if he/she purchases it, the clothes do not fit and the clothes are not fit. You may be left without doing anything.

In order to improve such a situation, a system has been developed that allows the user to try on clothes he/she is unsure of purchasing through the Internet. For example, in Patent Literature 1, an image of a clothing item is captured by capturing an image of a fitting person to which a code label on which a code image is formed by an image capturing unit is attached, and detecting the code position that is the position of the code image in the captured image. There is disclosed a virtual fitting system that generates a composite image by generating a composite image arranged on a captured image based on the detected code position. In this system, one piece of clothes can be tried on to one part of the person trying on the clothes. For example, one piece of clothing can be selected for each of the hat, tops, and bottoms. Therefore, in this case, the fitting person cannot try on a plurality of clothes by stacking them.

It is possible to superimpose a plurality of three-dimensional images in order to realize layering in a virtual space. When the three-dimensional images are superposed on each other, the vertical relationship between the plurality of clothes cannot be accurately reproduced, and a so-called “penetration” in which the inner clothes penetrate the outer clothes may occur. FIG. 16 is a schematic diagram showing a combination of three-dimensional images of a plurality of clothes and the result thereof. As is clear from the figure, the uncertainty is high and the vertical relationship between the clothes cannot be properly expressed simply by combining the three-dimensional images. Such a composite image is unsuitable as a try-on image, and is unlikely to support the purchaser's purchase of clothes.

It is also possible to synthesize three-dimensional images of a plurality of clothes by physical calculation. FIG. 17 is a schematic diagram showing a composite image obtained by using a method of forcibly approaching a neighboring polygon, as an example of a composite result using physical calculation. As shown in FIG. 17, there is a method called Shrink Wrap as a method for forcibly approaching a near polygon. It can be seen that the vertical relationship between clothes is appropriately processed as compared with the general three-dimensional image composition shown in FIG. However, it is still not practical because the unevenness on the surface cannot be maintained, a defect occurs in a region where clothes are not present, and the processing result cannot be predicted in advance. The physical calculation has a very high calculation load, and it is impossible to complete the processing immediately with a normal device. For example, it is possible to generate a composite image of many three-dimensional images in a short time like trying on clothes. In some cases it is an inappropriate method. On the other hand, if the calculation load is reduced, the quality of the physical calculation becomes low, and in some cases, the clothes may penetrate. When a physical operation is used to obtain a virtual fitting image, it is impossible to immediately complete the three-dimensional image synthesizing process, which is likely to cause stress to the user, and the virtual fitting image cannot be viewed. , There is a possibility that the purchase of clothes will not be reached.

In order to improve the accuracy of the composite image of the three-dimensional image, it is possible to adopt a method such as surface deformation as a method that can be processed on the DCC tool, but the calculation load is high, and many methods such as clothing fitting are required. This is an unsuitable method when a composite image of three-dimensional images is generated in a short time.

JP, 2017-156957, A

Therefore, the inventors have come up with a virtual fitting device, a virtual fitting method, and a virtual fitting program that have a low calculation load and improve the accuracy of a composite image of three-dimensional images. That is, the present invention has been made in view of the above circumstances, and an object thereof is to provide a virtual fitting device, a virtual fitting method, and a virtual fitting program that can generate a composite image of three-dimensional images with a low load.

(1) According to a first aspect of the present invention, a model information receiving unit that receives a head image of a model and body type information of the model from a terminal device, a plurality of arbitrary clothes and a plurality of arbitrary clothes in the same body part. 2D image corresponding to a plurality of arbitrary clothes is extracted from the clothes information receiving unit that receives the clothes order and the image information database in which the clothes state of the plurality of clothes is converted into a two-dimensional image, and the two-dimensional image is obtained based on the clothes order. A generation processing unit that generates a superimposed image by superimposing images, a conversion processing unit that converts the superimposed image into a three-dimensional image based on body type information, and a transmission unit that transmits the three-dimensional image and the head image to the terminal device. And a virtual fitting apparatus including:

(2) In (1) above, the generation processing unit may generate a superimposed image by superimposing the converted two-dimensional images by commonly using an arbitrary intermediate polygon model.

(3) In (2) above, the conversion processing unit may generate a virtual human body model of the model by correcting an arbitrary intermediate polygon model based on the body type information. The conversion processing unit converts the virtual human body model into a virtual human body model. The superimposed image may be converted into a three-dimensional image by further superimposing the superimposed image.

(4) In (2) or (3) above, the generation processing unit may generate a superimposed image by superimposing a distance image and a normal image included in the two-dimensional images of a plurality of clothes.

(5) In the above (4), the generation processing unit adds the magnitude of the distance held by the distance image in one normal direction included in the normal image from the innermost clothes to the outermost clothes. The superimposed image may be generated by calculating the distance in the line direction.

(6) In the above (5), the generation processing unit may measure the magnitude of the distance of the distance image in one normal direction among the plurality of normal directions included in the normal image, and the normal line near the one normal direction. The overlapped image may be generated by bringing the distance in the normal direction having a smaller distance closer to the distance in the normal direction having a larger distance, depending on the difference between the distance image in the direction and the distance size.

(7) In the above (5) or (6), the image information database may further include material information or rigidity information of a plurality of clothes, and the generation processing unit determines the normal direction based on the material information or rigidity information. A superimposed image may be generated by correcting the distance.

(8) In any one of (4) to (7) above, the two-dimensional image may further include a color image, and the generation processing unit includes the color of the three-dimensional image in the two-dimensional images of a plurality of clothes. The superimposed image may be generated by setting the color of the portion having the outermost distance in the normal line direction as the color in the normal line direction when the distance image and the normal line image are overlapped.

(9) In the above (8), the generation processing unit corrects the colors in the normal direction based on the colors of the outer clothes of the plurality of clothes and the inner clothes of the outer clothes, and the transparency of the outer clothes. A superimposed image may be generated.

(10) According to a second aspect of the present invention, a step of receiving a head image of a model and body type information of the model from a terminal device, a plurality of arbitrary clothes and a wearing order of the plurality of arbitrary clothes in the same body part. And a two-dimensional image corresponding to an arbitrary plurality of clothes is extracted from the image information database in which the clothing states of the plurality of clothes are converted into a two-dimensional image, and the two-dimensional image is superposed based on the clothing order. And a step of converting the superimposed image into a three-dimensional image based on the body shape information, and a step of transmitting the three-dimensional image and the head image to the terminal device. Regarding

(11) According to a third aspect of the present invention, a function of allowing a computer to receive a model head image and body type information of the model from a terminal device, and a plurality of arbitrary clothes and a plurality of arbitrary clothes in the same body part. 2D images corresponding to arbitrary plural clothes are extracted from the image information database in which the clothes state of plural clothes is converted into a two-dimensional image, and the two-dimensional images are superposed based on the clothes order. And a function of generating the superimposed image, a function of converting the superimposed image into a three-dimensional image based on body type information, and a function of transmitting the three-dimensional image and the head image to the terminal device. About virtual fitting program to do.

According to the present invention, a virtual fitting apparatus and a virtual fitting method capable of generating a composite image of three-dimensional images with a low load because conversion to a three-dimensional image is performed based on a superimposed image obtained by overlapping two-dimensional images of a plurality of clothes. , And a virtual fitting program can be provided.

It is a schematic diagram for demonstrating an example of a process by a virtual fitting system. It is a figure which shows an example of a schematic structure of a virtual fitting system. It is a figure which shows an example of schematic structure of a user's terminal device. It is a figure which shows an example of a schematic structure of a server. It is a table which shows an example of a clothing database which stores detailed information of a plurality of clothing. It is a table showing an example of a user database which stores information on a plurality of users. An example of the distance image of arbitrary clothes is shown. An example of the normal image of arbitrary clothes is shown. An example of the color image of arbitrary clothes is shown. It is a schematic diagram which shows the two-dimensional image of the clothes whose clothing order is the innermost side. It is a schematic diagram which shows the two-dimensional image of the clothing which has the next clothing order of the innermost clothing. It is a schematic diagram which shows the result of superposing the two-dimensional image of an inner and an outer. It is a figure for demonstrating conversion of the superposition image of a two-dimensional image into a three-dimensional image by a conversion part. It is a figure which shows an example of the operation sequence of a series of flow of a new member registration process of the user by the virtual fitting system concerning this embodiment. It is a figure which shows an example of the operation sequence of a series of flow of the production|generation process of the virtual fitting image of several clothes by the virtual fitting system concerning this embodiment. It is a schematic diagram which synthesize|combines the three-dimensional image of several clothes, and shows the result. It is a schematic diagram which shows the synthetic|combination image obtained using the method of making it approach a proximity polygon forcibly. FIG. 10 is a schematic diagram showing a two-dimensional image (clothes image) of clothes in which the clothing order is the innermost side according to the second embodiment. FIG. 10 is a schematic diagram showing a two-dimensional image (vector displacement map) of clothes in which the clothing order is innermost according to the second embodiment. FIG. 13 is a schematic diagram showing a two-dimensional image (clothes image) of clothes whose clothing order is the outermost part according to the second embodiment. FIG. 12 is a schematic diagram showing a two-dimensional image (vector displacement map) of clothes whose clothing order is the outermost side according to the second embodiment. It is a schematic diagram which shows the image which applied the alpha channel of the image of clothes to a vector displacement map regarding the clothes whose clothing order is innermost. FIG. 6 is a schematic diagram showing an image in which the alpha channel of the image of the clothes is applied to the vector displacement map for the clothes whose clothing order is the outermost side. It is a schematic diagram which shows the image (alpha synthetic|combination of the images of clothes) which superimposed the image of the clothes of the innermost side and the image of the outermost clothes. It is a schematic diagram which shows the image (alpha composite of vector displacement maps) which superposed the image of the innermost clothes and the image of the outermost clothes.

Hereinafter, a virtual fitting device, a virtual fitting method, and a virtual fitting program according to one aspect of the present disclosure will be described with reference to the drawings. However, it should be noted that the technical scope of the present disclosure is not limited to those embodiments and extends to the invention described in the claims and equivalents thereof.

[First Embodiment]
(Outline of processing by virtual fitting system 1)
FIG. 1 is a schematic diagram for explaining an example of processing by the virtual fitting system 1.

The virtual fitting system 1 includes terminal devices 2 of a plurality of users, and a server 3 that communicates with the terminal devices 2 of the plurality of users. The server 3 includes a clothing database 311 that stores information about a plurality of clothes and a user database 312 that stores information about a plurality of users. In the present invention, a plurality of users who seek virtual fitting are called models.

The server 3 receives the selection of the plurality of clothes stored in the clothes database 311 from the terminal devices 2 of the plurality of users. Further, the server 3 also receives the clothing order of the plurality of clothings. The server 3 generates a try-on image of a plurality of clothes for which selections have been accepted from each of the plurality of users, based on the information received from the terminal devices 2 of the plurality of users and the information of the plurality of users stored in the user database 312. Then, the fitting images are transmitted to the terminal devices 2 of a plurality of users. The present invention is characterized by the technique of generating try-on images of a plurality of clothes by the server 3.

The above description of FIG. 1 is merely for the purpose of deepening the understanding of the content of the present invention. The present invention is specifically implemented in each of the embodiments described below, and may be implemented by various modifications without substantially exceeding the principle of the present invention. All such modifications are within the scope of the invention and the disclosure herein.

(Schematic configuration of virtual fitting system 1)
FIG. 2 is a diagram showing an example of a schematic configuration of the virtual fitting system 1.

The virtual fitting system 1 has a plurality of user terminal devices 2, 2, 2,... And a server 3. Below, the terminal device 2 of a some user may only be called the terminal device 2 of a user. The user's terminal devices 2, 2, 2,... And the server 3 are connected to each other via a communication network such as the Internet 4, for example. Further, although one Internet 4 is illustrated here, if the Internet 4 is composed of a plurality of networks, a gateway (not shown) may be appropriately provided between the networks. Communication with a program executed by the server 3 (for example, a management program) is performed using a communication protocol such as a hypertext transfer protocol (HTTP).

(Schematic configuration of user's terminal device 2)
FIG. 3 is a diagram illustrating an example of a schematic configuration of the user's terminal device 2.

The terminal device 2 executes connection to a wireless communication network, web access, and the like. Therefore, the terminal device 2 includes a terminal communication unit 211, a terminal storage unit 212, a terminal operation unit 213, a terminal display unit 214, and a terminal processing unit 215.

A multi-functional mobile phone (so-called “smartphone”) is assumed as the terminal device 2, but the present invention is not limited to this. The terminal device 2 may be any one to which the present invention can be applied, and examples thereof include a tablet PC, a notebook PC, a mobile phone (so-called “feature phone”), a personal digital assistant (PDA), a portable game machine, a portable music player, and a tablet terminal. , And so on.

The terminal communication unit 211 includes a communication interface circuit and connects the terminal device 2 to the Internet 4. The terminal communication unit 211 transmits the data supplied from the terminal processing unit 215 to the server 3 or the like via the network. Further, the terminal communication unit 211 supplies the data received from the server 3 or the like via the network to the terminal processing unit 215.

The terminal storage unit 212 includes, for example, a semiconductor memory device. The terminal storage unit 212 stores an operating system program, a driver program, an application program, data, and the like used for the processing in the terminal processing unit 215. For example, the terminal storage unit 212 stores, as the driver programs, an input device driver program that controls the terminal operation unit 213, an output device driver program that controls the terminal display unit 214, and the like. Further, the terminal storage unit 212 displays, as an application program, a registration screen for registering the search conditions, the characteristic information, the characteristic image, and the like input by the store personnel operating the terminal operation unit 213 in the server 3. Memorize browsing programs. Various programs may be installed in the terminal storage unit 212 from a computer-readable portable recording medium such as a CD-ROM or a DVD-ROM using a known setup program or the like. Further, the terminal storage unit 212 may temporarily store temporary data related to a predetermined process.

The terminal operation unit 213 may be any device as long as it can operate the terminal device 2, and is, for example, a touch panel, but a mouse, a key button, or the like may be connected to the outside of the terminal device 2. The user can use the terminal operation unit 213 to select or cancel information, and input characters or numbers. When operated by the user, the terminal operation unit 213 generates a signal corresponding to the operation. Then, the generated signal is transmitted to the terminal processing unit 215.

The terminal display unit 214 may be any device as long as it can display images and images, and is, for example, a liquid crystal display or an organic EL (Electro-Luminescence) display. The terminal display unit 214 displays a video according to the video data supplied from the terminal processing unit 215, an image according to the image data, and the like.

The terminal processing unit 215 includes one or more processors and their peripheral circuits. The terminal processing unit 215 comprehensively controls the overall operation of the terminal device 2, and is, for example, a CPU. The terminal processing unit 215 and the terminal communication unit 211 and the terminal communication unit 211 execute the various processes of the terminal device 2 in an appropriate procedure based on a program stored in the terminal storage unit 212 and an operation of the terminal operation unit 213. The operation of the display unit 214 and the like is controlled. The terminal processing unit 215 executes processing based on a program (operating system program, driver program, application program, etc.) stored in the terminal storage unit 212. Further, the terminal processing unit 215 can execute a plurality of programs (application programs and the like) in parallel.

The terminal processing unit 215 has a function of processing the screen display information received from the outside of the terminal device 2 as a screen display that can be viewed by the user, and a process based on the operation content of the terminal operation unit 213 from the user of the terminal device 2. It has a function of converting to a signal that can be transmitted to the outside and sending it to the terminal communication unit 211. These functions are functional modules realized by a program executed by a processor included in the terminal processing unit 215. Alternatively, each of these units may be implemented in the terminal device 2 as an independent integrated circuit, a microprocessor, or firmware.

(Schematic configuration of server 3)
FIG. 4 is a diagram showing an example of a schematic configuration of the server 3.

The server 3 includes a server storage unit 313 that includes a clothing database 311 that stores information about a plurality of clothes and a user database 312 that stores information about a plurality of users. The server 3 transmits the search result of desired clothes from the clothes database 311 to the user terminal device 2 according to the search conditions from the terminal devices 2 of the plurality of users. Further, when the server 3 receives a request to generate a try-on image of a plurality of selected clothes from the terminal devices 2 of a plurality of users, the server 3 stores the user's body shape information stored in the user database 312 and the clothes database 311. A three-dimensional image as a virtual fitting image of a plurality of clothes selected based on the two-dimensional image is transmitted to the terminal devices 2 of a plurality of users. In order to realize the above functions, the server 3 further includes a server processing unit 317 including a reception unit 314, a generation unit 315, and a conversion unit 316, and a server communication unit 318, in addition to the server storage unit 313.

The clothing database 311 stores clothing vendor information, manufacturer information, manufacturing size information, clothing category information, selling price information, salable time information, and the like in association with a plurality of clothing identification information. Further, the clothing database 311 stores a two-dimensional image of the corresponding clothing for each piece of clothing identification information.

The user database 312 stores the user's email address, the user's gender, the user's age, etc. in association with the user identification information (user ID) of the plurality of users. Further, the user database 312 stores the body type information of the user.

The server storage unit 313 has, for example, at least one of a semiconductor memory, a magnetic disk device, and an optical disk device, and is connected to the server 3 via a bus. The server storage unit 313 stores a driver program, an operating system program, an application program, data and the like used for the processing by the server processing unit 317. For example, the server storage unit 313 stores, as the driver program, a communication device driver program that controls the server communication unit 318. The computer program may be installed in the server storage unit 313 from a computer-readable portable recording medium such as a CD-ROM or a DVD-ROM using a known setup program or the like. The server storage unit 313 also stores a clothing database 311 and a user database 312.

In addition, the server storage unit 313 stores the clothes identification information and the user identification information of the clothes that have been selected from the terminal devices 2 of the plurality of users, the superimposed image obtained by superimposing the two-dimensional images, and the three-dimensional image (virtual fitting) on the superposed image. It also functions as a temporary storage unit that temporarily stores images converted into images).

The server storage unit 313 may be composed of one storage area or may be composed of a plurality of storage areas. Furthermore, the server storage unit 313 may not exist inside the server 3. For example, a cloud server or the like is one example.

The server processing unit 317 includes a reception unit 314, a generation unit 315, and a conversion unit 316. The function of the server processing unit 317 is a functional module implemented by a program executed by a processor included in the server processing unit 317. Alternatively, each of these units may be implemented in the server 3 as an independent integrated circuit, a microprocessor, or firmware. The processing contents of the server processing unit 317 will be described later. Further, the division of the constituent elements of the server processing unit 317 is an example, and which constituent element performs which processing is not limited to the description of the present embodiment.

The reception unit 314 collectively receives various information received from the terminal devices 2 of a plurality of users via the server communication unit 318 described below. Specifically, the reception unit 314 receives a new user registration from the user. At this time, the server 3 may prompt the user to register the information stored in the user database 312 with the user in advance. For example, the reception unit 314 receives the head image of the user and the body type information of the user. The head image may be a three-dimensional image that is 3D-scanned by the user terminal device 2 or a two-dimensional image that is captured by the user terminal device 2. Further, the user may store an arbitrary head image in the user database 312 instead of the user's own head image. The image may be an animation or the like. After the user registration, the accepting unit 314 accepts the search conditions of the plurality of clothes stored in the clothes database 311 from the terminal devices 2 of the plurality of users, and stores the plurality of clothes stored in the clothes database 311 for virtual fitting. Selective input of arbitrary clothes from the clothes and the order of wearing the clothes. Further, the reception unit 314 receives a request for generating a fitting image in which virtual fitting is visualized. In the present invention, the reception unit 314 can correspond to the model information reception unit and the clothes information reception unit. The server storage unit 313 stores the various information received by the reception unit 314 in the clothing database 311, the user database 312, and the temporary storage area. Which information is stored in each database or storage area is arbitrary in the present invention and is not particularly a limitation on the present invention.

First, the generation unit 315 extracts clothing information based on a search condition for selecting an arbitrary clothing from the clothing database 311 received from the terminal devices 2 of a plurality of users. The generation unit 315 extracts from the clothing database 311 a two-dimensional image corresponding to a plurality of clothes selected and input from the terminal devices 2 of a plurality of users, and puts it in the order of wearing received from the terminal devices 2 of a plurality of users. A two-dimensional image is superposed on the basis to generate a superposed image. The details of the generation process of the generation unit 315 will be described later. The generation unit 315 can correspond to the generation processing unit in the present invention. Note that the generation unit 315 may consider the clothing order of clothes of a plurality of parts. That is, the user can select whether to wear the tops in the bottoms or to put the tops out of the bottoms. In this case, the accepting unit 314 may accept the order of wearing clothes in different parts in addition to the order of wearing clothes in the same part.

The conversion unit 316 corrects the common intermediate polygon model based on the body shape information of the user received by the reception unit 314 and synthesizes the head image to generate the virtual human body model of the user, and the virtual human body model is converted into the virtual human body model. The superimposed image generated by the generation unit 315 is further superimposed to convert the superimposed image into a three-dimensional image (that is, a virtual fitting image). Here, when the user's head image is a three-dimensional image, the conversion unit 316 can generate a virtual fitting image in which the user is actually trying on clothes by combining the head images. On the other hand, when the user's head image is a two-dimensional image, the conversion unit 316 needs to convert the two-dimensional image of the user's head together with the two-dimensional image of the clothes into a three-dimensional image. That is, in the server 3, the generation unit 315 superimposes a plurality of clothes images at the stage of the two-dimensional image and converts the superposed image into a three-dimensional image. Can be generated. The conversion unit 316 can correspond to the conversion processing unit in the present invention.

The server communication unit 318 has a communication interface circuit for connecting the server 3 to the Internet 4. The server communication unit 318 transmits a search request or a fitting image generation request from the terminal devices 2 of a plurality of users to the reception unit 314. In addition, the server communication unit 318 transmits the clothing images extracted by the generation unit 315 from the clothing database 311 to the terminal devices 2 of the plurality of users, and the three-dimensional images generated by the generation unit 315 and the conversion unit 316 of the plurality of users. It is transmitted to the terminal device 2. The server communication unit 318 can correspond to the transmission unit in the present invention.

(Table data structure)
5 and 6 are diagrams showing examples of the structures of the clothing database 311 and the user database 312.

FIG. 5 is a table showing an example of a clothing database 311 that stores detailed information of a plurality of clothing. The clothing database 311 stores, in association with a plurality of pieces of clothing identification information (clothing ID), clothing manufacturer information, size information, clothing category information, selling price information, salable period information, and the like. Further, the clothing database 311 stores a two-dimensional image of the corresponding clothing for each piece of clothing identification information. The two-dimensional image of this clothes includes a distance image, a normal image, and a color image, as described later. In the clothing database 311 shown in FIG. 5, only the path for calling the two-dimensional image is stored. The two-dimensional image of the clothes may be created from the pattern of the clothes, or may be created based on a 3D scan of the completed clothes or the like. In the present embodiment, the two-dimensional image is stored in the clothing database 311 by using the 3D-scanned image as various images or maps. The clothing database 311 that stores the 3D-scanned image can correspond to the image information database in the present invention.

As shown in FIG. 5, different sizes of the same clothes are managed by the clothes database 311 by assigning branch numbers as clothes identification numbers. This makes it easier for the user to search for products of different sizes for clothes of the same design. Further, the manufacturer, category, and color are information entered for the convenience of the user's search. The sale price and the sale start time and the sale end time as the sale possible time are necessary information when the virtual fitting system 1 also sells clothes.

FIG. 7 shows an example of a distance image of arbitrary clothes. The distance image may be prepared in advance by the virtual fitting system 1 or may be created outside the virtual fitting system 1. For the distance image, an arbitrary intermediate polygon model is prepared, and the distance (displacement) at each pixel is obtained by acquiring the difference between the intermediate polygon model and the polygon model of the arbitrary clothing. The distance image is obtained by two-dimensionally imaging (baking) the distance at each pixel. A UV map (assignment information for expanding the polygon model on a plane) is set in the intermediate polygon model.

FIG. 8 shows an example of a normal image of arbitrary clothes. The normal image may be prepared in advance by the virtual fitting system 1 or may be created outside the virtual fitting system 1. The normal image is an image showing the direction (normal) of each surface of the polygon model of the arbitrary clothing. The normal image is obtained by two-dimensionally imaging (baking) the normal direction of each pixel. Like the image, the normal line image may have a configuration in which the common intermediate polygon model and the clothes polygon model are overlapped to obtain the direction of each surface of the clothes polygon model.

FIG. 9 shows an example of a color image of arbitrary clothes. The color image may be prepared in advance by the virtual fitting system 1 or may be created outside the virtual fitting system 1. The color image is obtained by obtaining the color at each pixel when the arbitrary clothing is two-dimensionally imaged (baked).

The distance image, the normal image, and the color image are collectively referred to as a two-dimensional image of arbitrary clothes. By using a common intermediate polygon model for a plurality of different clothes, the clothes database 311 can store a two-dimensional image of clothes having a common reference. That is, since the generation unit 315 superimposes the two-dimensional images of a plurality of clothes using the common intermediate polygon model, the conversion unit 316 can easily convert the three-dimensional image from the superposed image. Although clothes of a plurality of sizes are usually manufactured, it is preferable in the present invention to obtain a two-dimensional image by commonly using a common intermediate polygon model for a plurality of sizes. That is, when the user wants to obtain a virtual fitting image when trying on a plurality of clothes of different sizes, the two-dimensional images obtained based on different intermediate polygon models are superimposed. In that case, since the distance images of the plurality of two-dimensional images have different reference points, the distances of the plurality of clothes may be reversed (replaced).

FIG. 6 is a table showing an example of the user database 312 that stores information on a plurality of users. The user database 312 stores the user's email address, the user's gender, the user's age, etc. in association with the user identification information (user ID) of the plurality of users. Further, the user database 312 stores the body type information of the user. The body type information of the user is input by the user, and is information such as height and weight. The information of the user can be appropriately modified by the user, and the items the user refuses to input may include items for which no data is stored. In order to obtain an accurate virtual fitting image, it is preferable that the height and the weight are essential.

In addition, the user database 312 further stores a two-dimensional image that has been two-dimensionally imaged as a distance image and a normal line image based on the body type information of a plurality of users like clothing. Here, the body type information may include only simple information such as height and weight, but may also include detailed body type information such as chest circumference, arm length, and thigh circumference.

(Overlapping process of two-dimensional image by generation unit 315)
10 to 12 are views for explaining a polymerization process of arbitrary plural clothes. FIG. 10 is a schematic diagram showing a two-dimensional image of clothes in which the order of wearing is innermost. The innermost garment is the inner. Further, FIG. 11 is a schematic diagram showing a two-dimensional image of clothes having the next clothing order of the innermost clothes. Here, it is called an outer. Then, FIG. 12 is a schematic diagram showing a result of superposing two-dimensional images of the inner (FIG. 10) and the outer (FIG. 12 ).

The generation unit 315 extracts a two-dimensional image of the innermost clothes from the clothes database 311 based on the wearing order of the plurality of clothes selected by the user, and then extracts a two-dimensional image of the clothes in the wearing order from the clothes database 311. Extract from and polymerize. That is, the generation unit 315 adds the value of the distance included in each distance image at the same pixel (position) to the direction of the pixel included in the normal image. The cumulative value of the distance is the position of the outermost garment at that pixel. By giving the cumulative value to each pixel in the distance direction, the vector of each pixel is determined. In addition to the normal image, the superposition of the distance image can obtain a more accurate superposed image by using the transmission value of the color image as a factor. Then, the generation unit 315 determines the color of the outermost clothes of each pixel as the color of the pixel.

That is, the generation unit 315 can generate a superimposed image in which layering of a plurality of clothes is expressed as a two-dimensional image by overlapping a two-dimensional image generated by using a common intermediate polygon model for a plurality of clothes. .. By performing image processing using the common intermediate polygon model, the generation unit 315 can guarantee that various clothes have information corresponding to the same coordinates regardless of the type and size of clothes. ..

(Conversion processing into a three-dimensional image by the conversion unit 316)
FIG. 13 is a diagram for explaining the conversion of the superimposed image of the two-dimensional image into the three-dimensional image by the conversion unit 316. The conversion unit 316 converts the superimposed image generated by the generation unit 315 into a three-dimensional image by assigning it to a common intermediate polygon model. Further, the conversion unit 316 may generate a virtual fitting image for visualizing a state in which the user is trying on a plurality of clothes by combining the head images of the users received from the terminal devices 2 of the plurality of users. it can. Note that the composition of the user's head image is omitted in FIG.

Since the common intermediate polygon model used to obtain the two-dimensional images of a plurality of clothes is based on the standard body shape, in order to obtain a fitting image in a fitting state closer to the body shape of each user, The conversion unit 316 corrects the value of the distance in the normal direction of the common intermediate polygon model based on the body type information of the user included in the user database 312. Specifically, the conversion unit 316 subtracts the distance in the normal direction based on the difference from the standard weight when the weight of the user is smaller than the standard body type at any height. The degree of subtraction of each pixel is predetermined for each height (height range), and the body parts that are likely to affect the body shape due to the difference in weight are experimentally or statistically stored in a server using information such as a map. The storage unit 313 stores it in advance. The processing of the conversion unit 316 when the weight of the user is larger than the standard body shape at any height is the reverse of the processing when the body weight is smaller than the standard body shape, and thus detailed description will be omitted.

Even when the detailed body type information is input by the user, the value of the distance in the normal direction may be corrected in consideration of whether the polygon model is smaller or larger than the standard on the basis of an arbitrary polygon model. Note that the common intermediate polygon model used to obtain the two-dimensional images of a plurality of clothes is based on the standard height of a male or a female, and therefore, depending on the difference between the user's height and the standard height. The length of the clothes (the position of the bottom of the clothes) changes.

(New member registration process)
FIG. 14 is a diagram showing an example of an operation sequence of a series of user new member registration processing by the virtual fitting system 1 according to the present embodiment. That is, the process is performed when the user newly registers the personal information and uses the virtual fitting system 1.

The operation sequence described below is executed mainly by the server processing unit 317 in cooperation with each element of the server 3 based on a program stored in the server storage unit 313 in advance. Furthermore, the operation sequence described below is based on a program stored in the terminal storage unit 212 of the terminal device 2 of the user in advance, mainly by the terminal processing unit 215 of the terminal device 2 of the user, and Performed in cooperation with the element. In the operation sequence described below, the server 3 transmits/receives various information to/from the terminal device 2 via the server communication unit 318.

This process is performed when the user presses a "new member registration button" or the like to become a new login user. First, the server 3 determines whether or not the mail address of the user has been input (step S101). In this step, the user may be allowed to enter the email address in duplicate for confirmation. When the server cannot confirm the input of the user's email address (NO in step S101), step S101 is repeated.

On the other hand, if the input of the user's email address is confirmed (YES in step S101), the server 3 determines whether the input user's email address is an already registered address (step S102). If the input user's email address is already registered (YES in step S102), the process returns to step S101, and the server 3 prompts the user to input another email address.

When the input user's mail address is not already registered (NO in step S102), the server 3 waits for input of the user's personal information (step S103). Here, the personal information refers to a user's name, telephone number, sex, height, weight, and the like. These pieces of information can be freely set by the provider of the virtual fitting system 1. When the virtual fitting system 1 also sells clothes, it is preferable to accept payment information such as a credit card as personal information as the personal information. When the server cannot confirm the input of the user's email address (NO in step S103), step S103 is repeated.

On the other hand, when the input of the user's personal information can be confirmed (YES in step S103), the server 3 determines whether all the items of the user's personal information input have been input (step S104). If the input of the user's personal information is inadequate (missing) (NO in step S104), the process returns to step S103, and the server 3 displays on the personal information input screen assistance such as highlighting an uninput item. By doing so, the user is prompted to input an item that has not been input. Although the server 3 requests the user to input the height and weight as the user's body type information in step S104, the server 3 may include the height and weight in the next step S105. In that case, it is preferable that the step S105 is also an input required item.

When all items of the user's personal information have been input (YES in step S104), the server 3 prompts the user to input detailed body type information (step S105). Detailed body type information is numerical information regarding a detailed body type other than height and weight. Specifically, the chest circumference, arm length, thigh circumference, and the like are included, but these items do not particularly limit the present invention. Further, the detailed body type information may include the head image of the user. Input of these detailed body type information is optional, and new member registration is possible even if no input has been made.

In a succeeding step S106, the server 3 waits until the "progress to final confirmation" button for accepting a request for final confirmation of personal information input by the user is pressed. The server repeats step S106 when the “button for proceeding to final confirmation” is not pressed (NO in step S106).

On the other hand, when the user presses the button for proceeding to final confirmation (YES in step S106), the server 3 generates a screen for prompting the user to confirm whether the personal information input by the user is correct, and the server 3 The data is transmitted to the device 2 (step S107). Further, on this screen, a "registration button" that is pressed when the final confirmation of the personal information input by the user is completed and the member registration is requested is displayed. In addition, there is an error in the input of personal information by the user, and a "return button" for returning to the input screen is displayed. The description when the "return button" is pressed will be omitted.

Next, the server 3 waits for the user to press the "registration button" to send the request for member registration (step S108). If the “registration button” is not pressed (NO in step S108), the server 3 repeats step S108.

On the other hand, when the “register button” is pressed (YES in step S108), the server 3 stores the personal information input by the user and the user identification information newly added in the user database 312 of the server storage unit 313 in association with each other. Yes (step S109). Then, the server 3 ends the new member registration process.

(Processing of Generating Virtual Fitting Image by Generation Unit 315 and Conversion Unit 316)
FIG. 15 is a diagram showing an example of an operation sequence of a series of processes for generating virtual fitting images of a plurality of clothes by the virtual fitting system 1 according to the present embodiment. That is, this is a process of generating a virtual three-dimensional image of a virtual fitting state when a user tries on a plurality of arbitrary clothes selected from the clothes database 311.

The operation sequence described below is executed mainly by the server processing unit 317 in cooperation with each element of the server 3 based on a program stored in the server storage unit 313 in advance. Further, the operation sequence described below is based on a program stored in the terminal storage unit 212 of the user's terminal device 2 in advance, mainly by the terminal processing unit 215 of the terminal device 2 and each element of the terminal device 2. It is executed in collaboration. In the operation sequence described below, the server 3 transmits/receives various information to/from the user terminal device 2 via the server communication unit 318.

Since this process is performed after the user finishes the process of selecting a plurality of clothes from the clothes database 311, the process of the user selecting clothes from the clothes database 311 will be omitted in this embodiment. Further, the present embodiment is characterized by generating virtual fitting images of a plurality of clothes, but may have a function of generating virtual fitting images of a single clothes.

First, the server 3 determines whether or not the selection input of a plurality of clothes and the wearing order of the selected and input clothes have been input from the user's terminal device 2 (step S201). The server 3 repeats step S201 when the selection input of a plurality of clothes and the input of the wearing order of the selected clothes are not confirmed (NO in step S201). If the user forgets to input the clothing order of a plurality of clothes, a warning display or the like is displayed on the user's terminal device 2 to prompt the user to input the clothing order. The selection input of a plurality of clothes and the confirmation of the wearing order of the selected and input clothes are performed when the user presses a “try-on button” or the like.

Next, the server 3 extracts a two-dimensional image for each of the plurality of clothes selected and input by the user from the clothes database (step S202).

Then, the server 3 superimposes the extracted range images and normal images of the two-dimensional images to generate a superposed image (step S203). This superimposed image is generated in the server 3 and is not transmitted to the user's terminal device 2.

The server 3 extracts the user's head image and body shape information from the user database 312, corrects a common intermediate polygon model based on the extracted body shape information of the user, and synthesizes the head image to synthesize the head image. A human body model is generated (step S204).

The server 3 further superimposes the superimposed image generated in step S203 on the virtual human body model of the user generated in step S204, thereby converting the superimposed image into a three-dimensional image as a fitting image (step S205).

The virtual fitting image generation process by the generation unit 315 and the conversion unit 316 is premised on that the user is logged in to the virtual fitting system 1, but the virtual fitting image generation process is performed even in the unlogged state. It can be used, and the user may be required to log in at any timing of this processing. For example, in the conversion process of step S205, it is necessary to extract the body type information of the user from the user database, so it is preferable to require login or prompt login immediately before moving to this process.

As described above, the virtual fitting system 1 according to the present embodiment accurately overlays a plurality of clothes by a simple process of superimposing a two-dimensional image, and finally the superposed images are finally superposed. By returning to the three-dimensional image, the three-dimensional image can be easily generated. That is, the processing of the server 3 can be reduced, and the processing speed for generating the three-dimensional image can be increased. Further, since the virtual fitting system 1 converts a plurality of clothes into a two-dimensional image using a common intermediate polygon model and stores the two-dimensional image in the clothes database 311, the plurality of clothes and the user's body shapes are shared by the common intermediate polygon model. A three-dimensional image can be easily obtained by further polymerizing with.

It will be appreciated by those skilled in the art that various changes, substitutions and modifications can be made thereto without departing from the spirit and scope of the invention.

(Modification 1)
In the present embodiment, the generation unit 315 simply adds, for each pixel, the values of the distance image in the same normal direction included in the two-dimensional images of a plurality of clothes. The unevenness of the clothes becomes smoother than the superposition result of a plurality of superposition images. That is, it is preferable to smoothly treat the unevenness of the outermost clothes in consideration of the unevenness of a woman's chest or clothes' scallops.

Therefore, the generation unit 315 has the magnitude of the distance that the distance image has in one normal direction out of the plurality of normal directions included in the normal image and the distance image in the normal direction near the one normal direction. The overlapped image is generated after the correction for making the distance in the normal direction having a small distance closer to the distance in the normal direction having a large distance according to the difference from the magnitude of the distance. By this correction, the virtual fitting image can be brought closer to the fitting state when actually fitting the clothes. This process may be performed for each clothes to be put on, or may be performed only once after the added distance is calculated.

(Modification 2)
In the present embodiment, the generation unit 315 simply adds, for each pixel, the value of the distance image in the same normal direction included in the two-dimensional images of a plurality of clothes regardless of the type of the material of the clothes. , There is a possibility that if the distances are simply added, a virtual fitting image different from the clothing state at the time of actual fitting is generated.

Therefore, the generation unit 315 generates a superimposed image by correcting the distance in the normal direction based on the material information or the rigidity information of the plurality of clothes included in the clothes database 311. That is, the generation unit 315 corrects the outermost distance in accordance with the material that is easily affected by the human body or the clothes of the lower layer and the material that is not easily affected. Also in this modification, it is preferable to perform correction so that the distance in the normal direction having a small distance is closer to the distance in the normal direction having a large distance, as in the first modification. Note that this modification may be combined with the modification 1.

(Modification 3)
In the present embodiment, the generation unit 315 determines the color of the portion having the outermost distance in the normal direction when the distance images and the normal images included in the two-dimensional images of the plurality of clothes are superimposed, in the normal direction. By doing so, a superimposed image was generated, but the color may differ from the color when actually tried on depending on the transparency of the outer clothes.

Therefore, the generation unit 315 generates the superimposed image by correcting the colors in the normal direction based on the colors of the outer clothes of the plurality of clothes and the inner clothes of the outer clothes, and the transparency of the outer clothes. That is, when the transparency of the outer garment is high, the color of the garment in the lower layer is transparent. A more accurate virtual fitting image can be obtained by changing the proportion of the color of the clothes in the lower layer to the color of the outer clothes according to the transparency.

(Scope of application of the present invention)
The virtual fitting system 1 according to the present embodiment is a virtual fitting image in which the users mutually control the web browsers of the terminal devices 2 of a plurality of users, and the server 3 makes it possible for the server 3 to view the wearing of a plurality of clothes via the Internet 4 or the like. Is transmitted to the terminal devices 2 of a plurality of users. As another aspect, virtual fitting can be performed as a function of application software downloaded from the server 3 by the terminal devices 2 of a plurality of users. That is, the application refers to the clothing database 311 stored in the server storage unit of the server 3 and selects and inputs a plurality of arbitrary clothing. Further, the clothing database 311 may be included not in the server 3 but in an external server or the user's terminal device 2. When the selection input of a plurality of clothes is accepted, the user's terminal device cooperates with the application software to generate a two-dimensional superimposed image or to convert the superimposed image into three-dimensional. In this case, the terminal processing unit 215 is responsible for the control of the generation unit 315 and the conversion unit 316 described above.

[Second Embodiment]
Next, a second embodiment will be described. In the second embodiment, only the parts different from the first embodiment will be described, and the description of the same parts as the first embodiment will be omitted.

In the virtual fitting system 1 of the second embodiment, the generation unit 315 generates a superimposed image based on the distance image included in the two-dimensional images of a plurality of clothes and the alpha representing the opacity of the two-dimensional image.
For the distance image, for example, a vector displacement map (Vector Displacement Map) is used. The vector displacement map can show three-dimensional displacement in each of red, green and blue (RGB) channels.

The vector displacement map is generated by the virtual fitting system 1 or in a device arranged outside the virtual fitting system 1, for example, as follows.
First, the virtual fitting system 1 and the like store the first position map (X, Y, Z coordinates in R, G, B, respectively) from the coordinates on the space of the three-dimensional model (intermediate model) based on the UV map. Stuff) is generated. Next, the virtual fitting system 1 or the like uses, for example, a shrink wrap (a technique of projecting the vertices of one model onto the surface of another model) or the like, to obtain the shape of a three-dimensional model (intermediate model). The second position map is generated based on the transformation into the model indicating The vector displacement map is calculated by subtracting the value of the first position map from the value of the second position map.
The UV map is data indicating how to develop the surfaces forming the three-dimensional model into a two-dimensional plane. The surface forming the three-dimensional model can be regarded as a plane by itself. The UV map is data indicating how an image is assigned to each plane of the three-dimensional model.

The alpha is acquired from the two-dimensional image, for example, based on the painting process by the image editing software. Alternatively, the alpha is acquired based on the color and opacity of another model regarding the clothes, for example, by a baking (transfer) process.

FIG. 18 is a schematic diagram illustrating a two-dimensional image (clothes image) of clothes in which the clothing order is the innermost side according to the second embodiment. FIG. 19 is a schematic diagram showing a two-dimensional image (vector displacement map) of clothes in which the clothing order is the innermost side according to the second embodiment. FIG. 20 is a schematic diagram showing a two-dimensional image (clothes image) of clothes in the outermost clothing order according to the second embodiment. FIG. 21 is a schematic diagram showing a two-dimensional image (vector displacement map) of clothes in which the clothing order is the outermost part according to the second embodiment. FIG. 22 is a schematic diagram showing an image in which the alpha channel of the image of the clothes is applied to the vector displacement map regarding the clothes having the innermost clothing order. FIG. 23 is a schematic diagram showing an image in which the alpha channel of the image of the clothes is applied to the vector displacement map for the clothes whose clothes order is the outermost side. FIG. 24 is a schematic diagram showing an image in which the image of the innermost clothes and the image of the outermost clothes are superimposed (alpha composition of the clothes images). FIG. 25 is a schematic diagram showing an image in which the image of the innermost clothes and the image of the outermost clothes are overlapped (alpha composition of vector displacement maps).

The generation unit 315 extracts a two-dimensional image of the clothes whose innermost is in the clothing order from the clothes database 311, and applies the alpha channel of the clothes image (FIG. 18) to the vector displacement map (FIG. 19). .. The applied result is as shown in FIG.
The generation unit 315 extracts a two-dimensional image of clothes whose outermost clothes are placed from the clothes database 311, and applies the alpha channel of the clothes image (FIG. 20) to the vector displacement map (FIG. 21). .. The applied result is as shown in FIG.

Next, the generation unit 315 polymerizes the innermost clothes and the outermost clothes. Specifically, the generation unit 315 performs alpha synthesis of the image of the innermost clothes (FIG. 18) and the image of the outermost clothes (FIG. 20). The alpha combination is a process of combining the color (RGB) of each pixel of an image having RGB and alpha values using the transparency information (alpha). The result of the alpha synthesis is as shown in FIG. Accordingly, the generation unit 315 can combine the “color” of the clothes according to the transparency. "Overlapping" is a process of combining a plurality of images or superimposing a plurality of images.

The generation unit 315 alpha-composites the vector displacement map (FIG. 22) of the innermost clothes and the vector displacement map (FIG. 23) of the outermost clothes. Vector displacement maps are essentially only RGB channels that show three-dimensional displacements (X, Y, Z coordinates). However, in this embodiment, since the alpha channel acquired from the image of the clothes is added to the vector displacement map by the generation unit 315, the alpha synthesis method can be applied. The result of the alpha synthesis is as shown in FIG. Accordingly, the generation unit 315 can combine the “displacement amount” of the clothing according to the transparency.

The conversion unit 316 generates a three-dimensional image based on the two-dimensional image superimposed by the generation unit 315, as in the first embodiment.

DESCRIPTION OF SYMBOLS 1 Virtual fitting system 2 Terminal device 211 Terminal communication unit 212 Terminal storage unit 213 Terminal operation unit 214 Terminal display unit 215 Terminal processing unit 3 Server 311 Clothing database 312 User database 313 Server storage unit 314 Reception unit 315 Generation unit 316 Conversion unit 317 server Processing unit 318 Server communication unit

Claims (12)

A model information receiving unit that receives a head image of the model and body information of the model from the terminal device,
A clothing information receiving unit that receives an arbitrary plurality of clothes and a wearing order of the arbitrary plurality of clothes in the same body part;
A two-dimensional image corresponding to the arbitrary plurality of clothes is extracted from an image information database obtained by converting the clothing states of the plurality of clothing into a two-dimensional image, and a superposed image obtained by superposing the two-dimensional images based on the clothing order is displayed. A generation processing unit that generates,
A conversion processing unit that converts the superimposed image into a three-dimensional image based on the body type information;
A transmitter that transmits the three-dimensional image and the head image to the terminal device;
A virtual fitting device including: The virtual fitting apparatus according to claim 1, wherein the generation processing unit generates the overlapped image by overlapping the converted two-dimensional images using an arbitrary intermediate polygon model in common. The conversion processing unit generates a virtual human body model of the model by correcting the arbitrary intermediate polygon model based on the body type information,
The virtual fitting apparatus according to claim 2, wherein the conversion processing unit converts the superimposed image into the three-dimensional image by further superimposing the superimposed image on the virtual human body model. The virtual fitting apparatus according to claim 3, wherein the generation processing unit generates the overlapping image by overlapping the distance image and the normal image included in the two-dimensional images of the plurality of clothes. The generation processing unit calculates the distance in the one normal direction by adding the magnitude of the distance of the distance image in the one normal direction included in the normal image from the innermost clothes to the outermost clothes. The virtual fitting apparatus according to claim 4, wherein the superimposed image is generated by calculation. The generation processing unit has a size of a distance that the distance image has in one normal direction among a plurality of normal directions included in the normal image and a distance image in a normal direction near the one normal direction. The overlapped image is generated by bringing the distance in the normal direction having a small distance closer to the distance in the normal direction having a large distance according to the difference from the magnitude of the distance. Virtual fitting device. The image information database further includes material information or rigidity information of the plurality of clothes,
The virtual fitting apparatus according to claim 6, wherein the generation processing unit generates the superimposed image by correcting the distance in the normal direction based on the material information or the rigidity information. The two-dimensional image further includes a color image,
The generation processing unit uses, as the color of the three-dimensional image, the color of the portion having the outermost distance in the normal direction when the distance image and the normal image included in the two-dimensional images of the plurality of clothes are superimposed. The virtual fitting apparatus according to claim 7, wherein the overlapping image is generated by setting the color in the normal direction. The generation processing unit generates the superimposed image by correcting the colors of the outer clothes of the plurality of clothes and the inner clothes of the outer clothes, and the colors in the normal direction based on the transparency of the outer clothes. The virtual fitting apparatus according to claim 8, wherein The virtual fitting apparatus according to claim 3, wherein the generation processing unit generates the superimposed image based on an alpha representing the opacity of the distance image and the two-dimensional images included in the two-dimensional images of the plurality of clothes. A step of receiving the head image of the model and the body type information of the model from the terminal device;
Receiving a plurality of arbitrary clothes and a wearing order of the plurality of arbitrary clothes in the same body part,
A two-dimensional image corresponding to the arbitrary plurality of clothes is extracted from an image information database obtained by converting the clothing states of the plurality of clothes into a two-dimensional image, and a superposed image obtained by superposing the two-dimensional images based on the clothing order is displayed. The steps to generate,
Converting the superimposed image into a three-dimensional image based on the body shape information;
Transmitting the three-dimensional image and the head image to the terminal device;
A virtual fitting method, including: On the computer,
A function of receiving the head image of the model and the body type information of the model from the terminal device,
A function of accepting an arbitrary plurality of clothes and a wearing order of the arbitrary plurality of clothes in the same body part,
A two-dimensional image corresponding to the arbitrary plurality of clothes is extracted from an image information database obtained by converting the clothing states of the plurality of clothing into a two-dimensional image, and a superposed image obtained by superposing the two-dimensional images based on the clothing order is displayed. The function to generate,
A function of converting the superimposed image into a three-dimensional image based on the body shape information,
A function of transmitting the three-dimensional image and the head image to the terminal device,
A virtual fitting program that realizes

Images