JP6631988B1 - Virtual fitting device, virtual fitting method, and virtual fitting program - Google Patents

Abstract

A virtual fitting technique capable of generating a composite image of a three-dimensional image with a low load is provided. The virtual fitting device is a model information receiving unit that receives a head image of the model and the body type information of the model from a terminal device, and a clothing that receives an arbitrary plurality of clothes and an arbitrary order of the arbitrary clothes in the same part of the body. A superimposed image obtained by extracting a two-dimensional image corresponding to an arbitrary plurality of clothes from an information receiving unit and an image information database obtained by converting the state of clothes of the plurality of clothes into a two-dimensional image, and superimposing the two-dimensional images based on the order of clothes. , A conversion processing unit that converts the superimposed image into a three-dimensional image based on the body shape information, and a transmission unit that transmits the three-dimensional image and the head image to the terminal device. ing.

Description

  The present invention relates to a virtual fitting device, a virtual fitting method, and a virtual fitting program.

  Trying on when buying clothes is usually done. In order to try on, a purchaser goes to a store that sells clothes, selects clothes, moves to a space provided for try-on, and performs try-on. In order to try on, the buyer needs to undress the clothes that he or she was wearing, and doing so in a small fitting space can be difficult and can stress the buyer .

  On the other hand, in recent years, it has become commonplace to purchase clothes at an Internet shop that is not restricted by the timing or place at which clothes are purchased. However, in this case, the purchaser cannot try on the product for which he or she is wondering whether or not to purchase it, so the purchaser cannot give up and decide to give up, or even if he purchases his clothes, the size does not match. May be left untouched.

  In order to improve such a situation, a system has been developed that allows users to try on clothes that are lost in purchase through the Internet. For example, in Patent Literature 1, an image of a try-on to which a code label on which a code image is formed by an imaging unit is attached, a code position that is a position of the code image in the captured image is detected, and an image of a dress is displayed. A virtual fitting system that generates a composite image by generating a composite image arranged on a captured image with reference to a code position in which is detected is disclosed. In this system, one piece of clothing can be tried on at one site of the try-on person. For example, one clothing can be selected for each of the hat, the tops, and the bottoms. Therefore, in this case, the try-on person cannot try on a plurality of clothes in a pile.

  In order to realize layering in a virtual space, a plurality of three-dimensional images can be superimposed. When the three-dimensional images are superimposed, the vertical relationship between a plurality of clothes cannot be accurately reproduced, and a so-called “penetration” in which the inner clothes pass through the outer clothes may occur. FIG. 16 is a schematic diagram illustrating the synthesis of a three-dimensional image of a plurality of clothes and the result. As is clear from the figure, simply combining three-dimensional images has high uncertainty, and the vertical relationship between clothes cannot be appropriately expressed. Such a composite image is inappropriate as a try-on image, and is likely not to assist purchasers in purchasing clothes.

  It is also possible to combine three-dimensional images of a plurality of clothes by physical calculation. FIG. 17 is a schematic diagram showing a composite image obtained by using a method of forcibly approaching a nearby polygon as an example of a composite result using physical operation. As shown in FIG. 17, there is a method called Shrink Wrap as a method for forcibly approaching a nearby polygon. When compared with the synthesis of the general three-dimensional image shown in FIG. 16, it can be seen that the vertical relationship between clothes is properly processed. However, the unevenness on the surface cannot be maintained, a problem occurs in a region where no clothes exist, the processing result cannot be predicted in advance, and the utility is poor. The physical operation has a very high computational load, and it is impossible to complete the process immediately with ordinary equipment. Therefore, it is difficult to generate a composite image of a large number of three-dimensional images in a short time, such as trying on clothes. In some cases it is an inappropriate method. On the other hand, if the calculation load is reduced, a low-quality physical operation is performed, and in some cases, clothes may pass through. When a physical operation is used to obtain a virtual fitting image, it is impossible to complete the three-dimensional image synthesizing process immediately, and there is a high possibility that the user will be stressed, and the virtual fitting image cannot be viewed. , It may not even lead to the purchase of clothing.

  In order to improve the accuracy of the composite image of the three-dimensional image, it is conceivable to adopt a method such as surface deforming as a method that can be processed on the DCC tool, but the calculation load is high, and many methods such as fitting of clothes are used. This method is inappropriate when a composite image of a three-dimensional image is generated in a short time.

JP-A-2017-156957

  Therefore, the inventors have devised a virtual fitting apparatus, a virtual fitting method, and a virtual fitting program that reduce the calculation load and increase the accuracy of the synthesized image of the three-dimensional image. That is, the present invention has been made in view of the above circumstances, and an object of the present invention is to provide a virtual fitting apparatus, a virtual fitting method, and a virtual fitting program capable of generating a composite image of a three-dimensional image with a low load.

  (1) A first aspect of the present invention is a model information receiving unit that receives a head image of a model and body type information of the model from a terminal device, and arbitrary plural clothes and arbitrary plural clothes in the same part of the body. And a two-dimensional image corresponding to a plurality of arbitrary clothes is extracted from an image information database obtained by converting the state of clothes of the plurality of clothes into a two-dimensional image. A generation processing unit that generates a superimposed image obtained by superimposing images, a conversion processing unit that converts the superimposed image into a three-dimensional image based on the body type information, and a transmission unit that transmits the three-dimensional image and the head image to the terminal device. And a virtual fitting device.

  (2) In (1) above, the generation processing unit may generate a superimposed image by superimposing a two-dimensional image converted using an arbitrary intermediate polygon model in common.

  (3) In the above (2), the conversion processing unit may generate a virtual human body model of the model by correcting an arbitrary intermediate polygon model based on the body type information. The polymerized image may be converted into a three-dimensional image by further polymerizing the polymerized image.

  (4) In the above (2) or (3), the generation processing unit may generate a superimposed image by superimposing a distance image and a normal image included in a two-dimensional image of a plurality of clothes.

  (5) In the above (4), the generation processing unit may add the magnitude of the distance of the distance image in the one normal direction included in the normal image from the innermost garment to the outermost garment to perform the one method. The overlap image may be generated by calculating the distance in the linear direction.

  (6) In the above (5), the generation processing unit may determine the magnitude of the distance of the distance image in one normal direction among the plurality of normal directions included in the normal image, and the normal in the vicinity of the one normal direction. The overlap image may be generated by making the distance in the normal direction having a small distance close to the distance in the normal direction having a large distance in accordance with the difference between the distances of the distance images in the directions.

  (7) In the above (5) or (6), the image information database may further include material information or stiffness information of a plurality of clothes, and the generation processing unit may determine a normal direction based on the material information or stiffness information. A superimposed image may be generated by correcting the distance.

  (8) In any one of the above (4) to (7), the two-dimensional image may further include a color image, and the generation processing unit includes the color of the three-dimensional image in the two-dimensional image of a plurality of clothes. When the distance image and the normal line image to be superimposed are superimposed, the superposed image may be generated by using the color of the portion having the outermost distance in the normal direction as the color in the normal direction.

  (9) In the above (8), the generation processing unit corrects the color in the normal direction based on the colors of the outer clothes of the plurality of clothes, the inner clothes of the outer clothes, and the transmittance of the outer clothes. A polymerization image may be generated.

  (10) A second aspect of the present invention is a step of receiving a head image of a model and body type information of the model from a terminal device, and a plurality of arbitrary clothes and an order of wearing the arbitrary plurality of clothes in the same part of the body. Receiving a two-dimensional image corresponding to any of a plurality of clothes from an image information database obtained by converting the state of clothes of the plurality of clothes into a two-dimensional image, and superimposing the two-dimensional images based on the order of clothes , A step of converting the superimposed image into a three-dimensional image based on the body shape information, and a step of transmitting the three-dimensional image and the head image to the terminal device. About.

  (11) A third aspect of the present invention is directed to a function of allowing a computer to receive a head image of a model and body type information of the model from a terminal device, a plurality of arbitrary clothes and an arbitrary plurality of clothes in the same part of the body. A two-dimensional image corresponding to an arbitrary plurality of clothes is extracted from an image information database obtained by converting the state of clothes of the plurality of clothes into a two-dimensional image, and the two-dimensional images are superimposed based on the order of clothes. A function of generating the overlapped image, a function of converting the overlapped image into a three-dimensional image based on the body shape information, and a function of transmitting the three-dimensional image and the head image to the terminal device. About a virtual fitting program.

  According to the present invention, a three-dimensional image is converted into a three-dimensional image based on a superimposed image obtained by superimposing a two-dimensional image of a plurality of clothes. , And a virtual fitting program can be provided.

It is a schematic diagram for explaining an example of processing by a virtual fitting system. It is a figure showing an example of a schematic structure of a virtual fitting system. FIG. 2 is a diagram illustrating an example of a schematic configuration of a user terminal device. FIG. 3 is a diagram illustrating an example of a schematic configuration of a server. It is a table | surface which shows an example of the clothing database which memorize | stores the detailed information of several clothing. 5 is a table illustrating an example of a user database that stores information on a plurality of users. 4 shows an example of a distance image of an arbitrary piece of clothing. 4 shows an example of a normal image of an arbitrary piece of clothing. 1 shows an example of a color image of an arbitrary clothing. It is a schematic diagram which shows the two-dimensional image of the clothing whose clothing order is the innermost. It is a schematic diagram which shows the two-dimensional image of the clothing which has the next clothing order of the innermost clothing. It is a schematic diagram which shows the result of having superimposed the two-dimensional image of an inner and an outer. FIG. 7 is a diagram for explaining conversion of a two-dimensional image into a three-dimensional image by superimposing a two-dimensional image by a converter. It is a figure showing an example of an operation sequence of a series of flows of new member registration processing of a user by a virtual fitting system concerning this embodiment. It is a figure which shows an example of the operation | movement sequence of a series of flows of the production | generation process of the virtual fitting image of several clothes by the virtual fitting system concerning this embodiment. It is a schematic diagram which synthesize | combines the three-dimensional image of several clothes and shows the result. It is a schematic diagram which shows the synthetic | combination image obtained using the method of forcibly approaching a proximity polygon. FIG. 13 is a schematic diagram illustrating a two-dimensional image (an image of clothing) of clothing whose clothing order is the innermost according to the second embodiment. FIG. 14 is a schematic diagram illustrating a two-dimensional image (a vector displacement map) of clothing in which a clothing order is the innermost according to the second embodiment. FIG. 14 is a schematic diagram illustrating a two-dimensional image (an image of clothing) of clothing whose clothing order is the outermost according to the second embodiment. FIG. 13 is a schematic diagram showing a two-dimensional image (a vector displacement map) of clothing in which the clothing order is the outermost according to the second embodiment. It is a schematic diagram which shows the image which applied the alpha channel of the image of the clothing to the vector displacement map regarding the clothing whose clothing order is the innermost. It is a schematic diagram which shows the image which applied the alpha channel of the image of the clothing to the vector displacement map regarding the clothing whose clothing order is the outermost. It is a schematic diagram which shows the image (alpha synthesis | combination of clothes images) which superimposed the image of the innermost clothing and the image of the outermost clothing. It is a schematic diagram which shows the image (alpha synthesis | combination of vector displacement maps) which superimposed the image of the innermost clothing and the image of the outermost clothing.

  Hereinafter, a virtual fitting apparatus, a virtual fitting method, and a virtual fitting program according to one aspect of the present disclosure will be described with reference to the drawings. However, it should be noted that the technical scope of the present disclosure is not limited to these embodiments, but extends to the inventions described in the claims and their equivalents.

[First Embodiment]
(Overview of processing by virtual fitting system 1)
FIG. 1 is a schematic diagram for explaining an example of processing by the virtual fitting system 1.

  The virtual fitting system 1 includes a plurality of user terminal devices 2 and a server 3 that is mutually communicated with the plurality of user terminal devices 2. The server 3 includes a clothes database 311 that stores information on a plurality of clothes and a user database 312 that stores information on a plurality of users. In the present invention, a plurality of users who seek virtual fitting are referred to as models.

  The server 3 receives selection of a plurality of clothes stored in the clothes database 311 from the terminal devices 2 of the plurality of users. Further, the server 3 also accepts the clothing order of the clothes. The server 3 generates, based on the information received from the terminal devices 2 of the plurality of users and the information of the plurality of users stored in the user database 312, a try-on image of a plurality of clothes selected from each of the plurality of users. Then, the fitting image is transmitted to the terminal devices 2 of a plurality of users. The present invention is characterized by a technique in which the server 3 generates a try-on image of a plurality of clothes.

  Note that the description of FIG. 1 described above is merely for the purpose of deepening the understanding of the contents of the present invention. The present invention is specifically embodied in each embodiment described below, and may be embodied by various modifications without substantially exceeding the principles of the present invention. All such variations are within the scope of the present disclosure and the present disclosure.

(Schematic configuration of virtual fitting system 1)
FIG. 2 is a diagram illustrating an example of a schematic configuration of the virtual fitting system 1.

  The virtual fitting system 1 includes terminal devices 2, 2, 2,... Of a plurality of users, and a server 3. Hereinafter, the terminal devices 2 of a plurality of users may be simply referred to as user terminal devices 2. The user's terminal devices 2, 2, 2,... And the server 3 are mutually connected via a communication network such as the Internet 4, for example. Although one Internet 4 is illustrated here, when the Internet 4 includes a plurality of networks, a gateway (not shown) may be appropriately provided between the networks. Communication with a program (for example, a management program) executed by the server 3 is performed using a communication protocol such as a hypertext transfer protocol (HTTP).

(Schematic configuration of user terminal device 2)
FIG. 3 is a diagram illustrating an example of a schematic configuration of the terminal device 2 of the user.

  The terminal device 2 executes connection to a wireless communication network, Web access, and the like. To this end, the terminal device 2 includes a terminal communication unit 211, a terminal storage unit 212, a terminal operation unit 213, a terminal display unit 214, and a terminal processing unit 215.

  Note that the terminal device 2 is assumed to be a multifunctional mobile phone (a so-called “smart phone”), but the present invention is not limited to this. The terminal device 2 may be any one to which the present invention can be applied. For example, a tablet PC, a notebook PC, a mobile phone (so-called “feature phone”), a mobile information terminal (PDA), a mobile game machine, a mobile music player, a tablet terminal , Etc.

  The terminal communication unit 211 includes a communication interface circuit, and connects the terminal device 2 to the Internet 4. The terminal communication unit 211 transmits the data supplied from the terminal processing unit 215 to the server 3 or the like via a network. Further, the terminal communication unit 211 supplies data received from the server 3 or the like via the network to the terminal processing unit 215.

  The terminal storage unit 212 includes, for example, a semiconductor memory device. The terminal storage unit 212 stores an operating system program, a driver program, an application program, data, and the like used for processing in the terminal processing unit 215. For example, the terminal storage unit 212 stores, as driver programs, an input device driver program for controlling the terminal operation unit 213, an output device driver program for controlling the terminal display unit 214, and the like. In addition, the terminal storage unit 212 displays, as an application program, a registration screen for registering search conditions, feature information, feature images, and the like input by a store-related person operating the terminal operation unit 213 in the server 3. The browsing program is stored. The various programs may be installed in the terminal storage unit 212 from a computer-readable portable recording medium such as a CD-ROM or a DVD-ROM using a known setup program or the like. Further, the terminal storage unit 212 may temporarily store temporary data related to a predetermined process.

  The terminal operation unit 213 may be any device as long as it can operate the terminal device 2. For example, the terminal operation unit 213 may be a touch panel, but a mouse, key buttons, or the like may be connected to the outside of the terminal device 2. The user can use the terminal operation unit 213 to select and release information, and to input characters and numbers. When operated by the user, the terminal operation unit 213 generates a signal corresponding to the operation. Then, the generated signal is transmitted to the terminal processing unit 215.

  The terminal display unit 214 may be any device as long as it can display a video or an image, and is, for example, a liquid crystal display or an organic EL (Electro-Luminescence) display. The terminal display unit 214 displays an image corresponding to the video data supplied from the terminal processing unit 215, an image corresponding to the image data, and the like.

  The terminal processing unit 215 includes one or more processors and their peripheral circuits. The terminal processing unit 215 controls the overall operation of the terminal device 2 as a whole, and is, for example, a CPU. The terminal processing unit 215 and the terminal communication unit 211 and the terminal communication unit 211 are configured to execute various processes of the terminal device 2 in an appropriate procedure based on a program stored in the terminal storage unit 212, an operation of the terminal operation unit 213, and the like. The operation of the display unit 214 and the like is controlled. The terminal processing unit 215 executes a process based on a program (such as an operating system program, a driver program, or an application program) stored in the terminal storage unit 212. In addition, the terminal processing unit 215 can execute a plurality of programs (such as application programs) in parallel.

  The terminal processing unit 215 performs a function of processing screen display information received from outside the terminal device 2 as a screen display that can be viewed by a user, and performs a process based on the operation content of the terminal operation unit 213 from the user. It has a function of converting the signal into a signal that can be transmitted to the outside and sending the signal to the terminal communication unit 211. These functions are function modules realized by a program executed by a processor included in the terminal processing unit 215. Alternatively, each of these units may be implemented in the terminal device 2 as an independent integrated circuit, microprocessor, or firmware.

(Schematic configuration of server 3)
FIG. 4 is a diagram illustrating an example of a schematic configuration of the server 3.

  The server 3 includes a server storage unit 313 including a clothes database 311 for storing information on a plurality of clothes and a user database 312 for storing information on a plurality of users. The server 3 transmits a search result of desired clothes from the clothes database 311 to the user terminal devices 2 according to the search conditions from the plurality of user terminal devices 2. Further, when the server 3 receives a request for generating a plurality of clothing try-on images selected from the terminal devices 2 of the plurality of users, the server 3 stores the user's body type information stored in the user database 312 and the clothing database 311. A three-dimensional image as a virtual fitting image of a plurality of clothes selected based on the two-dimensional image is transmitted to the terminal devices 2 of a plurality of users. In order to realize the above functions, the server 3 further includes a server processing unit 317 including a reception unit 314, a generation unit 315, and a conversion unit 316, and a server communication unit 318, in addition to the server storage unit 313.

  The clothing database 311 stores clothing selling source information, maker information, manufacturing size information, clothing category information, selling price information, sellable time information, and the like in association with a plurality of pieces of clothing identification information. Further, the clothing database 311 stores a two-dimensional image of the clothing corresponding to each piece of clothing identification information.

  The user database 312 stores user email addresses, user genders, user ages, and the like in association with user identification information (user IDs) of a plurality of users. Further, the user database 312 stores the body type information of the user.

  The server storage unit 313 has, for example, at least one of a semiconductor memory, a magnetic disk device, and an optical disk device, and is connected to the server 3 via a bus. The server storage unit 313 stores a driver program, an operating system program, an application program, data, and the like used for processing by the server processing unit 317. For example, the server storage unit 313 stores a communication device driver program for controlling the server communication unit 318 as a driver program. The computer program may be installed in the server storage unit 313 from a computer-readable portable recording medium such as a CD-ROM or a DVD-ROM, using a known setup program or the like. The server storage unit 313 stores a clothing database 311 and a user database 312.

  In addition, the server storage unit 313 stores the clothing identification information and the user identification information of the clothing whose selection has been received from the terminal devices 2 of the plurality of users, a superimposed image obtained by superimposing the two-dimensional image, and a three-dimensional image (virtual fitting). The image also functions as a temporary storage unit for temporarily storing an image converted into an image.

  Note that the server storage unit 313 may be formed of one storage area, or may be formed of a plurality of storage areas. Further, the server storage unit 313 may not exist inside the server 3 in some cases. For example, a cloud server is one example.

  Server processing unit 317 includes a receiving unit 314, a generating unit 315, and a converting unit 316. The function of the server processing unit 317 is a functional module realized by a program executed by a processor included in the server processing unit 317. Alternatively, each of these units may be implemented in the server 3 as an independent integrated circuit, microprocessor, or firmware. The processing contents of the server processing unit 317 will be described later. In addition, the separation of the components of the server processing unit 317 is an example, and which component performs which processing is not limited to the description of the present embodiment.

  The receiving unit 314 collectively receives various information received from the terminal devices 2 of a plurality of users via the server communication unit 318 described below. Specifically, the receiving unit 314 receives a new user registration from the user. At this time, the server 3 may prompt the user to register the information stored in the user database 312 in advance. For example, the receiving unit 314 receives a user's head image and user's body type information. The head image may be a three-dimensional image that is 3D scanned by the user terminal device 2 or a two-dimensional image that is captured by the user terminal device 2. Further, the user may store an arbitrary head image in the user database 312 instead of the user's own head image. This image may be an animation or the like. Then, after the user registration, the reception unit 314 receives search conditions for a plurality of clothes stored in the clothes database 311 from the terminal devices 2 of the plurality of users, or stores the plurality of search conditions stored in the clothes database 311 for virtual fitting. And input of the selection of an arbitrary garment from the garments and the order of wearing the garments. Further, the receiving unit 314 receives a request for generating a fitting image in which virtual fitting is visualized. In the present invention, the receiving unit 314 can correspond to a model information receiving unit and a clothing information receiving unit. The server storage unit 313 stores various information received by the reception unit 314 in the clothing database 311, the user database 312, and the temporary storage area. Which information is stored in each database or storage area is arbitrary in the present invention, and is not particularly limited to the present invention.

  First, the generation unit 315 extracts clothing information based on a search condition for selecting an arbitrary clothing from the clothing database 311 received from the terminal devices 2 of a plurality of users. The generation unit 315 extracts, from the clothing database 311, two-dimensional images corresponding to the plurality of clothes selected and input from the plurality of user terminal devices 2, and also combines the two-dimensional images into the clothing order received from the plurality of user terminal devices 2. Based on this, a two-dimensional image is superimposed to generate a superimposed image. The generation process of the generation unit 315 will be described later in detail. Note that the generation unit 315 can correspond to the generation processing unit in the present invention. Note that the generation unit 315 may consider the order of clothes between clothes of a plurality of parts. That is, the user can select whether to wear the tops inside the bottoms or to wear the tops outside the bottoms. In this case, the reception unit 314 may receive the order of clothing between different parts in addition to the order of clothing of the same part.

  The conversion unit 316 generates a virtual human body model of the user by correcting the common intermediate polygon model based on the body type information of the user received by the reception unit 314 and combining the head image, and generates a virtual human body model of the user. The superimposed image is converted into a three-dimensional image (that is, a virtual fitting image) by further superimposing the superimposed image generated by the generation unit 315. Here, when the user's head image is a three-dimensional image, the conversion unit 316 can generate a virtual fitting image in which the user is actually trying on clothes by combining the head images. On the other hand, when the user's head image is a two-dimensional image, the conversion unit 316 needs to convert the two-dimensional image of the user's head into a three-dimensional image together with the two-dimensional image of the clothing. That is, since the generation unit 315 superimposes a plurality of clothing images at the stage of a two-dimensional image and converts the superimposed image into a three-dimensional image, the server 3 generates a three-dimensional image that is a result of overlapping a plurality of clothing images. Can be generated. Note that the conversion unit 316 can correspond to the conversion processing unit in the present invention.

  The server communication unit 318 has a communication interface circuit for connecting the server 3 to the Internet 4. The server communication unit 318 transmits a search request and a request for generating a fitting image from the terminal devices 2 of the plurality of users to the reception unit 314. In addition, the server communication unit 318 transmits the clothing image extracted from the clothing database 311 by the generation unit 315 to the terminal devices 2 of a plurality of users, or outputs the three-dimensional image generated by the generation unit 315 and the conversion unit 316 to the plurality of users. Or to the terminal device 2. Note that the server communication unit 318 can correspond to the transmission unit in the present invention.

(Table data structure)
5 and 6 are diagrams illustrating an example of the structure of the clothing database 311 and the user database 312.

  FIG. 5 is a table illustrating an example of a clothing database 311 that stores detailed information of a plurality of clothing. The clothing database 311 stores clothing manufacturer information, size information, clothing category information, selling price information, available time information, and the like in association with a plurality of pieces of clothing identification information (clothing ID). Further, the clothing database 311 stores a two-dimensional image of the clothing corresponding to each piece of clothing identification information. The two-dimensional image of the clothes includes a distance image, a normal image, and a color image, as described later. In the clothing database 311 shown in FIG. 5, only a path for calling a two-dimensional image is stored. The two-dimensional image of the clothing may be created from a pattern of the clothing, or may be created based on a 3D scan of the completed clothing. In the present embodiment, the two-dimensional image is stored in the clothing database 311 as a variety of images or maps using a 3D scanned image. Note that the clothing database 311 that stores 3D scanned images can correspond to the image information database in the present invention.

  As shown in FIG. 5, the clothing database 311 manages differences in size of the same clothing by assigning branch numbers as clothing identification numbers. This makes it easier for the user to search for products of different sizes for clothes of the same design. The maker, category, and color are information input for the convenience of the user's search. The selling price and the selling start time and the selling end time as the sellable time are information necessary when the virtual fitting system 1 also sells clothes.

  FIG. 7 shows an example of a distance image of an arbitrary piece of clothing. The distance image may be prepared in advance by the virtual fitting system 1 or may be created outside the virtual fitting system 1. For the distance image, an arbitrary intermediate polygon model is prepared, and the distance (displacement) at each pixel is obtained by acquiring a difference between the intermediate polygon model and the arbitrary clothing polygon model. The distance image is obtained by two-dimensionally imaging (baking) the distance at each pixel. It should be noted that a UV map (assignment information for developing the polygon model into a plane) is set in the intermediate polygon model.

  FIG. 8 shows an example of a normal image of an arbitrary piece of clothing. The normal image may be prepared in advance by the virtual fitting system 1 or may be created outside the virtual fitting system 1. The normal image is an image indicating the direction (normal) of each surface of the polygon model of the arbitrary clothing. The normal image is obtained by two-dimensionally imaging (baking) the normal direction of each pixel. The normal image may be configured such that the common intermediate polygon model and the polygon model of the clothing are overlapped with each other to obtain the directions of the respective surfaces of the polygon model of the clothing.

  FIG. 9 shows an example of a color image of an arbitrary piece of clothing. The color image may be prepared in advance by the virtual fitting system 1 or may be created outside the virtual fitting system 1. The color image is obtained by obtaining the color of each pixel when the arbitrary clothing is converted into a two-dimensional image (baked).

  The distance image, the normal image, and the color image are collectively referred to as a two-dimensional image of any clothing. By using a common intermediate polygon model for a plurality of different clothes, the clothes database 311 can store a two-dimensional image of the clothes having a common reference. That is, since the generation unit 315 superimposes a two-dimensional image of a plurality of clothes using a common intermediate polygon model, the conversion unit 316 can easily convert the three-dimensional image from the superimposed image. Note that clothes are usually manufactured in a plurality of sizes, but in the present invention, it is preferable to obtain a two-dimensional image by using a common intermediate polygon model in common in a plurality of sizes. That is, when the user wants to obtain a virtual fitting image when a plurality of clothes of different sizes are tried on, two-dimensional images obtained based on different intermediate polygon models are superimposed. In this case, since the distance images of the two-dimensional images have different reference points, the distances of the clothes may be reversed (swapped).

  FIG. 6 is a table illustrating an example of the user database 312 that stores information on a plurality of users. The user database 312 stores user email addresses, user genders, user ages, and the like in association with user identification information (user IDs) of a plurality of users. Further, the user database 312 stores the body type information of the user. The user's body type information is input by the user, and is information such as height and weight. The information of the user can be appropriately modified by the user, and some items for which the user rejects input may not store data. In order to obtain an accurate virtual fitting image, the height and weight are preferably required.

  In addition, the user database 312 further stores a two-dimensional image that is converted into a two-dimensional image as a distance image and a normal image in the same manner as clothing based on body type information of a plurality of users. Here, the body type information may include only simple information such as height and weight, but may also include detailed body type information such as chest circumference, arm length, and thigh circumference.

(Polymerization process of two-dimensional image by generation unit 315)
10 to 12 are diagrams for explaining a polymerization process of an arbitrary plurality of clothes. FIG. 10 is a schematic diagram illustrating a two-dimensional image of clothing in which the clothing order is the innermost. The innermost garment is the inner. FIG. 11 is a schematic diagram showing a two-dimensional image of clothing having the next clothing order of the innermost clothing. Here, it is called an outer. FIG. 12 is a schematic diagram showing the result of superimposing the two-dimensional images of the inner (FIG. 10) and the outer (FIG. 12).

  The generation unit 315 extracts the two-dimensional image of the innermost clothing from the clothing database 311 based on the clothing order of the plurality of clothings selected by the user, and then extracts the two-dimensional image of the clothing in the clothing order from the clothing database 311. And then polymerized. That is, the generation unit 315 adds the value of the distance included in each distance image at the same pixel (position) in the direction of the pixel included in the normal image. The cumulative value of the distance is the position of the outermost garment at that pixel. By giving this accumulated value a distance direction in each pixel, a vector of each pixel is determined. In addition, in addition to the normal image, a more accurate superimposed image can be obtained by using the transmission value of the color image as a factor. Then, the generation unit 315 determines the color of the outermost clothing in each pixel as the color in the pixel.

  In other words, the generation unit 315 can generate a superimposed image expressing a plurality of clothes as a two-dimensional image by superimposing two-dimensional images generated by using a common intermediate polygon model on a plurality of clothes. . By performing image processing using a common intermediate polygon model, the generation unit 315 can guarantee that information corresponding to the same coordinates is loaded on various clothes regardless of the type and size of the clothes. .

(Conversion process to three-dimensional image by conversion unit 316)
FIG. 13 is a diagram for explaining the conversion of the superimposed image of the two-dimensional image into the three-dimensional image by the conversion unit 316. The conversion unit 316 converts the superimposed image generated by the generation unit 315 into a three-dimensional image by assigning it to a common intermediate polygon model. Further, the conversion unit 316 can generate a virtual fitting image for visualizing a state where the user is trying on a plurality of clothes by synthesizing the head images of the users received from the terminal devices 2 of the plurality of users. it can. In FIG. 13, the composition of the user's head image is omitted.

  Since the common intermediate polygon model used to obtain a two-dimensional image of a plurality of clothes is based on a standard body shape, in order to obtain a fitting image in a fitting state closer to the body shape of each user, The conversion unit 316 corrects the value of the distance in the normal direction of the common intermediate polygon model based on the body type information of the user included in the user database 312. Specifically, when the weight of the user is smaller than the standard body shape at an arbitrary height, the conversion unit 316 subtracts the distance in the normal direction based on the difference from the standard body weight. The degree of subtraction of each pixel is determined in advance for each height (range of height), and a part of the body that is likely to have an effect on the body shape due to a difference in weight is experimentally or statistically used as a map-like information. The storage unit 313 stores the information in advance. The process performed by the conversion unit 316 when the user's weight is larger than the standard body shape at an arbitrary height is the reverse of the process when the user's weight is smaller than the standard body shape, and a detailed description thereof will be omitted.

  Even when detailed body shape information is input by the user, the value of the distance in the normal direction may be corrected based on an arbitrary polygon model in consideration of whether it is smaller or larger than the standard. Note that the common intermediate polygon model used to obtain a two-dimensional image of a plurality of clothes is based on the standard height of a man or a woman, so that the model differs depending on the difference between the user's height and the standard height. The length of the clothes (the position of the lowest part of the clothes) changes.

(New member registration process)
FIG. 14 is a diagram showing an example of an operation sequence of a series of flows of a new member registration process of the user by the virtual fitting system 1 according to the present embodiment. That is, the process is performed when the user newly registers personal information and uses the virtual fitting system 1.

  The operation sequence described below is mainly executed by the server processing unit 317 in cooperation with each element of the server 3 based on a program stored in the server storage unit 313 in advance. Furthermore, the operation sequence described below is mainly performed by the terminal processing unit 215 of the user terminal device 2 based on a program stored in the terminal storage unit 212 of the user terminal device 2 in advance. Performed in cooperation with the element. In the operation sequence described below, the server 3 transmits and receives various information to and from the terminal device 2 via the server communication unit 318.

  This process is performed when the user presses a “new member registration button” or the like to become a new login user. First, the server 3 determines whether the user's mail address has been input (step S101). In this step, the user may be required to input a duplicated e-mail address for confirmation. If the input of the user's e-mail address cannot be confirmed (NO in step S101), the server repeats step S101.

  On the other hand, if the input of the user's e-mail address is confirmed (YES in step S101), the server 3 determines whether the input user's e-mail address is an already registered address (step S102). If the input mail address of the user is already registered (YES in step S102), the process returns to step S101, and server 3 prompts the user to input another mail address.

  If the input mail address of the user is not already registered (NO in step S102), the server 3 waits for input of the user's personal information (step S103). Here, the personal information refers to the user's name, telephone number, gender, height, weight, and the like. These information can be freely set by the provider of the virtual fitting system 1. When the virtual fitting system 1 also sells clothes, it is preferable to accept payment information such as a credit card as personal information as personal information. If the input of the user's e-mail address cannot be confirmed (NO in step S103), the server repeats step S103.

  On the other hand, when the input of the user's personal information has been confirmed (YES in step S103), the server 3 determines whether or not all the items of the input personal information of the user have been input (step S104). If there is an incompleteness (loss) in the input of the user's personal information (NO in step S104), the process returns to step S103, and the server 3 provides assistance such as highlighting an uninputted item on the personal information input screen. To prompt the user to enter an item that has not been entered. Note that, in step S104, the server 3 requests the user to input the height and weight as the user's body type information, but the server 3 may include the information in the next step S105. In that case, it is preferable that step S105 is also an input required item.

  When all the items of the user's personal information have been input (YES in step S104), the server 3 prompts the user to input detailed body type information of the user (step S105). The detailed body type information is numerical information on detailed body types other than height and weight. Specifically, it includes the chest circumference, arm length, thigh circumference, and the like, but these items do not particularly limit the present invention. Further, the detailed body type information may include a head image of the user. The input of these detailed body type information is optional, and new members can be registered even if they have not been input.

  In subsequent step S106, server 3 waits for pressing a “button for final confirmation” for receiving a request for final confirmation of personal information and the like input by the user. If the “button to proceed to final confirmation” is not pressed (NO in step S106), the server repeats step S106.

  On the other hand, when the user presses the button for proceeding to the final confirmation (YES in step S106), server 3 generates a screen for prompting the user to confirm whether or not the personal information input by the user is correct, and generates a screen for the user. The data is transmitted to the device 2 (step S107). Further, on this screen, a “registration button” to be pressed when a final confirmation of personal information or the like input by the user is completed and a membership registration is requested is displayed. In addition, a "return button" for returning to the input screen is displayed when the user has made an error in inputting personal information or the like. The description of the case where the “return button” is pressed is omitted.

  Next, the server 3 waits until the user presses a “registration button” to transmit a request for member registration (step S108). If the “registration button” has not been pressed (NO in step S108), server 3 repeats step S108.

  On the other hand, when the “registration button” is pressed (YES in step S108), the server 3 stores the personal information input by the user and the user identification information to be newly added in the user database 312 of the server storage unit 313 in association with each other. (Step S109). Then, the server 3 ends the new member registration process.

(Generation process of virtual fitting image by generation unit 315 and conversion unit 316)
FIG. 15 is a diagram illustrating an example of an operation sequence of a series of flows of a virtual fitting image generation process of a plurality of clothes by the virtual fitting system 1 according to the present embodiment. In other words, this is a process for generating a virtual fitting state when a user tries on a plurality of arbitrary clothes selected from the clothes database 311 as a virtual three-dimensional image.

  The operation sequence described below is mainly executed by the server processing unit 317 in cooperation with each element of the server 3 based on a program stored in the server storage unit 313 in advance. Further, the operation sequence described below is mainly performed by the terminal processing unit 215 of the terminal device 2 based on the program stored in the terminal storage unit 212 of the terminal device 2 of the user. It is performed in cooperation. In the operation sequence described below, the server 3 transmits and receives various kinds of information to and from the user terminal device 2 via the server communication unit 318.

  Since this processing is performed after the user has completed the step of selecting a plurality of clothes from the clothes database 311, the processing of selecting clothes from the clothes database 311 by the user is omitted in this embodiment. Further, the present embodiment is characterized in that a virtual fitting image of a plurality of clothes is generated, but may have a function of generating a virtual fitting image of a single clothes.

  First, the server 3 determines whether or not a selection of a plurality of clothes and an input of a clothes order of the selected clothes have been input from the user's terminal device 2 (step S201). If the selection input of the plurality of clothes and the input of the clothing order of the selected and input clothes cannot be confirmed (NO in step S201), server 3 repeats step S201. If the user has forgotten to input the order of clothes, a warning display or the like is displayed on the user's terminal device 2 to urge the user to input the order of clothes. The input of selecting a plurality of clothes and the input of the order of the selected clothes are performed when the user presses a “button to try on” or the like.

  Next, the server 3 extracts a two-dimensional image from the clothes database for each of the clothes selected and input by the user (step S202).

  Then, the server 3 generates a superimposed image by superimposing the distance image and the normal image of the extracted two-dimensional images (Step S203). This superimposed image is generated in the server 3 and is not transmitted to the user terminal device 2.

  The server 3 extracts the user's head image and body type information from the user database 312, corrects a common intermediate polygon model based on the extracted user's body type information, and synthesizes the head image to synthesize the user's virtual image. A human body model is generated (Step S204).

  The server 3 further converts the superimposed image into a three-dimensional image as a fitting image by further superimposing the superimposed image generated in step S203 on the virtual human body model of the user generated in step S204 (step S205).

  The generation process of the virtual fitting image by the generation unit 315 and the conversion unit 316 is based on the premise that the user is logged in to the virtual fitting system 1. It can be used, and the user may be asked to log in at any time during this process. For example, in the conversion process of step S205, since it is necessary to extract the body type information of the user from the user database, it is preferable to make a login mandatory or prompt the login immediately before shifting to this process.

  As described above, the virtual fitting system 1 according to the present embodiment accurately overlaps a plurality of clothes by overlaying the clothes by a simple process of stacking two-dimensional images, and finally stacks the stacked images. By returning to the three-dimensional image, a three-dimensional image can be easily generated. That is, the processing of the server 3 can be reduced, and the processing speed for generating a three-dimensional image can be increased. In addition, since the virtual fitting system 1 converts a plurality of clothes into a two-dimensional image using a common intermediate polygon model and stores the two-dimensional image in the clothes database 311, the plurality of clothes and the body shape of the user are stored in the common intermediate polygon model. A three-dimensional image can be easily obtained by further polymerizing using.

  It should be understood that those skilled in the art can make various changes, substitutions and modifications without departing from the spirit and scope of the invention.

(Modification 1)
In the present embodiment, the generation unit 315 simply adds the value of the distance image in the same normal direction included in the two-dimensional image of a plurality of clothes for each pixel, but actually, the outermost image is determined according to the unevenness of the human body or the clothes. The unevenness of the clothes becomes smoother than the polymerization result of the plurality of polymerization images. That is, it is preferable to smoothly treat the unevenness of the outermost clothes in consideration of the unevenness of the woman's chest and the clothing's button.

  Therefore, the generation unit 315 has the distance magnitude of the distance image in one normal direction among the plurality of normal directions included in the normal image, and the distance image in the normal direction near the one normal direction. According to the difference from the magnitude of the distance, a correction is performed to make the distance in the normal direction having a small distance close to the distance in the normal direction having a large distance, and then a superimposed image is generated. By this correction, the virtual fitting image can be made closer to the fitting state when actually fitting. This processing may be performed for each piece of clothing to be worn, or may be performed only once after the added distance is calculated.

(Modification 2)
In the present embodiment, the generation unit 315 simply adds, for each pixel, the value of the distance image in the same normal direction included in the two-dimensional image of a plurality of clothes regardless of the type of the material of the clothes. However, if the distance is simply added, a virtual fitting image different from the actual clothing state at the time of fitting may be generated.

  Therefore, the generation unit 315 generates a superimposed image by correcting the distance in the normal direction based on the material information or the stiffness information of a plurality of clothes included in the clothes database 311. That is, the generation unit 315 corrects the outermost distance in accordance with a material that is easily affected by the human body or lower-layer clothing or a material that is less likely to be affected by the clothing. Also in this modification, similarly to the first modification, it is preferable to perform correction so that the distance in the normal direction having a small distance approaches the distance in the normal direction having a large distance. This modification may be combined with the first modification.

(Modification 3)
In the present embodiment, when the distance image and the normal image included in the two-dimensional image of a plurality of clothes are superimposed, the generation unit 315 converts the color of the portion having the outermost distance in the normal direction into the color in the normal direction. Thus, a superimposed image is generated, but depending on the transmittance of the outer clothes, the color may be different from the color at the time of actual fitting.

  Therefore, the generation unit 315 generates a superimposed image by correcting the color in the normal direction based on the colors of the outer clothes of the plurality of clothes, the inner clothes of the outer clothes, and the transmittance of the outer clothes. That is, when the transmittance of the outer garment is high, the color of the garment in the lower layer is transmitted. A more accurate virtual fitting image can be obtained by changing the ratio of adding the color of the lower layer clothing to the color of the outer clothing according to the transmittance.

(Scope of application of the present invention)
In the virtual fitting system 1 according to the present embodiment, a virtual fitting image in which the users mutually control the web browsers of the terminal devices 2 of the plurality of users and the server 3 visualizes the overlapping of a plurality of clothes via the Internet 4 or the like. Is transmitted to the terminal devices 2 of a plurality of users. As another mode, virtual fitting can be performed as a function of the application software downloaded from the server 3 by the terminal devices 2 of a plurality of users. That is, the application refers to the clothing database 311 stored in the server storage unit of the server 3 and selects and inputs a plurality of arbitrary clothing. Further, the clothing database 311 may be included not in the server 3 but in an external server or the user's terminal device 2. When receiving a selection input of a plurality of clothes, the user's terminal device generates a superimposed image of a two-dimensional image or converts the superimposed image into three-dimensional images in cooperation with application software. In this case, the terminal processing unit 215 controls the generation unit 315 and the conversion unit 316 described above.

[Second embodiment]
Next, a second embodiment will be described. In the second embodiment, only parts different from the first embodiment will be described, and description of the same parts as in the first embodiment will be omitted.

In the virtual fitting system 1 according to the second embodiment, the generation unit 315 generates a superimposed image based on a distance image included in a two-dimensional image of a plurality of clothes and alpha representing the opacity of the two-dimensional image.
For the distance image, for example, a vector displacement map is used. The vector displacement map can show three-dimensional displacement in each of red, green, and blue (RGB) channels.

The vector displacement map is generated by the virtual fitting system 1 or in a device arranged outside the virtual fitting system 1, for example, as follows.
First, the virtual fitting system 1 or the like stores the first position map (X, Y, Z coordinates as R, G, B, respectively) from the coordinates in the space of the three-dimensional model (intermediate model) based on the UV map. Stuff). Next, the virtual fitting system 1 or the like uses, for example, shrink wrap (a technique of projecting the vertices of a certain model onto the surface of another model) or the like to convert a three-dimensional model (intermediate model) into a target whose shape is to be acquired. The second position map is generated based on the transformation into a model indicating. The vector displacement map is calculated by subtracting the value of the first position map from the value of the second position map.
Note that the UV map is data indicating how a plane constituting a three-dimensional model is developed on a two-dimensional plane. The surface constituting the three-dimensional model can be regarded as a plane by itself. The UV map is data indicating how to assign an image to each plane of the three-dimensional model.

  Alpha is acquired from a two-dimensional image based on, for example, a paint process by image editing software. Alternatively, the alpha is acquired based on the color and opacity of another model of the clothing by, for example, a bake (transfer) process.

  FIG. 18 is a schematic diagram illustrating a two-dimensional image (clothes image) of clothing in which the clothing order is the innermost according to the second embodiment. FIG. 19 is a schematic diagram illustrating a two-dimensional image (a vector displacement map) of clothing in which the clothing order is the innermost according to the second embodiment. FIG. 20 is a schematic diagram illustrating a two-dimensional image (image of clothing) of clothing whose clothing order is the outermost according to the second embodiment. FIG. 21 is a schematic diagram illustrating a two-dimensional image (a vector displacement map) of clothing in which the clothing order is the outermost according to the second embodiment. FIG. 22 is a schematic diagram illustrating an image in which the alpha channel of the image of the clothing is applied to the vector displacement map for the clothing whose clothing order is the innermost. FIG. 23 is a schematic diagram illustrating an image in which the alpha channel of the image of the clothing is applied to the vector displacement map for the clothing whose clothing order is the outermost. FIG. 24 is a schematic diagram illustrating an image obtained by superimposing the image of the innermost clothing and the image of the outermost clothing (alpha synthesis of the clothing images). FIG. 25 is a schematic diagram showing an image obtained by superimposing an image of the innermost clothes and an image of the outermost clothes (alpha synthesis of vector displacement maps).

The generation unit 315 extracts a two-dimensional image of the clothing whose clothing order is the innermost from the clothing database 311 and applies the alpha channel of the clothing image (FIG. 18) to the vector displacement map (FIG. 19). . The result of the application is as shown in FIG.
The generation unit 315 extracts the two-dimensional image of the clothing whose clothing order is the outermost from the clothing database 311 and applies the alpha channel of the clothing image (FIG. 20) to the vector displacement map (FIG. 21). . The result of the application is as shown in FIG.

  Next, the generation unit 315 superimposes the innermost clothing and the outermost clothing. Specifically, the generation unit 315 alpha-combines the image of the innermost clothes (FIG. 18) and the image of the outermost clothes (FIG. 20). The alpha synthesis is a process of synthesizing the color (RGB) of each pixel of an image having RGB and alpha values using transmission information (alpha). The result of the alpha synthesis is as shown in FIG. Thereby, the generation unit 315 can synthesize the “color” of the clothing according to the transmittance. "Superposition" is a process of combining a plurality of images or superimposing a plurality of images.

  The generation unit 315 alpha-combines the vector displacement map of the innermost clothes (FIG. 22) and the vector displacement map of the outermost clothes (FIG. 23). A vector displacement map originally has only RGB channels indicating three-dimensional displacement (X, Y, Z coordinates). However, in the present embodiment, since the alpha channel obtained from the clothing image is added to the vector displacement map by the generation unit 315, an alpha synthesis method can be applied. The result of the alpha synthesis is as shown in FIG. Thereby, the generation unit 315 can synthesize the “displacement amount” of the clothing according to the transmittance.

  The conversion unit 316 generates a three-dimensional image based on the two-dimensional image superimposed by the generation unit 315, as in the first embodiment.

Reference Signs List 1 virtual fitting system 2 terminal device 211 terminal communication unit 212 terminal storage unit 213 terminal operation unit 214 terminal display unit 215 terminal processing unit 3 server 311 clothing database 312 user database 313 server storage unit 314 reception unit 315 generation unit 316 conversion unit 317 server Processing unit 318 Server communication unit

Claims (11)

A model information receiving unit that receives a head image of the model and body type information of the model from the terminal device,
A clothing information receiving unit that receives an arbitrary plurality of clothes and an arbitrary clothing order in the same part of the body,
A two-dimensional image corresponding to the arbitrary plurality of clothes is extracted from an image information database obtained by converting the clothes of the plurality of clothes into a two-dimensional image, and a superimposed image obtained by superimposing the two-dimensional images based on the clothing order is obtained. A generation processing unit to generate,
A conversion processing unit that converts the superimposed image into a three-dimensional image based on the body type information;
A transmitting unit that transmits the three-dimensional image and the head image to the terminal device ,
The virtual fitting device , wherein the generation processing unit generates the superimposed image by superimposing the two-dimensional image converted using an arbitrary intermediate polygon model in common . The conversion processing unit generates a virtual human body model of the model by correcting the arbitrary intermediate polygon model based on the body type information,
The virtual fitting apparatus according to claim 1 , wherein the conversion processing unit converts the superimposed image into the three-dimensional image by further superimposing the superimposed image on the virtual human body model. The virtual fitting device according to claim 2 , wherein the generation processing unit generates the superimposed image by superimposing a distance image and a normal image included in a two-dimensional image of the plurality of clothes. The generation processing unit, the distance in the one normal direction by adding the size of the distance of the distance image in the one normal direction included in the normal image from the innermost clothing to the outermost clothing The virtual fitting device according to claim 3 , wherein the superimposed image is generated by calculating. The generation processing unit includes a magnitude of a distance of the distance image in one normal direction among a plurality of normal directions included in the normal image, and a distance image in a normal direction near the one normal direction. The overlapping image is generated by bringing a distance in a normal direction having a small distance closer to a distance in a normal direction having a large distance according to a difference from the magnitude of the distance. The method according to claim 4 , wherein Virtual fitting device. The image information database further includes material information or rigidity information of the plurality of clothes,
The virtual fitting device according to claim 5 , wherein the generation processing unit generates the superimposed image by correcting the distance in the normal direction based on the material information or the rigidity information. The two-dimensional image further includes a color image,
The generation processing unit includes, as a color of the three-dimensional image, a color of a portion having an outermost distance in a normal direction when the distance image and the normal image included in the two-dimensional images of the clothes are superimposed. The virtual fitting apparatus according to claim 6 , wherein the overlapped image is generated by setting a color in the normal direction. The generation processing unit generates the superimposed image by correcting the color in the normal direction based on the colors of the outer clothes of the plurality of clothes and the inner clothes of the outer clothes, and the transmittance of the outer clothes. The virtual fitting device according to claim 7 , wherein: The generation processing unit generates the superimposed image based on a distance image included in the two-dimensional image of the plurality of clothes and alpha representing opacity of the two-dimensional image.
The virtual fitting device according to claim 2 . Receiving a head image of the model and body type information of the model from the terminal device;
Receiving any of a plurality of clothes and the order of wearing the plurality of clothes in the same part of the body;
A two-dimensional image corresponding to the arbitrary plurality of clothes is extracted from an image information database obtained by converting the clothes of the plurality of clothes into a two-dimensional image, and a superimposed image obtained by superimposing the two-dimensional images based on the clothing order is obtained. A generating step to generate ;
Converting the superimposed image into a three-dimensional image based on the body type information;
Transmitting the three-dimensional image and the head image to the terminal device ,
The virtual fitting method, characterized in that the generating step generates the superimposed image by superimposing the two-dimensional image converted using an arbitrary intermediate polygon model in common . On the computer,
A function of receiving a model head image and body type information of the model from the terminal device;
A function of receiving an arbitrary plurality of clothes and a clothing order of the arbitrary plurality of clothes in the same part of the body,
A two-dimensional image corresponding to the arbitrary plurality of clothes is extracted from an image information database obtained by converting the clothes of the plurality of clothes into a two-dimensional image, and a superimposed image obtained by superimposing the two-dimensional images based on the clothing order is obtained. Generation function to generate ,
A function of converting the superimposed image into a three-dimensional image based on the body type information;
Transmitting the three-dimensional image and the head image to the terminal device .
A virtual fitting program , wherein the generation function generates the superimposed image by superimposing the two-dimensional image converted using an arbitrary intermediate polygon model in common .

Images