JP2007011543A - Article-wearing simulation system, article-wearing simulation method, and the like - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an article-wearing simulation system which can perform a simulation which makes a user feel as if the user actually worn an article, and also provide an article-wearing simulation method and the like. <P>SOLUTION: A server is provided with a storage means which stores body image information on users and article image information representing the external appearances of articles and also stores position information on a plurality of deformation points arranged on the article image information. A terminal device is provided with; an image acquisition means which acquires the body image information, the article image information, and the position information on the deformation points, which are all stored in the server, from the server; a body image display means which displays the body image information thus acquired; a deformation point moving means which changes the acquired position information on the deformation points to move the positions of the deformation points; an article image deformation means which deforms the shapes of the articles of the acquired article image information based on the position information on the deformation points; and a deformed-article image display means which displays article image information relating to the deformed shapes of the articles on the displayed body image information. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention includes a terminal device used by a user and a server to which the terminal device can be connected via a network, and a technology such as a product wearing simulation system and a product wearing simulation method for simulating product wearing by a user. Related to the field.

  When consumers purchase products such as clothes, hats, gloves, etc., it is common to decide which products to purchase from a plurality of products by trying on products that they are interested in at stores in advance. However, it is troublesome to repeat the try-on until it is satisfactory, and it also takes time, so it may be necessary to give up the try-on or purchase of the product.

For such a problem, for example, in the website use experience system described in Patent Document 1, by displaying an image of clothes or the like on a model image reflecting a consumer's body size, A method for simulating the wearing of a shoe has been proposed. According to this method, it is possible to determine the purchase of a product without trying on at a store.
JP 2002-24640 A

  However, in the method described in Patent Document 1 described above, the model image does not completely reflect the characteristics of the consumer's body, and a clothing image having a shape that matches the body shape of the consumer is obtained. It is not displayed superimposed on the model image.

  Therefore, from the viewpoint of consumers, there is a problem that it is difficult to find out that they actually tried on, and that it is difficult to determine whether the clothes are really suitable for them.

  The present invention has been made in view of the above points, and an object thereof is to provide a product wear simulation system, a product wear simulation method, and the like that can obtain a simulation result close to the appearance when the user actually wears it. To do.

  In order to solve the above problem, the invention according to claim 1 includes a terminal device used by a user and a server to which the terminal device can be connected via a network, and simulates wearing of a product by the user. A product wearing simulation system to perform, wherein the server stores body image information representing an appearance of a user's body and product image information representing an appearance of the product, and conforms to a body shape of the body image information Storage means for storing deformation point position information indicating the positions of a plurality of deformation points arranged on the product image information in order to change the product shape of the product image information, and the terminal device in the server An image acquisition means for acquiring the stored body image information, product image information, and deformation point position information from the server, and the acquired body image information are displayed. Body image display means, deformation point moving means for moving the position of the deformation point by changing the acquired deformation point position information, and the acquired product image based on the changed deformation point position information Product image deformation means for deforming the product shape of information, and deformed product image display means for displaying product image information relating to the deformed product shape on the displayed body image information, To do.

  According to a second aspect of the present invention, in the commodity wear simulation system according to the first aspect, the terminal device displays the acquired commodity image information on the displayed body image information. Means, deformation point display means for displaying the deformation point on the displayed product image information based on the acquired deformation point position information, operation input means for inputting an operation by a user as operation information, The deformation point moving means of the terminal device changes the deformation point position information of the displayed deformation point based on the input operation information, and moves the position of the deformation point. Features.

  According to a third aspect of the present invention, in the commodity wearing simulation system according to the first or second aspect, the storage unit of the server is disposed in a part representing a body shape of the body image information, and Further storing part point position information indicating the positions of a plurality of part points corresponding to the deformation point, and association information between the part point position information and the deformation point position information, and acquiring the image information and the like of the terminal device Further acquires the part point position information and the association information stored by the server from the server, and the deformation point moving means of the terminal device obtains the acquired information based on the acquired association information. The deformation point position information is changed so as to match the acquired part point position information, and the position of the deformation point is moved to the position of the part point.

  According to a fourth aspect of the present invention, in the commodity wearing simulation system according to any one of the first to third aspects, the terminal device includes commodity identification information input means for inputting commodity identification information assigned to the commodity. The server further includes product identification information acquisition means for acquiring and storing the product identification information input by the terminal device from the terminal device, and the storage means of the server includes the acquired product identification information The product image information stored in the terminal device and acquired by the image or the like acquisition unit of the terminal device is product image information related to a product indicated by the stored product identification information.

  The invention according to claim 5 is the commodity wearing simulation system according to any one of claims 1 to 4, wherein the server uses the terminal device to form the product image after the deformation on the body image information. The apparatus further includes result acquisition means for acquiring the result of displaying the information as simulation result information, the storage means of the server stores the acquired simulation result information, and the terminal device is stored by the server It further comprises a result acquisition means for acquiring simulation result information from the server, and a result display means for displaying the acquired simulation result information.

  The invention according to claim 6 is the commodity wearing simulation system according to claim 5, further comprising a store terminal device connected to the server via the network and used in a store, The apparatus further comprises message input means for inputting a message by a user as message information, the server further comprises message acquisition means for acquiring message information input by the terminal device, and the storage means of the server is acquired. Message information is stored, and the store terminal device includes a result acquisition display means for acquiring and displaying the simulation result information and message information stored by the server.

  Invention of Claim 7 is a terminal device contained in the goods wearing simulation system of any one of Claims 1 thru | or 6, Comprising: The said image acquisition means, the said body image display means, The said deformation | transformation point A moving means, the product image deforming means, and the deformed product image displaying means are provided.

  According to an eighth aspect of the present invention, a computer is caused to function as the terminal device according to the seventh aspect.

  A ninth aspect of the present invention is a server included in the commodity wearing simulation system according to any one of the first to sixth aspects, wherein the storage unit is provided.

  According to a tenth aspect of the present invention, a computer is caused to function as the server according to the ninth aspect.

  The invention according to claim 11 is a product wear simulation device for simulating product wear by a user, and stores body image information representing the appearance of the user's body and product image information representing the appearance of the product. In addition, deformation point position information indicating the positions of a plurality of deformation points arranged on the product image information in order to deform the product shape of the product image information in conformity with the body shape of the body image information is stored. Storage means, acquisition means such as an image for acquiring the stored body image information, product image information and deformation point position information from the server, body image display means for displaying the stored body image information, and the storage Deformation point moving means for moving the position of the deformation point by changing the deformation point position information obtained, and the quotient obtained based on the changed deformation point position information. Product image deformation means for deforming the product shape of the image information, and deformed product image display means for displaying the product image information related to the deformed product shape on the displayed body image information. And

  Invention of Claim 12 is equipped with the terminal device which a user utilizes, and the server which the said terminal device can connect via a network, The product wearing in the product wearing simulation system which simulates wearing of goods by a user A simulation method, wherein the server stores body image information representing an appearance of a user's body and product image information representing an appearance of a product, and the product image is adapted to a body shape of the body image information. A step of storing deformation point position information indicating the positions of a plurality of deformation points arranged on the product image information in order to deform the product shape of the information, and a body image in which the terminal device is stored in the server Information, product image information and deformation point position information is acquired from the server, the acquired body image information is displayed, and the acquired The shape point position information is changed to move the position of the deformation point, the product shape of the acquired product image information is deformed based on the changed deformation point position information, and the displayed body image information And displaying the product image information relating to the deformed product shape.

  According to the present invention, a plurality of pieces arranged on the product image information to deform the product shape of the product image information in conformity with the body shape of the body image information, product image information, and body image information stored by the server. The terminal device acquires deformation point position information indicating the position of the deformation point, displays the body image information, changes the position information of the deformation point, and moves the position of the deformation point to change the product shape of the product image information. Since this is deformed and displayed on the body image information, the product image information of the product shape suitable for the user's body shape etc. can be used even when a photographic image or the like of the user is used as the body image information. Since it becomes possible to perform a wearing simulation, a simulation result close to the appearance when the user actually wears can be obtained.

  Hereinafter, the best embodiment of the present invention will be described in detail with reference to the drawings. The embodiment described below is an embodiment in the case where the present invention is applied to a clothes try-on simulation system that simulates the try-on of clothes sold in stores.

[1] Outline of Configuration and Function of Clothes Try-On Simulation System S First, the structure and function of the clothes try-on simulation system S in this embodiment will be described.

  FIG. 1 is a diagram illustrating an example of a schematic configuration of a clothes try-on simulation system S in the present embodiment.

  As shown in FIG. 1, a clothes try-on simulation system S includes a server SA, a portable terminal UT1 and a home terminal UT2 as terminal devices, a store terminal ST as store terminals, and a registration terminal RT that are connected to a network NW. Connected to and configured.

  The server SA, the mobile terminal UT1, the home terminal UT2, the shop terminal ST, and the registration terminal RT are mutually connected via the network NW, for example, using TCP / IP (Transmission Control Protocol / Internet Protocol) as a communication protocol. Data can be sent and received.

  The network NW includes, for example, the Internet, a public line network, a mobile communication line network, a dedicated line (for example, CATV (Community Antenna Television)) and the like.

  In the example of FIG. 1, only one mobile terminal UT1, home terminal UT2, store terminal ST, and registration terminal RT are shown, but a plurality of terminals are actually installed.

[2] Configuration and Function of Server SA Next, the configuration and function of the server SA will be described.

  FIG. 2 is a diagram illustrating an example of a schematic configuration of the server SA in the present embodiment. FIG. 3 is a diagram illustrating an example of a state in which a deformation point is set. FIG. 4 is a diagram illustrating an example of a state in which contour points are set. FIG. 5 is a diagram illustrating an example of the correspondence between the deformation points and the contour points.

  The server SA registers a full body image as body image information that captures the whole body of the user, a clothing image as product image information that captures clothes, and the like in the portable terminal UT1, the home terminal UT2, and the like that perform a fitting simulation. A computer for supplying information.

  As shown in FIG. 2, the server SA includes a control unit 11 having a CPU (Central Processing Unit), a RAM (Random Access Memory), a ROM (Read Only Memory), etc., various programs (server programs, etc.), data, etc. And a communication unit 13 (for example, a network) connected to the network NW and controlling the communication state between the mobile terminal UT1, the home terminal UT2, the store terminal ST, and the registration terminal RT. Adapter, etc.) and are connected to each other via the bus 14.

  The control unit 11 performs overall control of the server SA by the CPU reading and executing various programs stored in the ROM or the storage unit 12, and also stores the storage unit, the product identification information acquisition unit, and the result acquisition according to the present embodiment. It functions as a means.

  The server program or the like may be downloaded from another server or the like via the network NW, or may be recorded on a recording medium such as a CD-ROM and read via a drive. Also good.

  The storage unit 12 includes a product DB (database) 12a and a user DB 12b. The product DB 12a and the user DB 12b may not be provided directly by the server SA, but may be provided by a database server connected to the server SA via a network.

  In the product DB 12a, product information of clothes is registered corresponding to the product code as product identification information uniquely assigned to each clothing. As merchandise information, in addition to the deformation point coordinates and the part name corresponding to each deformation point as deformation point position information indicating the position of the deformation point for deforming the clothes shape of the clothes image, for example, the product name, Brand name, store information (eg store ID (Identification), store name, address, phone number, e-mail address, homepage URL (Uniform Resource Locator), etc.), price, category, material, size, color, pattern Etc. are included.

  As shown in FIG. 3, the deformation point coordinates are set such that the deformation points are arranged at substantially constant intervals on, for example, the outline of the clothes imaged in the clothes image. Further, in association with each deformation point coordinate, the part names of the clothes where the deformation point is located are set, for example, on the collar 1, the collar 2, and the right side 1.

  User information is registered in the user DB 12b corresponding to the member ID uniquely assigned to each member of the system. The user information includes, for example, the user's whole body image, contour point coordinates as part point position information indicating the position on the whole body contour line imaged in the whole body image, and the part name corresponding to each contour point. Information such as name, age, gender, address, phone number, email address, etc. The user information includes a list of product codes that have been input by the user operating the mobile terminal UT1 and the like, matching results as simulation result information, consultation contents regarding simulation results, and the like for each matching result. It is recorded corresponding to the uniquely assigned dressing ID.

  As shown in FIG. 4, the contour point coordinates are set so that the contour points are provided at substantially constant intervals on the contour line of the whole body of the user shown in the whole body image. Further, in association with each contour point coordinate, the body part names where the contour points are located are set as, for example, right head 1, right head 2, right neck 1, right neck 2, and the like. In the present embodiment, the site point is applied to a contour point that is a point located on the contour line of the whole body. However, the present invention is not limited to this.

  In addition, as shown in FIG. 5, the storage unit 12 stores an association of each contour point of the whole body image and each deformation point of the clothes image based on the part name as a part name matching table. This part name matching table is set corresponding to the part of the human body where each part of the clothes should be located when the user actually wears the clothes. For example, the upper right arm 1 of the human body is associated with the upper right sleeve 1 of the clothing, the upper right arm 2 of the human body is associated with the upper right sleeve 2 of the clothing, and the right waist 1 of the human body is associated with the right waist 1 of the clothing.

[3] Configurations and Functions of Mobile Terminal UT1 and Home Terminal UT2 Next, configurations and functions of mobile terminal UT1 and home terminal UT2 will be described.

  FIG. 6 is a diagram illustrating an example of a schematic configuration of the mobile terminal UT1 in the present embodiment.

  The mobile terminal UT1 and the home terminal UT2 are computers used by the user to perform a fitting simulation, the mobile terminal UT1 is a terminal carried by the user, and the home terminal UT2 is installed at the user's home or the like. It is an installed terminal. The portable terminal UT1 is also a terminal for inputting a product code from a price tag of clothes displayed at a store and recording it on the server SA.

  As the mobile terminal UT1, for example, a mobile phone, a PDA (Personal Digital Assistant) or the like is applicable. As the home terminal UT2, a personal computer, an STB (Set Top Box) or the like can be applied.

  Since the configurations and functions of the mobile terminal UT1 and the home terminal UT2 are substantially the same, the following description will focus on the mobile terminal UT1.

  As illustrated in FIG. 6, the mobile terminal UT1 includes a control unit 21 including a CPU, a RAM, a ROM, and the like, a storage unit 22 (for example, a terminal device program, a browser program, and the like), data, and the like. , A hard disk, a non-volatile memory, etc.), a communication unit 23 (for example, a modem, a network adapter, etc.) that is connected to the network NW and controls the communication state with the server SA, and a display unit that displays information such as characters and images 24 (for example, a display), an operation unit 25 (for example, a keyboard, a mouse, an operation button, a touch panel, etc.) as operation information input means for receiving an operation instruction from a user, and a product code input as product identification information input means Unit 26 (barcode reader, IC (Integrated Circuit) tag reader, etc.) and antenna not shown They are connected to each other via a bus 27. In the home terminal UT2, the product code input unit 26 and the antenna unit are unnecessary.

  The control unit 21 performs overall control of the portable terminal UT1 by reading and executing various programs stored in the ROM or the storage unit 22, and the control unit 21 obtains an image and the like according to the present embodiment, a body image display unit, It functions as deformation point moving means, product image deformation means, modified product image display means, acquired product image display means, deformation point display means, and the like.

  Note that the terminal device program or the like includes, for example, a plug-in such as Flash Player in the web browser program, and the server SA via the network by the web browser program as a program such as an active script executed by the plug-in. When connected to the server, it may be downloaded from the server SA, or may be recorded on a recording medium such as a CD-ROM and read via a drive.

  The product code input unit 26 is, for example, a two-dimensional bar code such as a JAN (Japanese Article Number) or QR (Quick Response) code displayed on a price tag or a price board attached to clothes displayed at a store. A product code is read and input from a code or an IC tag. The product code written on the price tag or the like may be input by the user operating the operation unit 25.

[4] Configuration and function of store terminal ST and registration terminal RT The store terminal ST is installed in a store or the like that sells clothes, and consults the user regarding the result of the fitting simulation by the mobile terminal UT1 or the home terminal UT2 and the result of the simulation. This is a terminal for acquiring and displaying the contents and inputting advice for the contents of the consultation, and a shop ID is uniquely assigned to each shop terminal ST. The configuration of the store terminal ST is the same as that of the home terminal UT2.

  The registration terminal RT is a terminal that is installed in a photo studio, a store, etc., and takes a captured whole body image and clothes image and registers it in the server SA, and a product code input unit (for example, a barcode) that inputs a product code Reader, IC tag reader, etc.), and a photographic image input unit (for example, a digital camera, a film scanner, etc.) for inputting a photographic image.

[5] Operation of Clothes Try-On Simulation System S Next, an example of operation in the clothes try-on simulation system S having the above configuration will be described.

(1) Registration of whole body image and setting of contour point First, the operation for registering a whole body image will be described.

  A user's full-length photograph is taken at a photo studio or the like provided with a photographing facility. For example, the user wears a black suit so that the outline of the body becomes clear. Then, the whole body picture of the user is taken with a blue screen background. For example, when a whole body photograph is taken by a digital camera or the like, the camera and the registration terminal RT are connected by a USB (Universal Serial Bus) cable or the like, and the registration terminal RT inputs the whole body image from the camera. Remember.

  In the present embodiment, an image showing the whole body is used as the body image information. However, the present invention is not limited to this, and an image of a part of the body may be used.

  The registration terminal RT activates the image processing application software in response to an operator's operation instruction, and performs mask processing on the whole body image based on, for example, the color information of the blue screen displayed in the whole body image (the whole body image When the background image and the like are combined and displayed on the display, the blue screen portion is omitted and the background image is displayed).

  Thereafter, the registration terminal RT makes a member registration request by transmitting other user information (name, age, etc.) to the server SA together with the processed whole body image according to the operator's operation instruction.

  The server SA that has received the whole body image or the like generates a member ID for the user, and registers the whole body image and other user information in the user DB 12b in association with the member ID.

  Next, the operation when setting contour points will be described.

  In response to the operator's operation instruction, the server SA that has received a whole body image transmission request from an operator terminal connected to the server SA transmits the whole body image corresponding to the designated member ID to the operator terminal.

  The operator terminal displays the received whole body image on a display or the like, and sets contour points at substantially equal intervals on the contour line of the human body of the whole body image by the operation of the operator. Instead of the operation by the operator, for example, the operator terminal may determine the masked part and the part not masked and automatically set the equidistant contour points. The operator terminal generates and stores contour point coordinates corresponding to the position of the contour point thus set.

  The operator sets a part name for each set contour point. For example, when a contour point is selected by an operator's operation, the operator terminal displays a list of part names, and the operator terminal selects the part name from the list, and the operator terminal corresponds to the selected part name to the contour point. Add and remember.

  When the setting is finished, the operator terminal transmits the stored contour point coordinates and part name together with the member ID to the server SA according to the operator's operation instruction, and the server SA corresponds to the received contour point coordinates and part name received. At the same time, it is registered in the user DB 12b as user information of the user indicated by the member ID.

(2) Input of Product Photo Image and Setting of Deformation Point A clothing photo is taken in the same manner as in the case of the whole body image described above, and mask processing is performed at the registration terminal RT.

  Then, the registration terminal RT inputs a product code from a price tag attached to the clothes, etc., according to a user's operation instruction, and a product photo image and other product information subjected to mask processing (product name, brand name, etc.) At the same time, a product registration request is sent to the server SA.

  The server SA that has received the product photo image or the like registers the photo image information and other product information in the product DB 12a in association with the received product code.

  The deformation point is set in the same manner as the contour point setting described above. It is not necessary to set the deformation points corresponding to all the body contour points. For example, in the case of a T-shirt, it is only necessary to set deformation points corresponding to some contour points of the upper body. Moreover, even if the same clothes have a plurality of sizes (for example, S, M, L, etc.), the sizes can be expressed by changing the number of deformation points to be set.

(3) Recording of Product Code Next, the operation when the product code is input at the portable terminal UT1 and recorded by the server SA will be described.

  In response to a user operation instruction, the mobile terminal UT1 activates an application for inputting a product code, and inputs a product code from a price tag attached to clothes by the product code input unit.

  Then, the mobile terminal UT1 transmits the input product code together with the member ID input in advance by the user to the server SA.

  The server SA adds the received product code to the list of product codes corresponding to the received member ID and records it in the product DB 12a.

  In this way, it is possible to record a list of product codes of clothes that the user has seen at the store etc., for example, although there are clothes that you are interested in, it is troublesome to try on the spot, or the time to try on If there is not, it is possible to perform a try-on simulation for the clothes later.

(4) Try-on Simulation Next, the operation when a try-on simulation is performed will be described.

  7 and 8 are flowcharts showing an example of the flow of processing of the portable terminal UT1 when performing a fitting simulation. FIG. 9 is an example of a screen displayed in the fitting simulation, (a) is an initial fitting simulation screen, (b) is a recorded product list screen, and (c) is displayed on the whole body image. It is a try-on simulation screen when a clothes image is displayed. Moreover, FIG. 10 is a figure which shows an example of a mode that a deformation | transformation point is moved and a clothes shape is matched with a body shape. FIG. 11 is a diagram illustrating an example of how the deformation point moves to the position of the corresponding contour point.

  When the user starts the try-on simulation program by operating the operation unit 25, the portable terminal UT1 designates a member ID and transmits a transmission request for user information and product information to the server SA as shown in FIG. (Step S1).

  The server SA that has received the transmission request carries the part name matching table stored in the storage unit 12 and the whole body image and contour point coordinates registered in the user DB 12b as the user information of the user indicated by the designated member ID. Transmit to terminal UT1. The server SA also reads a list of product codes recorded in the user DB 12b, reads product information corresponding to each product code in the list from the product DB 12a, and transmits it to the mobile terminal UT1.

  The mobile terminal UT1 that has received the information (step S2) displays, for example, a try-on simulation screen 31 as shown in FIG. 9A on the display unit 24 (step S3).

  On the try-on simulation screen 31, the received whole body image of the user is displayed. In addition, a clothes button 31, a move button 32, a deformation button 33, an automatic button 34, and a save button 35 are displayed.

  Then, the mobile terminal UT1 inputs the operation content by the user (step S4) and determines the operation content (step S5).

  Here, when the user selects the clothes button 32 (step S5: clothes), the portable terminal UT1 displays, for example, a recorded product list screen 37 as shown in FIG. 9B based on the received product information. (Step S6).

  On the recorded product list screen 37, for example, the product name, brand name, store name, list price, etc. are displayed together with the clothes image information of the clothes recorded in advance by the user. In addition, a selection button 38 is displayed for each product.

  Then, the portable terminal UT1 inputs the content of the selection operation by the user (step S7), and when any clothing selection button 38 is selected, the portable terminal UT1 displays the try-on simulation screen 31 (step 8). Further, as shown in FIG. 9C, the clothes image of the selected clothes is displayed superimposed on the whole body image (step S9), and the process proceeds to step S4. Note that the user can select a plurality of clothes images by repeating the processes of steps S4 to S9.

  Next, when the user selects the move button 33 (steps S4 and S5: move), the mobile terminal UT1 inputs the operation content by the user (step S10), and moves the clothes image based on the input operation content. Display (step S11), and move to step S4. Thereby, the user can move the clothes image to a desired position. Depending on the category of the product included in the product information, in step S9, the clothes image of the clothes selected by the user can be displayed at a predetermined position (for example, the upper body of a T-shirt, the lower body of jeans, etc. ).

  Next, when the user selects the deformation button 34 (steps S4 and S5: deformation), as shown in FIG. 7, the mobile terminal UT1 places a deformation point on the clothes image based on the received deformation point coordinates as shown in FIG. The display is performed as shown in (a) (step S12).

  Then, the mobile terminal UT1 inputs an operation content by the user (step S13), and if it is a selection operation (step S14: YES), the process proceeds to step S15, and if it is not a selection operation, that is, an end operation is performed. In the case (step S13: NO), the process proceeds to step S19.

  In step S15, the portable terminal UT1 inputs the operation content by the user, and moves the deformation point by changing the coordinates of the deformation point selected based on the input operation content (step S16).

  Next, the mobile terminal UT1 deforms the clothes shape of the clothes image based on the changed deformation point coordinates so that the outline of the clothes follows the moved deformation point (step S17). First, the deformation process of the outline of the clothes can be performed by a curve interpolation method between the moved deformation point and the deformation point adjacent thereto. In addition, a method such as warping used for morphing a two-dimensional image, three-dimensional texture mapping, or the like can be used for the deformation process of a clothes image. For example, a mesh having a deformation point as a control point is constructed in a clothes image, and the clothes shape is arbitrarily deformed by moving the control point. As a deformation theory of an image using a mesh structure, for example, there is a Bezier surface method. In this way, a technique for transforming an image into an arbitrary shape is also incorporated in, for example, a live transformation tool of Adobe Illustrator sold by Adobe Systems.

  After deforming the clothes shape, the mobile terminal UT1 displays the deformed clothes image on the display unit 24 (step S18), and proceeds to step S13.

  In this way, when the processes of steps S13 to S18 are repeated, and each deformation point is moved in accordance with the body shape of the whole body image by the user's operation as shown in FIG. 9B, FIG. ), The clothes shape is deformed to match the body shape, so that it is possible to perform a try-on simulation using a clothes image that matches the body shape of the user.

  If the user performs an end operation (steps S13 and S14: NO), the deformation point is deleted (step S19), and the process proceeds to step S4.

  In addition to moving the deformation point by user operation, it is also possible to automatically move the deformation point to deform the clothes shape.

  That is, when the user selects the automatic button 34 (steps S4 and S5: automatic), as shown in FIG. 11, the mobile terminal UT1 selects the deformation points one by one (step S20), and the received part name matching table , It is determined whether or not there is a contour point corresponding to the selected deformation point (step S21).

  Here, when there is no corresponding contour point (step S21: NO), the process proceeds to step S23, and when there is a corresponding contour point (step S21: YES), the transformation point coordinates are set to the corresponding contour point. By matching the coordinates, the deformation point is moved to the position of the contour point (step S22).

  And portable terminal UT1 determines whether all the deformation points were moved (step S23), and when not moving (step S23: NO), it transfers to step S20.

  In this way, by repeating the processes in steps S20 to S22, when the movement of all the deformation points is completed (step S23: YES), the mobile terminal UT1 determines the shape of the clothes based on the changed deformation point coordinates. Is transformed (step S24). Here, since the coordinates of the deformation points coincide with the coordinates of the contour points corresponding to these, by matching the contour lines connecting the deformation points to the contour lines connecting the contour points of the body image, What is necessary is just to deform | transform the outline of. In addition, the deformation of the clothes image is performed using a deformation method using a mesh structure as described above.

  After deforming the clothes shape, the mobile terminal UT1 displays the deformed clothes image (step S25), and proceeds to step S4.

  In the present embodiment, when there is no contour point corresponding to the deformation point, the deformation point is not moved, but as described above, the contour line connecting the two adjacent deformation points is represented by the body image. The coordinates of the deformation point for which there is no corresponding contour point may be complemented and moved so as to coincide with the contour line.

  Thus, in the mobile terminal UT1, the clothes shape can be automatically matched to the body shape based on the part name matching table, so that the burden on the user's operation is reduced and the clothes more suitable for the user's body shape. It is possible to perform a fitting simulation with the image.

  In addition, after this, it is also possible to adjust the clothes shape by a user's operation (steps S12 to S19).

  Next, when the user selects the save button 36 (steps S4 and S5: save), the mobile terminal UT1 displays a screen for inputting the name of the dress for the simulation result on the display unit 24 (step S26).

  Next, when a name is input by the user's operation (step 27), for example, an image in which a body image and a deformed clothes image are combined is generated, and this is used as a matching result together with the name and member ID, and a simulation is performed. The product code of the performed clothes is transmitted to the server SA (step 28).

  The server SA that has received the information generates a dressing ID, registers the dressing result, the dressing name and the product code in association with the dressing ID and registers them in the user DB 12b as user information indicated by the member ID.

  In the present embodiment, the fitting simulation is performed on the clothes recorded in advance by the user. However, the present invention is not limited to this. For example, from the clothes registered as product information in the server SA, You may perform a fitting simulation with the clothes selected by the user.

  Further, in the present embodiment, the part name matching table is stored by the server SA, and the portable terminal UT1 is acquired from the server SA when performing the fitting simulation. However, the present invention is not limited to this. You may memorize | store in the memory | storage part 22 of portable terminal UT1 previously.

(5) Confirmation of Simulation Results, Consultation, and Transmission / Reception of Advice Next, the operation when the user confirms the simulation results will be described.

  FIG. 12 is an example of a screen on which the result of try-on simulation is displayed. (A) is a dressing list screen, and (b) is a simulation result screen. FIGS. 13A and 13B are diagrams showing an example of how simulation results consultation and advice are transmitted and received, and a displayed screen. FIG. 13A is a simulation result consultation screen, and FIG. 13B is a consultation content screen. , (C) is an advice input screen.

  When the user operates the operation unit 25 to activate the simulation result confirmation program, the portable terminal UT1 designates a member ID and transmits a transmission request for a matching ID and a matching name to the server SA.

  The server SA that has received the transmission request reads all the matching ID and the matching name indicated by the member ID, and transmits them to the portable terminal UT1.

  Receiving these pieces of information, the portable terminal UT1 displays a matching list screen 41 on the display unit 24 as shown in FIG.

  On the matching list screen 41, the name of the matching is displayed together with, for example, a serial number and a registration date.

  When any name is selected by the user's operation, the mobile terminal UT1 designates a matching ID corresponding to the selected name and transmits a simulation result transmission request to the server SA.

  The server SA that has received the transmission request reads the matching result and product code corresponding to the designated dressing ID from the user DB 12b, and further reads the product information indicated by the read product code from the product DB 12a. Is transmitted to the portable terminal UT1.

  Receiving these pieces of information, the mobile terminal UT1 displays a simulation result screen 42 on the display unit 24 as shown in FIG.

  In the simulation result screen 42, for example, the image of the clothes used for the simulation and the product name are displayed together with the image of the user who tried on the clothes as the simulation result, and a detailed button 43 is displayed for each of the clothes. Further, a consultation button 44 is also displayed.

  When one of the clothes is selected by the user's operation, the mobile terminal UT1 displays, for example, the brand name, the store name, the list price, etc. on the display unit 24 together with the clothes and the product name of the selected terminal. To do.

  In this way, the user can confirm the simulation result after performing the fitting simulation.

  Next, the operation when consulting and giving advice on the try-on simulation result will be described.

  When the user selects the consultation button 44 on the simulation result screen 42 shown in FIG. 12B, the mobile terminal UT1 displays the simulation result consultation screen 51 on the display unit 24 as shown in FIG.

  On the simulation result consultation screen 51, an area 52 for inputting consultation contents, an edit button 53, a store clerk button 54, and a send button 55 are displayed together with an image of a user who has tried on clothes.

  Here, when the user selects the edit button 53, it becomes possible to input the consultation content or the like in the area 52 for inputting the consultation content.

  When the clerk button 54 is selected, the mobile terminal UT1 displays a list of store clerk names of stores that handle clothes used in the fitting simulation, and the user can select a clerk to consult with.

  When the user selects the transmission button 55, the portable terminal UT1 transmits the input consultation content and the selected clerk name to the server SA.

  The server SA that has received the consultation content and the store clerk name registers the information in the user DB 12b in association with the dressing ID, and stores the store ID of the product information indicated by the product code registered in association with the dressing ID. Is read from the user DB 12b, and a consultation notification indicating that the content of the consultation by the user is registered is transmitted to the store terminal ST to which the store ID is assigned.

  The store terminal ST that has received the consultation notification displays the notification on the display unit, and transmits a consultation content transmission request to the server SA by the operation of the store clerk.

  The server SA that has received the consultation content transmission request transmits the member ID, the dressing ID, the simulation result information, the consultation content, the clerk name, the product code, and the like from the user DB 12b to the store terminal ST, and the store that has received these information. For example, the terminal ST displays a consultation content screen 56 as shown in FIG. 13B on the display unit.

  On the consultation content screen 56, an image of the user who tried on clothes, the content of the consultation, the name of the clerk who wants to consult, and an advice button 57 are displayed.

  When the store clerk selects the advice button 57, the store terminal ST displays an advice input screen 58 as shown in FIG. 58, for example.

  On the advice input screen 58, an area 59 for inputting advice, an edit button 60, a recommendation button 61, and a send button 62 are displayed together with an image of a user who has tried on clothes.

  Here, when the store clerk selects the edit button 60, it is possible to input advice or the like in the area 59 for inputting advice.

  When the recommendation button 61 is selected, the store terminal ST displays a screen similar to the recorded product list screen 37 shown in FIG. 7B on the display unit as a list screen of products handled by the store. The recommended product for the user can be selected by the operation of. Note that after selecting a recommended product, a try-on simulation screen 31 shown in FIG. 7A may be displayed to perform a try-on simulation using the recommended product.

  When the store clerk selects the transmission button 62, the store terminal ST transmits the input advice, the product code of the recommended product, the try-on simulation result by the recommended product, and the like to the server SA. Similarly to the case, registration by the server SA, notification to the mobile terminal UT1, display of advice by the mobile terminal UT1, and the like are performed.

  For example, an e-mail system can be used for notification of consultation contents and advice.

  In this way, the user can consult with the store clerk regarding trying on clothes without going to the store. On the other hand, the store clerk can improve customer satisfaction by using consultation from the user, and can recommend products in the store.

  In addition, it is also possible to configure this system so that, for example, an order for clothes used for a try-on simulation is performed in the same manner as the consultation content and advice transmission / reception. For example, when the user selects clothes displayed on the simulation result display screen 42 shown in FIG. 12B, an order message is transmitted to the store terminal ST via the server SA.

  As described above, according to the present embodiment, the positions of the plurality of deformation points for changing the clothing shape of the clothing image to match the body shape of the whole body image, the clothing image, and the whole body image registered by the server SA. The mobile terminal UT1 obtains the deformation point coordinates respectively indicating the image, displays the whole body image, changes the deformation point coordinates and moves the position of the deformation point, thereby deforming the clothes shape of the clothes image, and after the deformation Since the clothes image is displayed on the whole body image, it is possible to perform a try-on simulation using a clothes image that matches the user's body shape, etc. even if a photographic image or the like of the user is used as the whole body image. Therefore, it is possible to obtain a simulation result close to that when the user actually tried on.

  In the above embodiment, the product for which the wear simulation is performed is applied to the clothes. However, the present invention is not limited to this. For example, products such as Japanese clothes, underwear, hats, gloves, socks, and shoes may be applied. Is also possible.

  Moreover, you may comprise not only the simulation of the try-on of the goods currently sold, but the simulation of the wearing of the goods which a user owns, for example.

It is a figure which shows an example of schematic structure of the clothes try-on simulation system S in this embodiment. It is a figure which shows an example of schematic structure of server SA in this embodiment. It is a figure which shows an example of the state in which the deformation | transformation point was set. It is a figure which shows an example of the state in which the contour point was set. It is a figure which shows an example of the correspondence of a deformation | transformation point and an outline point. It is a figure which shows an example of schematic structure of portable terminal UT1 in this embodiment. It is a flowchart which shows an example of the flow of a process of portable terminal UT1 in the case of performing a try-on simulation. It is a flowchart which shows an example of the flow of a process of portable terminal UT1 in the case of performing a try-on simulation. It is an example of a screen displayed in a try-on simulation, (a) is an initial try-on simulation screen, (b) is a recorded product list screen, and (c) is when a clothes image is displayed on the whole body image It is a try-on simulation screen. It is a figure which shows an example of a mode that a deformation | transformation point is moved and a clothes shape is matched with a body shape. It is a figure which shows an example of a mode that a deformation | transformation point moves to the position of a corresponding outline point. It is an example of the screen on which the result of try-on simulation is displayed, (a) is a dressing list screen, (b) is a simulation result screen. It is a figure which shows an example of the state where the consultation and advice of a simulation result are transmitted / received, and the screen displayed, (a) is a simulation result consultation screen, (b) is a consultation content screen, (c) is advice It is an input screen.

Explanation of symbols

11, 21 Control unit 12, 22 Storage unit 12a Product DB
12b User DB
13, 23 Communication unit 14, 27 Bus 24 Display unit 25 Operation unit 26 Product code reading unit S Clothes try-on simulation system SA server UT1 mobile terminal UT2 home terminal ST store terminal RT registration terminal NW network

Claims (12)

A product wear simulation system comprising a terminal device used by a user and a server to which the terminal device can be connected via a network, and performing a product wear simulation by a user,
The server
In order to store body image information representing the appearance of the user's body and product image information representing the appearance of the product, and to deform the product shape of the product image information in conformity with the body shape of the body image information Comprising storage means for storing deformation point position information indicating the positions of a plurality of deformation points arranged on the product image information,
The terminal device
An image acquisition means for acquiring body image information, product image information and deformation point position information stored in the server from the server;
Body image display means for displaying the acquired body image information;
A deformation point moving means for moving the position of the deformation point by changing the acquired deformation point position information;
Product image deformation means for deforming the product shape of the acquired product image information based on the changed deformation point position information;
Deformed product image display means for displaying product image information relating to the deformed product shape on the displayed body image information;
A product wearing simulation system comprising: In the commodity wearing simulation system according to claim 1,
The terminal device
Acquired product image display means for displaying the acquired product image information on the displayed body image information;
Deformation point display means for displaying the deformation point on the displayed product image information based on the acquired deformation point position information;
An operation input means for inputting a user's operation as operation information;
The deformation point moving means of the terminal device changes the deformation point position information of the displayed deformation point based on the input operation information to move the position of the deformation point;
Product wear simulation system characterized by In the commodity wearing simulation system according to claim 1 or 2,
The storage means of the server is arranged in a part representing a body shape of the body image information, and part point position information indicating the positions of a plurality of part points corresponding to the respective deformation points, and the part point position information, Further storing association information with the deformation point position information,
The image information acquisition means of the terminal device further acquires the part point position information and the association information stored by the server from the server,
The deformation point moving means of the terminal device changes the deformation point position information so that the acquired deformation point position information matches the acquired part point position information based on the acquired association information. Moving the position to the position of the part point,
Product wear simulation system characterized by In the commodity wearing simulation system according to any one of claims 1 to 3,
The terminal device
It further comprises product identification information input means for inputting product identification information assigned to the product,
The server
Product identification information acquisition means for acquiring and storing the product identification information input by the terminal device from the terminal device,
The storage means of the server stores the acquired product identification information,
The product image information acquired by the image etc. acquisition means of the terminal device is product image information relating to a product indicated by the stored product identification information;
Product wear simulation system characterized by In the commodity wearing simulation system according to any one of claims 1 to 4,
The server
Further comprising a result acquisition means for acquiring, as simulation result information, a result of displaying the product image information after the deformation on the body image information by the terminal device;
The storage means of the server stores the acquired simulation result information,
The terminal device
Result acquisition means for acquiring simulation result information stored by the server from the server;
A result display means for displaying the acquired simulation result information;
Product wear simulation system characterized by In the commodity wearing simulation system according to claim 5,
It further comprises a store terminal device for connecting to the server via the network and using it in a store,
The terminal device
A message input means for inputting a message by the user as message information;
The server
Further comprising message acquisition means for acquiring message information input by the terminal device;
The storage means of the server stores the acquired message information;
The store terminal device
Comprising a result acquisition display means for acquiring and displaying the simulation result information and message information stored by the server;
Product wear simulation system characterized by   The terminal device included in the commodity wearing simulation system according to any one of claims 1 to 6, wherein the image etc. acquiring means, the body image display means, the deformation point moving means, the commodity image deforming means, A terminal device comprising the modified product image display means.   A computer program for causing a computer to function as the terminal device according to claim 7.   It is a server contained in the goods wear simulation system of any one of Claims 1 thru | or 6, Comprising: The terminal device provided with the said memory | storage means.   A program for a server, which causes a computer to function as the server according to claim 9. A product wear simulation device for simulating product wear by a user,
In order to store body image information representing the appearance of the user's body and product image information representing the appearance of the product, and to deform the product shape of the product image information in conformity with the body shape of the body image information Storage means for storing deformation point position information respectively indicating the positions of a plurality of deformation points arranged on the product image information;
An image acquisition unit for acquiring the stored body image information, product image information, and deformation point position information from the server;
Body image display means for displaying the stored body image information;
Deformation point moving means for moving the position of the deformation point by changing the stored deformation point position information;
Product image deformation means for deforming the product shape of the acquired product image information based on the changed deformation point position information;
Deformed product image display means for displaying product image information relating to the deformed product shape on the displayed body image information;
A product wearing simulation device comprising: A product wear simulation method in a product wear simulation system comprising a terminal device used by a user and a server to which the terminal device is connectable via a network, and performing a product wear simulation by a user,
The server stores body image information representing the appearance of the user's body and product image information representing the appearance of the product, and deforms the product shape of the product image information according to the body shape of the body image information. Storing the deformation point position information indicating the positions of a plurality of deformation points arranged on the product image information in order to
The terminal device acquires body image information, product image information, and deformation point position information stored in the server from the server, displays the acquired body image information, and displays the acquired deformation point position information. Changing the position of the deformation point to move, deforming the product shape of the acquired product image information based on the changed deformation point position information, and transforming the deformation on the displayed body image information Displaying product image information related to the product shape made,
A product wearing simulation method comprising:

Images