WO2022269741A1 - Information processing device, 3d system, and information processing method - Google Patents

Information processing device, 3d system, and information processing method Download PDF

Info

Publication number
WO2022269741A1
WO2022269741A1 PCT/JP2021/023541 JP2021023541W WO2022269741A1 WO 2022269741 A1 WO2022269741 A1 WO 2022269741A1 JP 2021023541 W JP2021023541 W JP 2021023541W WO 2022269741 A1 WO2022269741 A1 WO 2022269741A1
Authority
WO
WIPO (PCT)
Prior art keywords
clothes
clothing
movement
simulation
information
Prior art date
Application number
PCT/JP2021/023541
Other languages
French (fr)
Japanese (ja)
Inventor
英弟 謝
Original Assignee
株式会社Vrc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 株式会社Vrc filed Critical 株式会社Vrc
Priority to JP2021536724A priority Critical patent/JP7023558B1/en
Priority to PCT/JP2021/023541 priority patent/WO2022269741A1/en
Priority to CN202180005716.9A priority patent/CN114556332B/en
Priority to JP2021202815A priority patent/JP2023002440A/en
Publication of WO2022269741A1 publication Critical patent/WO2022269741A1/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/70Information retrieval; Database structures therefor; File system structures therefor of video data
    • G06F16/78Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • G06F16/7867Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using information manually generated, e.g. tags, keywords, comments, title and artist information, manually generated time, location and usage information, user ratings
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00Three dimensional [3D] modelling, e.g. data description of 3D objects
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02PCLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
    • Y02P90/00Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
    • Y02P90/30Computing systems specially adapted for manufacturing

Definitions

  • the present invention relates to a technology for displaying simulation results of putting a 3D model of clothes on a user's 3D model.
  • Patent Literature 1 discloses a virtual try-on system that confirms in real time the effects of wearing when a user makes various movements.
  • the simulation result of the virtual try-on may be displayed on a mobile terminal such as a smartphone.
  • a mobile terminal such as a smartphone.
  • the present invention provides a technique for displaying simulation results of a user's 3D model dressed with a 3D model of clothing using lower computational resources.
  • access means for accessing the stored database; acquisition means for acquiring, from a user terminal, a search key for retrieving clothes from among the plurality of clothes and body type information on a user's body type; and said search key from said database. and a transmission means for transmitting the extracted simulation result to the user terminal.
  • the simulation result may include temporal changes in the shape of the clothing.
  • the simulation result may include a relative positional relationship between a predetermined portion of the clothing and a predetermined portion of the inner body.
  • the predetermined motion includes a plurality of different motions
  • the extracting means corresponds to the motion selected from the database, the clothes specified by the search key, the body type information, and the plurality of motions. Simulation results may be extracted.
  • the obtaining means may obtain identification information designating at least a portion of the plurality of movements, and the extracting means may extract a simulation result corresponding to the movement designated by the identification information. .
  • This information processing apparatus has a selection means for selecting at least a portion of the plurality of movements according to the clothing specified by the search key, and the extraction means selects the movement selected by the selection means.
  • a simulation result corresponding to motion may be extracted.
  • the acquisition means includes movement information describing a new movement to be made to the inner body from the user terminal, and the information processing device corresponds to the body type information wearing the one clothing specified by the search key.
  • simulation means for simulating the movement of the clothing when the new movement described by the movement information is caused to the 3D modeling data of the inner body, and when the simulation is completed, the transmission means transmits the simulation. After the simulation result of the new movement is transmitted, the simulation means transforms the inner body into 3D modeling data corresponding to the body type information, which is dressed in another clothing different from the first clothing. A motion of the garment may be simulated when the new motion described by the motion information is caused.
  • Another aspect of the present disclosure includes a server and a user terminal, wherein for each of a plurality of clothes, the server stores 3D modeling data of the clothes and 3D modeling data of the inner body wearing the clothes.
  • an access means for accessing a database in which results of simulation of the movement of the clothing are recorded when the movement of the clothing is performed; acquisition means for acquiring body shape information related to, extraction means for extracting simulation results corresponding to the clothes and body shape information specified by the search key from the database, and sending the extracted simulation results to the user terminal and a transmission means for transmitting a moving image generated using the 3D modeling data of the clothing and the simulation result, in which the 3D model in which the user wears the clothing performs the predetermined movement.
  • a 3D system is provided having display means for displaying.
  • the display means displays the 3D modeling data of the clothes deformed in accordance with the body type difference between the 3D modeling data of the inner body and the 3D modeling data of the user, and the 3D modeling data of the clothing generated using the simulation result.
  • a moving image may be displayed in which the 3D model wearing clothes is caused to perform the predetermined movement.
  • Another aspect of the present disclosure is a simulation result of the movement of the clothing when the 3D modeling data of the clothing and the 3D modeling data of the inner body wearing the clothing are caused to perform a predetermined movement for each of a plurality of clothing.
  • a step of accessing a database in which is recorded a step of obtaining, from a user terminal, a search key for searching for clothes from among the plurality of clothes and body shape information about the user's body shape; and extracting a simulation result corresponding to the body type information and the clothes specified by, and transmitting the extracted simulation result to the user terminal.
  • FIG. 1 is a diagram exemplifying the functional configuration of an information processing system 1 according to an embodiment
  • FIG. 4 is a diagram illustrating the hardware configuration of the server 10
  • FIG. 4 is a sequence chart showing the operation of the information processing system 1
  • 4 is a diagram exemplifying data recorded in a database 111
  • FIG. 1 is a diagram illustrating the functional configuration of an information processing system 1 according to an embodiment.
  • the information processing system 1 is a system that provides information about clothes, and more specifically, a system that outputs information about the results of a simulation in which a 3D model of a human body (an example of an inner body) is dressed with a 3D model of clothes. Yes (an example of a 3D system).
  • the information processing system 1 is used for the purpose of searching clothes that suit the user's taste from among a plurality of clothes.
  • a 3D model is a three-dimensional virtual object that expresses the shape of an object in virtual space.
  • data representing a 3D model is called 3D modeling data (or 3 modeling data).
  • 3D modeling data of clothes refers to data representing a 3D model of clothes.
  • the user's 3D modeling data refers to data representing a 3D model of the user's human body.
  • the information processing system 1 provides a clothing search service.
  • the information processing system 1 has a server 10 and a user terminal 20 as hardware.
  • the server 10 is a computer device (an example of an information processing device) that functions as a server in the clothing search service.
  • the user terminal 20 is a computer device that functions as a client in the clothing search service.
  • the information processing system 1 includes storage means 11, access means 12, acquisition means 13, extraction means 14, transmission means 15, simulation means 18, control means 19, storage means 21, UI means 22, correction means 23, display means 24, and control means 29 .
  • the storage means 11, the access means 12, the acquisition means 13, the extraction means 14, the transmission means 15, the simulation means 18, and the control means 19 are connected to the server 10, the storage means 21, the UI means 22, the correction means 23, the display
  • the means 24 and the control means 29 are implemented in the user terminal 20, respectively.
  • the storage means 11 stores various data.
  • Data stored in the storage unit 11 includes, for example, a database 111 and a database 112 .
  • the database 111 for each of a plurality of clothes, the 3D modeling data of the clothes and the simulation result of the movement of the clothes when the 3D modeling data of the inner body wearing the clothes are made to move in a predetermined manner are recorded.
  • the database 112 is a database in which user attribute information is recorded.
  • User attribute information includes, for example, the user's name, age, sex, and body type information.
  • the body type information is information indicating the user's body type, and in one example, one standard body type that is closest to the user's body type (that is, has the smallest system difference from the user) among a plurality of predetermined standard body types.
  • identification information may include a set of sizes for a plurality of specific parts of the body (eg, height, chest circumference, upper arm circumference, waist circumference, thigh circumference, and leg length).
  • the access means 12 accesses the database 111.
  • Acquisition means 13 acquires a search key for retrieving clothes from a plurality of clothes and body shape information about the user's body shape from user terminal 20 .
  • the extraction means 14 extracts simulation results corresponding to clothing and body type information specified by the search key from the database.
  • the transmission means 15 transmits the extracted simulation result to the user terminal 20 .
  • the simulation means 18 simulates the movement of the clothes when the 3D model of the inner body is covered with the 3D model of the clothes.
  • the simulation means 18 writes the simulation results into the database 111 .
  • the control means 19 performs various controls.
  • the storage means 21 stores various data.
  • UI means 22 provides a user interface.
  • the modifying means 23 modifies the simulation result data received from the server 10 based on the difference between the body type of the user and the standard body type.
  • the display means 24 displays the corrected simulation results.
  • the control means 29 performs various controls.
  • FIG. 2 is a diagram illustrating the hardware configuration of the server 10.
  • the server 10 is a computer device having a CPU 101 , memory 102 , storage 103 and communication IF 104 .
  • the CPU 101 is a processing device that performs various calculations according to programs.
  • the memory 102 is a main storage device that functions as a work area when the CPU 101 executes programs, and includes, for example, a RAM.
  • the storage 103 is an auxiliary storage device that stores various data, and includes, for example, SSD or HDD.
  • the communication IF 104 is a device that communicates with other devices according to a predetermined standard (eg, Ethernet), and includes, for example, a NIC.
  • a predetermined standard eg, Ethernet
  • the programs stored in the storage 103 include a program (hereinafter referred to as "server program") for causing the computer device to function as the server 10 in the information processing system 1.
  • server program a program for causing the computer device to function as the server 10 in the information processing system 1.
  • At least one of the memory 102 and the storage 103 is an example of the storage unit 11 while the CPU 101 is executing the server program.
  • the CPU 101 is an example of the access means 12 , acquisition means 13 , extraction means 14 and control means 19 .
  • Communication IF 104 is an example of transmission means 15 .
  • the user terminal 20 is a general-purpose computer device such as a smart phone or a personal computer.
  • a program (hereinafter referred to as a “client program”) is installed in the user terminal 20 to allow the computer device to function as the user terminal 20 in the information processing system 1 .
  • the client program is an application program dedicated to the information processing system 1 or a general-purpose web browser.
  • FIG. 3 is a sequence chart showing the operation of the information processing system 1 .
  • the information processing system 1 is, for example, a system that provides e-commerce for clothes. A user performs a virtual try-on by putting a 3D model of clothes on his/her own 3D model (so-called avatar) and selects clothes to purchase.
  • step S101 the user terminal 20 transmits a simulation result transmission request to the server 10. Details are as follows. First, the user inputs information (for example, brand, product number, size, etc.) specifying one piece of clothing to be simulated (hereinafter referred to as “target clothing”) in the user terminal 20 . According to this input, the user terminal 20 identifies the target clothing. Alternatively, the user terminal 20 transmits the information input here to the server 10 . The server 10 identifies the target clothing from these pieces of information and transmits the identification information of the target clothing to the user terminal 20 . The user terminal 20 generates a transmission request for simulation results. This transmission request includes the identification information of the target clothing and the user identification information.
  • information for example, brand, product number, size, etc.
  • the server 10 Upon receiving the simulation result transmission request, the server 10 identifies the target clothing according to this transmission request (step S102).
  • the target clothing population is the clothing recorded in the database 111 .
  • FIG. 4 is a diagram illustrating data recorded in the database 111.
  • FIG. Database 111 includes a plurality of records. Each record includes a clothing ID, attribute information, image location information, and 3D model location information for one piece of clothing.
  • the clothing ID is identification information that identifies the clothing.
  • Attribute information is information indicating attributes of the clothing. Clothing attributes include, for example, at least one of brand, designer, type (for example, jacket, shirt, pants, skirt, etc.), model number, price range, size, material, color, pattern, and description. In this example, when there are multiple sizes and colors of the same design, a common clothing ID is given to them.
  • the image location information is information, such as a URL, specifying a resource in which image data of clothes is stored.
  • the 3D model location information is information, such as a URL, specifying a resource in which the 3D modeling data of the clothing is stored.
  • the image location information includes a different URL for each size. The same applies to colors and patterns. The same is true for 3D models.
  • the database 111 further includes data indicating simulation results of the movement of the clothing when the 3D model of the inner body wearing the clothing is caused to perform a predetermined movement, or information indicating the location of the data.
  • the simulation result data includes one or more data sets. Each data set includes identification information of the 3D modeling data of the inner body, identification information of the movement, and simulation results of the movement of the clothing when the 3D modeling data of the inner body is made to move while wearing the clothing. Contains data or location information for that data.
  • a simulation result showing the movement of the clothes when the clothes are put on the 3D models of the inner bodies of different body types and made to move in a predetermined manner is recorded. .
  • 3D models SB[1] to SB[20] are registered in the database 111 .
  • 3D models SB[1] to SB[20] are collectively referred to as 3D models SB.
  • the 3D model SB is a 3D model of a standard inner body. Of these 20 types of inner bodies, only the 10 types of inner bodies SB[1] to SB[10] can be dressed with the clothes with the clothes ID "12345" due to size restrictions.
  • the 10 standard body types SB[1] to SB[10] cannot wear the clothes with the clothes ID "12345” because the chest circumference of the inner body is larger than the chest circumference of the clothes.
  • 10 types of simulation results are obtained by making the inner bodies perform predetermined movements while wearing the clothes with the clothing ID "12345" on each of the 3D models SB[1] to SB[10] of the inner bodies. is recorded.
  • this simulation is triggered by a predetermined event.
  • An event that triggers the simulation is, for example, an event that new clothes are registered in the database 111 .
  • this event is an event that a predetermined number of clothes for which simulation has not yet been performed has accumulated.
  • this event is an event that the operating rate of the computational resource of the server 10 satisfies a predetermined condition (for example, the operating rate has become equal to or less than a threshold value). That is, in these examples, the simulation is performed independently of (or without) transmission requests from the user terminal 20 .
  • FIG. 5 is a diagram illustrating simulation results.
  • the simulation results include data indicating the movement of the clothes when the 3D model of the inner body is covered with clothes and the inner body is caused to move in a predetermined manner.
  • the 3D modeling data of clothes includes polygon meshes and information for moving the 3D model, such as bone information.
  • a bone is information that acts as a joint when moving a 3D model.
  • Bone information is information indicating the position (relative position or absolute position) and orientation of a bone.
  • the data indicating the movement of clothes is, for example, bone information and data indicating temporal changes of polygon meshes (or skin meshes).
  • the predetermined motion is, for example, a motion that causes the inner body to walk.
  • the simulation results include temporal changes in the bone information and polygon meshes of the target clothing when the inner body is walked while wearing the clothing. In other words, it can be said that this simulation result includes temporal changes in the shape of the target clothing.
  • step S103 the server 10 acquires the user's body type information.
  • the server 10 obtains body type information corresponding to the user identification information included in the request from the database 112 .
  • step S104 the server 10 extracts, from the database 111, a simulation result of the movement of the target clothing when the 3D model of the inner body corresponding to the user's body type information is made to perform a predetermined movement while the target clothing is being put on.
  • body type information is identification information of a standard body type that is closest to the user's body type. For example, when the body type information indicates SB[3], the server 10 retrieves from the database 111 the data of the simulation results in which the 3D model SB[3] of the inner body is made to move in a predetermined manner while wearing the target clothes. to extract
  • step S105 the server 10 transmits the extracted simulation result data to the user terminal 20, which is the source of the request.
  • the user terminal 20 corrects the data received from the server 10. Specifically, for example, it is as follows.
  • the user terminal 20 acquires body shape data and standard body shape data of the user.
  • the body shape data of the user is data indicating the body shape of the user.
  • the body shape data may be the user's 3D modeling data itself, or may be a set of sizes of a plurality of body parts extracted from the user's 3D model.
  • the standard figure data is data indicating the figure of the inner body used in the simulation. It may be a set of sizes for body parts.
  • the user terminal 20 calculates the difference between the body type data of the user and the standard body type data. In one example, the differences are a set of size differences at specific locations on the human body.
  • the user terminal 20 deforms the 3D modeling data (eg, polygon mesh) of the target garment using the calculated difference and a well-known computation method (eg, deformer). That is, in the 3D model of the target clothing, the simulation result using the inner body of the standard figure is deformed according to the user's figure.
  • 3D modeling data eg, polygon mesh
  • deformer e.g., a well-known computation method
  • step S107 the user terminal 20 generates a 3D model in which the user's 3D model is dressed with the 3D model of the target clothing (that is, synthesized).
  • step S108 the user terminal 20 displays a moving image that causes the user's 3D model to move in a predetermined manner. That is, even if the user terminal 20 does not perform a simulation in which the 3D model of the user is put on the 3D model of the target clothes and causes the 3D model of the user to move in a predetermined manner, the 3D model of the target clothes can be applied to the 3D model of the user. It is possible to display or play a moving image in which a model is dressed and made to perform predetermined movements.
  • a user terminal performs a simulation of making a user's 3D model wear a 3D model of target clothes and causing the user's 3D model to make a predetermined movement. Compared to doing it yourself, the simulation results can be displayed faster with fewer computational resources.
  • Simulation The specific contents of the simulation performed in a state in which the 3D model of the target clothing is put on the 3D model of the inner body of the standard figure is not limited to the example illustrated in the embodiment. In other words, this simulation is not limited to making the 3D model of the inner body of the standard figure move in a predetermined manner while wearing the 3D model of the target clothing.
  • the 3D model of the inner body may remain stationary in a given pose. Even if the 3D model of the inner body remains stationary, the clothing does not have a fixed shape regardless of the inner body. It can droop and wrinkle. Even if the inner body is stationary, the simulation allows visual confirmation of how wrinkles are formed or how the ends hang down, which is significant. In this way, the shape of the 3D model of clothing changes when it is changed from the standard state (the state in which the inner body is not worn) to the state in which the inner body is in a stationary state. It is an example of "movement".
  • the simulation shows the relative positional relationship between a predetermined part of the clothing and a predetermined part of the user's body in a state in which the 3D model of the user is put on the target clothes and taken in a predetermined pose.
  • the predetermined pose is a pose of sitting on a chair
  • the predetermined part of the clothing is the hem of pants
  • the predetermined part of the user's body is the ankle.
  • the simulation result is, for example, a magnified view of the appearance of this part in the 3D model (ie, a magnified view near the user's ankle).
  • the simulation result may be numerical data indicating the relative positional relationship (that is, the distance between the user's ankle and the hem of the pants of the target clothing).
  • multiple inner body motions may be defined. For example, walking motion, running motion, jumping motion, arm turning motion, and sitting motion are defined in database 111 .
  • the server 10 simulates each of these multiple movements.
  • the server 10 records simulation results for these multiple motions in the database 111 .
  • the server 10 transmits these motion simulation results to the user terminal 20 .
  • the transmission request may include identification information that designates some of the plurality of movements, and the server 10 may transmit the simulation result of the movement designated by this identification information to the user terminal 20 .
  • This identification information may directly or indirectly specify the movement.
  • the identification information that indirectly specifies movement is, for example, user identification information.
  • database 112 records the identification information of each user's preferred movement.
  • the server 10 refers to the database 112 to identify the movement preferred by the user indicated by the user identification information included in the transmission request.
  • the server 10 transmits the motion simulation result identified in this way to the user terminal 20 .
  • a plurality of poses are defined in the database 111 in the same way when the simulation is performed in a pose where the inner body remains stationary.
  • the movement of the inner body may be defined for each piece of clothing. That is, for each piece of clothing, the motions used in the simulation may be defined. For example, running motion and jumping motion are defined as motions used for simulation for sportswear, and walking motion and sitting motion are defined for suit. These movements may be uniquely defined for each piece of clothing, or may be selected from a plurality of previously prepared movements suitable for the particular piece of clothing. These are the same for poses.
  • the server 10 may automatically select some motions from a plurality of motions and transmit simulation results using the selected motions to the user terminal 20 .
  • FIG. 6 is a diagram illustrating the functional configuration of the server 10 according to this modification.
  • the server 10 has selection means 16 .
  • a selection means 16 automatically selects a part of motions from a plurality of motions.
  • the selection unit 16 operates based on the viewing history of the simulation results of not only the user of the user terminal 20 who has transmitted the transmission request to be processed now, but also a plurality of other users of the information processing system 1. to select.
  • the server 10 records the user's browsing history of the simulation results.
  • the server 10 uses this browsing history to estimate the preferred motion for the target clothing. If the browsing history is analyzed, for example, simulation results of running and jumping motions are frequently viewed for sportswear, and simulation results of walking motions and sitting motions are viewed for suits.
  • Machine learning may be used for these analyses. For example, machine learning is performed by giving clothing attribute and movement identification information to the input layer of the machine learning model and data on the frequency of viewing the clothing and movement simulation results to the output layer as teacher data.
  • the server 10 uses the machine learning model learned in this way to predict the movement that the user is likely to like (expected to be viewed frequently) in the target clothing.
  • the selection means 16 selects a motion based on the attributes of the user of the user terminal 20 that has transmitted the transmission request to be processed.
  • Machine learning may be used for these analyses. For example, machine learning is performed by giving user attribute and movement identification information to the input layer of the machine learning model, and data on the frequency with which the user browses the movement simulation result to the output layer as teacher data.
  • the server 10 uses the machine learning model learned in this way to predict the movement that the user is likely to like (expected to be viewed frequently) in the target clothing. The above points also apply to the pose of the inner body.
  • the server 10 may perform the simulation when a new motion is defined.
  • the acquiring means 13 acquires motion information describing new motions to be made to the inner body.
  • the acquisition means 13 acquires motion information from the user terminal 20 .
  • the user terminal 20 has a function of editing or creating movements for making a 3D model of a human body, and generates new movement information in accordance with user instructions.
  • the user terminal 20 transmits a transmission request including this new motion information to the server 10 .
  • the simulating means 18 requests the simulating means 18 to perform a simulation of making the 3D model of the inner body of the standard figure wearing the target clothes perform the new motion.
  • the simulation means 18 performs simulation according to this request.
  • the transmitting means 15 transmits the simulation result to the user terminal 20.
  • the simulation means 18 simulates the new movement for another garment.
  • the clothing to be simulated next to the target clothing is specified by the user of the user terminal 20, for example.
  • the server 10 may predict clothes that the user is likely to request simulation results next (ie, the user is likely to select next), and perform new motion simulations on the predicted clothes.
  • the hardware configuration of the information processing system 1 is not limited to those illustrated in the embodiments.
  • the information processing system 1 may have any hardware configuration as long as it can implement the required functions.
  • a plurality of physical devices may work together to function as the server 10 .
  • the server 10 may be a physical server or a virtual server (including so-called cloud).
  • the correspondence relationship between functional elements and hardware is not limited to the one illustrated in the embodiment.
  • at least part of the functions described as being implemented in the server 10 in the embodiments may be implemented in the user terminal 20 .
  • at least one of database 111 and database 112 may be implemented in a server device different from server 10 .
  • the database 111 and the database 112 may be integrated, or part of them may be further subdivided.
  • some of the functional elements illustrated in FIG. 2 may be omitted.
  • the program executed by the CPU 110 or the like may be provided by downloading via a network such as the Internet, or may be provided in a state recorded on a computer-readable non-temporary recording medium such as a DVD-ROM. may be

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Data Mining & Analysis (AREA)
  • Multimedia (AREA)
  • Library & Information Science (AREA)
  • Computer Graphics (AREA)
  • Geometry (AREA)
  • Software Systems (AREA)
  • Processing Or Creating Images (AREA)

Abstract

This information processing device includes: an access means for accessing a database in which are recorded, for each of a plurality of clothing items, 3D modeling data for the clothing item and simulation results of movement of the clothing item when 3D modeling data of an inner body wearing the clothing item is caused to make a prescribed movement; an acquisition means for acquiring, from a user terminal, a retrieval key for retrieving a clothing item from among the plurality of clothing items, and physique information relating to the physique of the user; an extraction means for extracting, from the database, a simulation result corresponding to the physique information and the clothing item specified by the retrieval key; and a transmission means for transmitting the extracted simulation result to the user terminal.

Description

情報処理装置、3Dシステム、及び情報処理方法Information processing device, 3D system, and information processing method
 本発明は、ユーザの3Dモデルに衣服の3Dモデルを着せるシミュレーション結果を表示する技術に関する。 The present invention relates to a technology for displaying simulation results of putting a 3D model of clothes on a user's 3D model.
 仮想空間で試着を行う仮想試着又はバーチャルフィッティングにおいて、人体の3Dモデルの動きに応じて、その人体が着ている衣服の3Dモデルの動き及びシワをシミュレーションすることで、よりリアルで自然な試着体験を提供することが可能となる。例えば特許文献1は、ユーザが様々な動きをしたときの着用効果をリアルタイムで確認する仮想試着システムを開示している。 A more realistic and natural fitting experience by simulating the movement and wrinkles of the 3D model of the clothes worn by the human body according to the movement of the 3D model of the human body in the virtual fitting or virtual fitting where the fitting is performed in a virtual space. can be provided. For example, Patent Literature 1 discloses a virtual try-on system that confirms in real time the effects of wearing when a user makes various movements.
中国特許出願公開第107578323号明細書Chinese Patent Application Publication No. 107578323
 仮想試着のシミュレーション結果はスマートフォンなどの携帯端末で表示されることがあるが、一般に携帯端末は演算処理能力が低く、特許文献1に記載の技術において仮想試着のためのシミュレーションを携帯端末で行うには演算に多大なリソースを要するという課題があった。 The simulation result of the virtual try-on may be displayed on a mobile terminal such as a smartphone. has the problem of requiring a large amount of computational resources.
 これに対し本発明は、ユーザの3Dモデルに衣服の3Dモデルを着せたシミュレーション結果を、より低い演算リソースを用いて表示する技術を提供する。 On the other hand, the present invention provides a technique for displaying simulation results of a user's 3D model dressed with a 3D model of clothing using lower computational resources.
 本開示の一態様は、複数の衣服の各々について、当該衣服の3Dモデリングデータ、当該衣服を着せたインナーボディの3Dモデリングデータに所定の動きをさせたときの当該衣服の動きのシミュレーション結果が記録されたデータベースにアクセスするアクセス手段と、ユーザ端末から、前記複数の衣服の中から衣服を検索するための検索キー及びユーザの体型に関する体型情報を取得する取得手段と、前記データベースから、前記検索キーにより特定される衣服及び前記体型情報に対応するシミュレーション結果を抽出する抽出手段と、前記抽出されたシミュレーション結果を、前記ユーザ端末に送信する送信手段とを有する情報処理装置を提供する。 According to one aspect of the present disclosure, for each of a plurality of clothes, 3D modeling data of the clothes and 3D modeling data of the inner body wearing the clothes are recorded in a simulation result of the movement of the clothes when the 3D modeling data of the inner body is made to move in a predetermined manner. access means for accessing the stored database; acquisition means for acquiring, from a user terminal, a search key for retrieving clothes from among the plurality of clothes and body type information on a user's body type; and said search key from said database. and a transmission means for transmitting the extracted simulation result to the user terminal.
 前記データベースにおいて、前記複数の衣服の各々について、当該衣服の3Dモデリングデータ、異なる体型を有する複数のインナーボディの3Dモデリングデータに当該衣服を着せて前記所定の動きをさせたときの当該衣服の動きのシミュレーション結果が記録され、前記抽出手段は、前記データベースから、前記複数のインナーボディのうち前記体型情報により示される体型との差が最も小さい体型を有するインナーボディの3Dモデリングデータに当該衣服を着せて前記所定の動きをさせたときの当該衣服の動きのシミュレーション結果を抽出してもよい。 In the database, for each of the plurality of clothing, 3D modeling data of the clothing, 3D modeling data of a plurality of inner bodies having different body types, and movement of the clothing when the clothing is put on and made to perform the predetermined movement. is recorded, and the extraction means puts the clothes on the 3D modeling data of the inner body having the smallest difference from the body shape indicated by the body shape information, among the plurality of inner bodies, from the database. It is also possible to extract a simulation result of the movement of the clothing when the clothing is moved in the predetermined manner.
 前記シミュレーション結果が、前記衣服の形状の時間変化を含んでもよい。 The simulation result may include temporal changes in the shape of the clothing.
 前記シミュレーション結果が、前記衣服の所定の部位と前記インナーボディの所定の部位との相対的位置関係を含んでもよい。 The simulation result may include a relative positional relationship between a predetermined portion of the clothing and a predetermined portion of the inner body.
 前記所定の動きが、異なる複数の動きを含み、前記抽出手段は、前記データベースから、前記検索キーにより特定される衣服、前記体型情報、及び前記複数の動きの中から選択された動きに対応するシミュレーション結果を抽出してもよい。 The predetermined motion includes a plurality of different motions, and the extracting means corresponds to the motion selected from the database, the clothes specified by the search key, the body type information, and the plurality of motions. Simulation results may be extracted.
 前記取得手段が、前記複数の動きの中から少なくとも一部の動きを指定する識別情報を取得し、前記抽出手段は、前記識別情報により指定される動きに対応するシミュレーション結果を抽出してもよい。 The obtaining means may obtain identification information designating at least a portion of the plurality of movements, and the extracting means may extract a simulation result corresponding to the movement designated by the identification information. .
 この情報処理装置は、前記検索キーにより特定される衣服に応じて前記複数の動きの中から少なくとも一部の動きを選択する選択手段を有し、前記抽出手段は、前記選択手段により選択された動きに対応するシミュレーション結果を抽出してもよい。 This information processing apparatus has a selection means for selecting at least a portion of the plurality of movements according to the clothing specified by the search key, and the extraction means selects the movement selected by the selection means. A simulation result corresponding to motion may be extracted.
 前記取得手段が、前記ユーザ端末から前記インナーボディにさせる新たな動きを記述した動き情報を含み、この情報処理装置は、前記検索キーにより特定される一の衣服を着せた、前記体型情報に対応するインナーボディの3Dモデリングデータに前記動き情報により記述される前記新たな動きをさせたときの当該衣服の動きをシミュレーションするシミュレーション手段を有し、前記シミュレーションが完了すると、前記送信手段が当該シミュレーションの結果を送信し、前記シミュレーション手段は、前記新たな動きのシミュレーション結果が送信された後で、前記一の衣服と異なる別の衣服を着せた、前記体型情報に対応するインナーボディの3Dモデリングデータに前記動き情報により記述される前記新たな動きをさせたときの当該衣服の動きをシミュレーションしてもよい。 The acquisition means includes movement information describing a new movement to be made to the inner body from the user terminal, and the information processing device corresponds to the body type information wearing the one clothing specified by the search key. simulation means for simulating the movement of the clothing when the new movement described by the movement information is caused to the 3D modeling data of the inner body, and when the simulation is completed, the transmission means transmits the simulation. After the simulation result of the new movement is transmitted, the simulation means transforms the inner body into 3D modeling data corresponding to the body type information, which is dressed in another clothing different from the first clothing. A motion of the garment may be simulated when the new motion described by the motion information is caused.
 本開示の別の一態様は、サーバと、ユーザ端末とを有し、前記サーバは、複数の衣服の各々について、当該衣服の3Dモデリングデータ、当該衣服を着せたインナーボディの3Dモデリングデータに所定の動きをさせたときの当該衣服の動きのシミュレーション結果が記録されたデータベースにアクセスするアクセス手段と、前記ユーザ端末から、前記複数の衣服の中から衣服を検索するための検索キー及びユーザの体型に関する体型情報を取得する取得手段と、前記データベースから、前記検索キーにより特定される衣服及び前記体型情報に対応するシミュレーション結果を抽出する抽出手段と、前記抽出されたシミュレーション結果を、前記ユーザ端末に送信する送信手段とを有し、前記ユーザ端末は、前記衣服の3Dモデリングデータ及び前記シミュレーション結果を用いて生成された、当該ユーザに当該衣服を着せた3Dモデルに前記所定の動きをさせる動画を表示する表示手段を有する3Dシステムを提供する。 Another aspect of the present disclosure includes a server and a user terminal, wherein for each of a plurality of clothes, the server stores 3D modeling data of the clothes and 3D modeling data of the inner body wearing the clothes. an access means for accessing a database in which results of simulation of the movement of the clothing are recorded when the movement of the clothing is performed; acquisition means for acquiring body shape information related to, extraction means for extracting simulation results corresponding to the clothes and body shape information specified by the search key from the database, and sending the extracted simulation results to the user terminal and a transmission means for transmitting a moving image generated using the 3D modeling data of the clothing and the simulation result, in which the 3D model in which the user wears the clothing performs the predetermined movement. A 3D system is provided having display means for displaying.
 前記表示手段は、前記インナーボディの3Dモデリングデータと前記ユーザの3Dモデリングデータとの体型差に応じて変形された前記衣服の3Dモデリングデータ及び前記シミュレーション結果を用いて生成された、当該ユーザに当該衣服を着せた3Dモデルに前記所定の動きをさせる動画を表示してもよい。 The display means displays the 3D modeling data of the clothes deformed in accordance with the body type difference between the 3D modeling data of the inner body and the 3D modeling data of the user, and the 3D modeling data of the clothing generated using the simulation result. A moving image may be displayed in which the 3D model wearing clothes is caused to perform the predetermined movement.
 本開示の別の一態様は、複数の衣服の各々について、当該衣服の3Dモデリングデータ、当該衣服を着せたインナーボディの3Dモデリングデータに所定の動きをさせたときの当該衣服の動きのシミュレーション結果が記録されたデータベースにアクセスするステップと、ユーザ端末から、前記複数の衣服の中から衣服を検索するための検索キー及びユーザの体型に関する体型情報を取得するステップと、前記データベースから、前記検索キーにより特定される衣服及び前記体型情報に対応するシミュレーション結果を抽出するステップと、前記抽出されたシミュレーション結果を、前記ユーザ端末に送信するステップとを有する情報処理方法を提供する。 Another aspect of the present disclosure is a simulation result of the movement of the clothing when the 3D modeling data of the clothing and the 3D modeling data of the inner body wearing the clothing are caused to perform a predetermined movement for each of a plurality of clothing. a step of accessing a database in which is recorded; a step of obtaining, from a user terminal, a search key for searching for clothes from among the plurality of clothes and body shape information about the user's body shape; and extracting a simulation result corresponding to the body type information and the clothes specified by, and transmitting the extracted simulation result to the user terminal.
 本発明によれば、ユーザの3Dモデルに衣服の3Dモデルを着せたシミュレーション結果を、より低い演算リソースを用いて表示することができる。 According to the present invention, it is possible to display the results of a simulation in which a 3D model of a user is dressed with a 3D model of clothing, using lower computational resources.
一実施形態に係る情報処理システム1の機能構成を例示する図。1 is a diagram exemplifying the functional configuration of an information processing system 1 according to an embodiment; FIG. サーバ10のハードウェア構成を例示する図。4 is a diagram illustrating the hardware configuration of the server 10; FIG. 情報処理システム1の動作を示すシーケンスチャート。4 is a sequence chart showing the operation of the information processing system 1; データベース111に記録されるデータを例示する図。4 is a diagram exemplifying data recorded in a database 111; FIG. シミュレーション結果を例示する図。The figure which illustrates a simulation result. 変形例に係るサーバ10の機能構成を例示する図。The figure which illustrates the functional structure of the server 10 which concerns on a modification.
1…情報処理システム、10…サーバ、11…記憶手段、12…アクセス手段、13…取得手段、14…抽出手段、15…送信手段、18…シミュレーション手段、19…制御手段、20…ユーザ端末、21…記憶手段、22…UI手段、23…修正手段、24…表示手段、29…制御手段、101…CPU、102…メモリ、103…ストレージ、104…通信IF Reference Signs List 1 information processing system 10 server 11 storage means 12 access means 13 acquisition means 14 extraction means 15 transmission means 18 simulation means 19 control means 20 user terminal 21... Storage means, 22... UI means, 23... Correction means, 24... Display means, 29... Control means, 101... CPU, 102... Memory, 103... Storage, 104... Communication IF
1.構成
 図1は、一実施形態に係る情報処理システム1の機能構成を例示する図である。情報処理システム1は衣服に関する情報を提供するシステムであり、より詳細には、人体(インナーボディの一例)の3Dモデルに衣服の3Dモデルを着せたシミュレーションを行った結果に関する情報を出力するシステムである(3Dシステムの一例)。一例において、情報処理システム1は、ユーザが複数の衣服の中から自分の嗜好に合う衣服を検索する目的で用いられる。3Dモデルとは、仮想空間における対象物の形状を表現する立体的な仮想オブジェクトをいう。ここで、3Dモデルを表すデータを3Dモデリングデータ(又は3モデリングデータ)という。衣服の3Dモデリングデータとは、衣服の3Dモデルを表すデータをいう。ユーザの3Dモデリングデータとは、ユーザの人体の3Dモデルを表すデータをいう。
1. Configuration FIG. 1 is a diagram illustrating the functional configuration of an information processing system 1 according to an embodiment. The information processing system 1 is a system that provides information about clothes, and more specifically, a system that outputs information about the results of a simulation in which a 3D model of a human body (an example of an inner body) is dressed with a 3D model of clothes. Yes (an example of a 3D system). In one example, the information processing system 1 is used for the purpose of searching clothes that suit the user's taste from among a plurality of clothes. A 3D model is a three-dimensional virtual object that expresses the shape of an object in virtual space. Here, data representing a 3D model is called 3D modeling data (or 3 modeling data). 3D modeling data of clothes refers to data representing a 3D model of clothes. The user's 3D modeling data refers to data representing a 3D model of the user's human body.
 情報処理システム1は、衣服検索サービスを提供する。情報処理システム1は、ハードウェアとしてはサーバ10及びユーザ端末20を有する。サーバ10は、衣服検索サービスにおけるサーバとして機能するコンピュータ装置(情報処理装置の一例)である。ユーザ端末20は、衣服検索サービスにおけるクライアントとして機能するコンピュータ装置である。 The information processing system 1 provides a clothing search service. The information processing system 1 has a server 10 and a user terminal 20 as hardware. The server 10 is a computer device (an example of an information processing device) that functions as a server in the clothing search service. The user terminal 20 is a computer device that functions as a client in the clothing search service.
 情報処理システム1は、記憶手段11、アクセス手段12、取得手段13、抽出手段14、送信手段15、シミュレーション手段18、制御手段19、記憶手段21、UI手段22、修正手段23、表示手段24、及び制御手段29を有する。この例において、記憶手段11、アクセス手段12、取得手段13、抽出手段14、送信手段15、シミュレーション手段18、及び制御手段19はサーバ10に、記憶手段21、UI手段22、修正手段23、表示手段24、及び制御手段29はユーザ端末20に、それぞれ実装される。 The information processing system 1 includes storage means 11, access means 12, acquisition means 13, extraction means 14, transmission means 15, simulation means 18, control means 19, storage means 21, UI means 22, correction means 23, display means 24, and control means 29 . In this example, the storage means 11, the access means 12, the acquisition means 13, the extraction means 14, the transmission means 15, the simulation means 18, and the control means 19 are connected to the server 10, the storage means 21, the UI means 22, the correction means 23, the display The means 24 and the control means 29 are implemented in the user terminal 20, respectively.
 記憶手段11は、各種のデータを記憶する。記憶手段11が記憶するデータには、例えば、データベース111及びデータベース112が含まれる。データベース111は、複数の衣服の各々について、その衣服の3Dモデリングデータ、及びその衣服を着せたインナーボディの3Dモデリングデータに所定の動きをさせたときのその衣服の動きのシミュレーション結果が記録されたデータベースである。データベース112は、ユーザの属性情報が記録されたデータベースである。ユーザの属性情報は、例えば、ユーザの名前、年齢、性別、体型情報を含む。体型情報は、ユーザの体型を示す情報であり、一例においては、あらかじめ決められた複数の標準体型のうち、ユーザの体型に最も近い(すなわち、ユーザとの体系差が最も小さい)一の標準体型の識別情報である。あるいは、体型情報は、身体の複数の特定部位のサイズ(例えば、身長、胸囲、上腕の周囲、胴囲、太ももの周囲、及び脚の長さ)のセットを含んでもよい。 The storage means 11 stores various data. Data stored in the storage unit 11 includes, for example, a database 111 and a database 112 . In the database 111, for each of a plurality of clothes, the 3D modeling data of the clothes and the simulation result of the movement of the clothes when the 3D modeling data of the inner body wearing the clothes are made to move in a predetermined manner are recorded. database. The database 112 is a database in which user attribute information is recorded. User attribute information includes, for example, the user's name, age, sex, and body type information. The body type information is information indicating the user's body type, and in one example, one standard body type that is closest to the user's body type (that is, has the smallest system difference from the user) among a plurality of predetermined standard body types. identification information. Alternatively, body type information may include a set of sizes for a plurality of specific parts of the body (eg, height, chest circumference, upper arm circumference, waist circumference, thigh circumference, and leg length).
 アクセス手段12は、データベース111にアクセスする。取得手段13は、ユーザ端末20から、複数の衣服の中から衣服を検索するための検索キー及びユーザの体型に関する体型情報を取得する。抽出手段14は、データベースから、検索キーにより特定される衣服及び体型情報に対応するシミュレーション結果を抽出する。送信手段15は、抽出されたシミュレーション結果をユーザ端末20に送信する。シミュレーション手段18は、インナーボディの3Dモデルに衣服の3Dモデルを着せた状態におけるその衣服の動きをシミュレーションする。シミュレーション手段18は、シミュレーション結果をデータベース111に書き込む。制御手段19は各種の制御を行う。 The access means 12 accesses the database 111. Acquisition means 13 acquires a search key for retrieving clothes from a plurality of clothes and body shape information about the user's body shape from user terminal 20 . The extraction means 14 extracts simulation results corresponding to clothing and body type information specified by the search key from the database. The transmission means 15 transmits the extracted simulation result to the user terminal 20 . The simulation means 18 simulates the movement of the clothes when the 3D model of the inner body is covered with the 3D model of the clothes. The simulation means 18 writes the simulation results into the database 111 . The control means 19 performs various controls.
 記憶手段21は各種のデータを記憶する。UI手段22は、ユーザインターフェースを提供する。修正手段23は、サーバ10から受信したシミュレーション結果のデータを、そのユーザの体型と標準体型との差に基づいて修正する。表示手段24は、修正されたシミュレーション結果を表示する。制御手段29は各種の制御を行う。 The storage means 21 stores various data. UI means 22 provides a user interface. The modifying means 23 modifies the simulation result data received from the server 10 based on the difference between the body type of the user and the standard body type. The display means 24 displays the corrected simulation results. The control means 29 performs various controls.
 図2は、サーバ10のハードウェア構成を例示する図である。サーバ10は、CPU101、メモリ102、ストレージ103、通信IF104を有するコンピュータ装置である。CPU101は、プログラムに従って各種の演算を行う処理装置である。メモリ102は、CPU101がプログラムを実行する際のワークエリアとして機能する主記憶装置であり、例えばRAMを含む。ストレージ103は、各種のデータを記憶する補助記憶装置であり、例えばSSD又はHDDを含む。通信IF104は所定の規格(例えばイーサネット)に従って他の装置と通信する装置であり、例えばNICを含む。 FIG. 2 is a diagram illustrating the hardware configuration of the server 10. As shown in FIG. The server 10 is a computer device having a CPU 101 , memory 102 , storage 103 and communication IF 104 . The CPU 101 is a processing device that performs various calculations according to programs. The memory 102 is a main storage device that functions as a work area when the CPU 101 executes programs, and includes, for example, a RAM. The storage 103 is an auxiliary storage device that stores various data, and includes, for example, SSD or HDD. The communication IF 104 is a device that communicates with other devices according to a predetermined standard (eg, Ethernet), and includes, for example, a NIC.
 この例において、ストレージ103が記憶するプログラムには、コンピュータ装置を情報処理システム1におけるサーバ10として機能させるためのプログラム(以下「サーバプログラム」という)が含まれる。CPU101がサーバプログラムを実行している状態において、メモリ102及びストレージ103の少なくとも一方が記憶手段11の一例である。CPU101がアクセス手段12、取得手段13、抽出手段14、及び制御手段19の一例である。通信IF104が送信手段15の一例である。 In this example, the programs stored in the storage 103 include a program (hereinafter referred to as "server program") for causing the computer device to function as the server 10 in the information processing system 1. At least one of the memory 102 and the storage 103 is an example of the storage unit 11 while the CPU 101 is executing the server program. The CPU 101 is an example of the access means 12 , acquisition means 13 , extraction means 14 and control means 19 . Communication IF 104 is an example of transmission means 15 .
 ハードウェア構成の詳細な説明は省略するが、ユーザ端末20は汎用のコンピュータ装置、例えばスマートフォン又はパーソナルコンピュータである。ユーザ端末20には、コンピュータ装置を情報処理システム1におけるユーザ端末20として機能させるためのプログラム(以下「クライアントプログラム」という)がインストールされている。クライアントプログラムは、情報処理システム1専用のアプリケーションプログラム又は汎用のウェブブラウザである。 Although a detailed description of the hardware configuration is omitted, the user terminal 20 is a general-purpose computer device such as a smart phone or a personal computer. A program (hereinafter referred to as a “client program”) is installed in the user terminal 20 to allow the computer device to function as the user terminal 20 in the information processing system 1 . The client program is an application program dedicated to the information processing system 1 or a general-purpose web browser.
2.動作
2-1.基本動作
 図3は、情報処理システム1の動作を示すシーケンスチャートである。図3のシーケンスチャートの開始以前において、ユーザ端末20は、クライアントプログラムを実行している。情報処理システム1は例えば衣服のEコマースを提供するシステムである。ユーザは自信の3Dモデル(いわゆるアバター)に衣服の3Dモデルを着せる仮想試着を行い、購入する衣服を選択する。
2. Operation 2-1. Basic Operation FIG. 3 is a sequence chart showing the operation of the information processing system 1 . Before starting the sequence chart of FIG. 3, the user terminal 20 is executing the client program. The information processing system 1 is, for example, a system that provides e-commerce for clothes. A user performs a virtual try-on by putting a 3D model of clothes on his/her own 3D model (so-called avatar) and selects clothes to purchase.
 ステップS101において、ユーザ端末20は、シミュレーション結果の送信要求をサーバ10に送信する。詳細には以下のとおりである。まず、ユーザはユーザ端末20においてシミュレーションの対象となる一の衣服(以下「対象衣服」という)を特定する情報(例えば、ブランド、品番、及びサイズなど)を入力する。この入力に応じて、ユーザ端末20は対象衣服を特定する。あるいは、ユーザ端末20は、ここで入力された情報をサーバ10に送信する。サーバ10はこれらの情報から対象衣服を特定し、対象衣服の識別情報をユーザ端末20に送信する。ユーザ端末20は、シミュレーション結果の送信要求を生成する。この送信要求は、対象衣服の識別情報及びユーザ識別情報を含む。 In step S101, the user terminal 20 transmits a simulation result transmission request to the server 10. Details are as follows. First, the user inputs information (for example, brand, product number, size, etc.) specifying one piece of clothing to be simulated (hereinafter referred to as “target clothing”) in the user terminal 20 . According to this input, the user terminal 20 identifies the target clothing. Alternatively, the user terminal 20 transmits the information input here to the server 10 . The server 10 identifies the target clothing from these pieces of information and transmits the identification information of the target clothing to the user terminal 20 . The user terminal 20 generates a transmission request for simulation results. This transmission request includes the identification information of the target clothing and the user identification information.
 シミュレーション結果の送信要求を受信すると、サーバ10は、この送信要求に従って対象衣服を特定する(ステップS102)。対象衣服の母集団は、データベース111に記録されている衣服である。 Upon receiving the simulation result transmission request, the server 10 identifies the target clothing according to this transmission request (step S102). The target clothing population is the clothing recorded in the database 111 .
 図4は、データベース111に記録されるデータを例示する図である。データベース111は、複数のレコードを含む。各レコードは、一の衣服について、衣服ID、属性情報、画像の所在情報、及び3Dモデルの所在情報を含む。衣服IDはその衣服を特定する識別情報である。属性情報はその衣服の属性を示す情報である。衣服の属性は、例えば、ブランド、デザイナー、種別(例えば、ジャケット、シャツ、パンツ、スカートの別等)、型番、価格帯、サイズ、素材、色、柄、及び説明文の少なくとも1種を含む。この例においては、同じデザインで複数のサイズ、色がある場合、これらに対して共通の衣服IDが与えられる。画像の所在情報は、衣服の画像データが記憶されているリソースを特定する情報、例えばURLである。3Dモデルの所在情報は、衣服の3Dモデリングデータが記憶されているリソースを特定する情報、例えばURLである。複数のサイズのそれぞれに対して画像が用意されている場合、画像の所在情報は、サイズ毎に異なるURLを含む。色及び柄についても同様である。3Dモデルについても同様である。 FIG. 4 is a diagram illustrating data recorded in the database 111. FIG. Database 111 includes a plurality of records. Each record includes a clothing ID, attribute information, image location information, and 3D model location information for one piece of clothing. The clothing ID is identification information that identifies the clothing. Attribute information is information indicating attributes of the clothing. Clothing attributes include, for example, at least one of brand, designer, type (for example, jacket, shirt, pants, skirt, etc.), model number, price range, size, material, color, pattern, and description. In this example, when there are multiple sizes and colors of the same design, a common clothing ID is given to them. The image location information is information, such as a URL, specifying a resource in which image data of clothes is stored. The 3D model location information is information, such as a URL, specifying a resource in which the 3D modeling data of the clothing is stored. When an image is prepared for each of a plurality of sizes, the image location information includes a different URL for each size. The same applies to colors and patterns. The same is true for 3D models.
 データベース111は、さらに、その衣服を着せたインナーボディの3Dモデルに所定の動きをさせたときのその衣服の動きのシミュレーション結果を示すデータ又はそのデータの所在を示す情報を含む。シミュレーション結果のデータは、1以上のデータセットを含む。各データセットは、インナーボディの3Dモデリングデータの識別情報、動きの識別情報、及びそのインナーボディの3Dモデリングデータにその衣服を着せた状態でその動きをさせたときの衣服の動きのシミュレーション結果のデータ又はそのデータの所在情報を含む。データベース111には、複数の衣服の各々について、その衣服を異なる複数の体型のインナーボディの3Dモデルに着せた状態で所定の動きをさせたときのその衣服の動きを示すシミュレーション結果が記録される。 The database 111 further includes data indicating simulation results of the movement of the clothing when the 3D model of the inner body wearing the clothing is caused to perform a predetermined movement, or information indicating the location of the data. The simulation result data includes one or more data sets. Each data set includes identification information of the 3D modeling data of the inner body, identification information of the movement, and simulation results of the movement of the clothing when the 3D modeling data of the inner body is made to move while wearing the clothing. Contains data or location information for that data. In the database 111, for each of a plurality of clothes, a simulation result showing the movement of the clothes when the clothes are put on the 3D models of the inner bodies of different body types and made to move in a predetermined manner is recorded. .
 図4においては具体的な例が示されている。データベース111には、SB[1]~SB[20]の20種類の3Dモデルが登録されている。3DモデルSB[1]~SB[20]を包括して3DモデルSBという。3DモデルSBは、標準体型のインナーボディの3Dモデルである。これら20種類のインナーボディのうち、サイズの制約上、衣服ID「12345」の衣服を着せることができるのはSB[1]~SB[10]の10種類のインナーボディのみである。SB[1]~SB[10]の10種類の標準体型は、インナーボディの胸囲が衣服のその胸囲よりも大きい等の理由により衣服ID「12345」の衣服を着せることができない。データベース111には、インナーボディの3DモデルSB[1]~SB[10]の各々に衣服ID「12345」の衣服を着せた状態でそのインナーボディに所定の動きをさせた、10種類のシミュレーション結果が記録される。 A specific example is shown in FIG. Twenty types of 3D models SB[1] to SB[20] are registered in the database 111 . 3D models SB[1] to SB[20] are collectively referred to as 3D models SB. The 3D model SB is a 3D model of a standard inner body. Of these 20 types of inner bodies, only the 10 types of inner bodies SB[1] to SB[10] can be dressed with the clothes with the clothes ID "12345" due to size restrictions. The 10 standard body types SB[1] to SB[10] cannot wear the clothes with the clothes ID "12345" because the chest circumference of the inner body is larger than the chest circumference of the clothes. In the database 111, 10 types of simulation results are obtained by making the inner bodies perform predetermined movements while wearing the clothes with the clothing ID "12345" on each of the 3D models SB[1] to SB[10] of the inner bodies. is recorded.
 なおこのシミュレーションは、所定のイベントをトリガとして実行される。シミュレーションのトリガとなるイベントは、例えば、新しい衣服がデータベース111に登録されたというイベントである。あるいは、このイベントは、まだシミュレーションが実行されていない衣服が所定数たまったというイベントである。さらにあるいは、このイベントは、サーバ10の演算リソースの稼働率が所定の条件(例えば稼働率がしきい値以下となった)を満たしたというイベントである。すなわちこれらの例においては、シミュレーションはユーザ端末20からの送信要求とは無関係に(又は送信要求によらずに)実行される。 Note that this simulation is triggered by a predetermined event. An event that triggers the simulation is, for example, an event that new clothes are registered in the database 111 . Alternatively, this event is an event that a predetermined number of clothes for which simulation has not yet been performed has accumulated. Further alternatively, this event is an event that the operating rate of the computational resource of the server 10 satisfies a predetermined condition (for example, the operating rate has become equal to or less than a threshold value). That is, in these examples, the simulation is performed independently of (or without) transmission requests from the user terminal 20 .
 図5は、シミュレーション結果を例示する図である。一例において、シミュレーション結果は、インナーボディの3Dモデルに衣服を着せた状態でそのインナーボディに所定の動きをさせたときの、衣服の動きを示すデータを含む。衣服の3Dモデリングデータは、ポリゴンメッシュ及び3Dモデルを動かすための情報、例えばボーン情報を含む。ボーンは3Dモデルを動かすときの関節の役割をする情報である。ボーン情報は、ボーンの位置(相対位置又は絶対位置)及び向きを示す情報である。衣服の動きを示すデータは、例えばボーン情報及びポリゴンメッシュ(又はスキンメッシュ)の時間変化を示すデータである。所定の動きは、例えばインナーボディを歩かせる動きである。この例において、シミュレーション結果は、衣服を着せた状態でそのインナーボディを歩かせたときの、対象衣服のボーン情報及びポリゴンメッシュの時間変化を含む。すなわち、このシミュレーション結果は、対象衣服の形状の時間変化を含むと言える。 FIG. 5 is a diagram illustrating simulation results. In one example, the simulation results include data indicating the movement of the clothes when the 3D model of the inner body is covered with clothes and the inner body is caused to move in a predetermined manner. The 3D modeling data of clothes includes polygon meshes and information for moving the 3D model, such as bone information. A bone is information that acts as a joint when moving a 3D model. Bone information is information indicating the position (relative position or absolute position) and orientation of a bone. The data indicating the movement of clothes is, for example, bone information and data indicating temporal changes of polygon meshes (or skin meshes). The predetermined motion is, for example, a motion that causes the inner body to walk. In this example, the simulation results include temporal changes in the bone information and polygon meshes of the target clothing when the inner body is walked while wearing the clothing. In other words, it can be said that this simulation result includes temporal changes in the shape of the target clothing.
 再び図3を参照する。ステップS103において、サーバ10は、ユーザの体型情報を取得する。この例において、サーバ10は、データベース112から、要求に含まれるユーザ識別情報に対応する体型情報を取得する。 Refer to Figure 3 again. In step S103, the server 10 acquires the user's body type information. In this example, the server 10 obtains body type information corresponding to the user identification information included in the request from the database 112 .
 ステップS104において、サーバ10は、データベース111から、ユーザの体型情報に対応するインナーボディの3Dモデルに対象衣服を着せた状態で所定の動きをさせたときの対象衣服の動きのシミュレーション結果を抽出する。一例において体型情報はそのユーザの体型と最も近い標準体型の識別情報である。例えば体型情報がSB[3]を示す場合、サーバ10は、データベース111から、インナーボディの3DモデルSB[3]に対象衣服を着せた状態でインナーボディに所定の動きをさせたシミュレーション結果のデータを抽出する。 In step S104, the server 10 extracts, from the database 111, a simulation result of the movement of the target clothing when the 3D model of the inner body corresponding to the user's body type information is made to perform a predetermined movement while the target clothing is being put on. . In one example, body type information is identification information of a standard body type that is closest to the user's body type. For example, when the body type information indicates SB[3], the server 10 retrieves from the database 111 the data of the simulation results in which the 3D model SB[3] of the inner body is made to move in a predetermined manner while wearing the target clothes. to extract
 ステップS105において、サーバ10は、抽出されたシミュレーション結果のデータを、要求の送信元であるユーザ端末20に送信する。 In step S105, the server 10 transmits the extracted simulation result data to the user terminal 20, which is the source of the request.
 ステップS106において、ユーザ端末20は、サーバ10から受信したデータを修正する。具体的には例えば以下の通りである。ユーザ端末20は、ユーザの体型データ及び標準体型データを取得する。ユーザの体型データは、そのユーザの体型を示すデータである。体型データは、そのユーザの3Dモデリングデータそのものであってもよいし、そのユーザの3Dモデルから抽出された、複数の身体部位におけるサイズのセットであってもよい。標準体型データは、シミュレーションに用いられたインナーボディの体型を示すデータであり、標準体型のインナーボディの3Dモデリングデータそのものであってもよいし、そのインナーボディの3Dモデルから抽出された、複数の身体部位におけるサイズのセットであってもよい。ユーザ端末20は、ユーザの体型データと標準体型データとの差分を計算する。一例においてこの差分は、人体における複数の特定部位におけるサイズの差のセットである。ユーザ端末20は、計算された差分、及び周知の計算手法(例えばdeformer)を用いて対象衣服の3Dモデリングデータ(例えばポリゴンメッシュ)を変形する。すなわち、対象衣服の3Dモデルにおいて、標準体型のインナーボディを用いてシミュレーションされた結果がユーザの体型に合わせて変形する。 In step S106, the user terminal 20 corrects the data received from the server 10. Specifically, for example, it is as follows. The user terminal 20 acquires body shape data and standard body shape data of the user. The body shape data of the user is data indicating the body shape of the user. The body shape data may be the user's 3D modeling data itself, or may be a set of sizes of a plurality of body parts extracted from the user's 3D model. The standard figure data is data indicating the figure of the inner body used in the simulation. It may be a set of sizes for body parts. The user terminal 20 calculates the difference between the body type data of the user and the standard body type data. In one example, the differences are a set of size differences at specific locations on the human body. The user terminal 20 deforms the 3D modeling data (eg, polygon mesh) of the target garment using the calculated difference and a well-known computation method (eg, deformer). That is, in the 3D model of the target clothing, the simulation result using the inner body of the standard figure is deformed according to the user's figure.
 ステップS107において、ユーザ端末20は、ユーザの3Dモデルに対象衣服の3Dモデルを着せた(すなわち合成した)3Dモデルを生成する。ステップS108において、ユーザ端末20は、ユーザの3Dモデルに所定の動きをさせる動画を表示する。すなわち、ユーザ端末20は、ユーザの3Dモデルに対象衣服の3Dモデルを着せた状態でユーザの3Dモデルに所定の動きをさせるシミュレーションを自身で行わなくても、ユーザの3Dモデルに対象衣服の3Dモデルを着せて所定の動きをさせた動画を表示又は再生することができる。 In step S107, the user terminal 20 generates a 3D model in which the user's 3D model is dressed with the 3D model of the target clothing (that is, synthesized). In step S108, the user terminal 20 displays a moving image that causes the user's 3D model to move in a predetermined manner. That is, even if the user terminal 20 does not perform a simulation in which the 3D model of the user is put on the 3D model of the target clothes and causes the 3D model of the user to move in a predetermined manner, the 3D model of the target clothes can be applied to the 3D model of the user. It is possible to display or play a moving image in which a model is dressed and made to perform predetermined movements.
 このように本実施形態によれは、例えば衣服のEコマースを提供するサービスにおいて、ユーザの3Dモデルに対象衣服の3Dモデルを着せた状態でユーザの3Dモデルに所定の動きをさせるシミュレーションをユーザ端末自身で行う場合と比較して、そのシミュレーション結果をより少ない演算リソースでより早く表示することができる。 As described above, according to the present embodiment, for example, in a service that provides e-commerce of clothes, a user terminal performs a simulation of making a user's 3D model wear a 3D model of target clothes and causing the user's 3D model to make a predetermined movement. Compared to doing it yourself, the simulation results can be displayed faster with fewer computational resources.
3.変形例
 本発明は上述の実施形態に限定されるものではなく種々の変形実施が可能である。以下、変形例をいくつか説明する。以下の変形例に記載した事項のうち2つ以上のものが組み合わせて適用されてもよい。
3. Modifications The present invention is not limited to the above-described embodiments, and various modifications are possible. Some modifications will be described below. Two or more of the items described in the following modified examples may be applied in combination.
3-1.シミュレーション
 標準体型のインナーボディの3Dモデルに対象衣服の3Dモデルを着せた状態で行われるシミュレーションの具体的内容は実施形態において例示したものに限定されない。すなわち、このシミュレーションは、対象衣服の3Dモデルを着せた状態で標準体型のインナーボディの3Dモデルに所定の動きをさせるものに限定されない。一例において、インナーボディの3Dモデルは所定のポーズで静止したままでもよい。インナーボディの3Dモデルが静止したままであっても、衣服はインナーボディによらず固定された形状であるわけではなく、インナーボディの形状にならって変形したり、重力に引かれて端部が垂れ下がったりしてシワができる。インナーボディが静止していても、シミュレーションによりシワのでき方又は端部の垂れ下がり方を視覚的に確認することができるので意義がある。なお、このように、衣服の3Dモデルの標準状態(インナーボディに着せていない状態)から静止状態のインナーボディに着せた状態にしたときに衣服の形状は変化するが、この変化は衣服の「動き」の一例である。
3-1. Simulation The specific contents of the simulation performed in a state in which the 3D model of the target clothing is put on the 3D model of the inner body of the standard figure is not limited to the example illustrated in the embodiment. In other words, this simulation is not limited to making the 3D model of the inner body of the standard figure move in a predetermined manner while wearing the 3D model of the target clothing. In one example, the 3D model of the inner body may remain stationary in a given pose. Even if the 3D model of the inner body remains stationary, the clothing does not have a fixed shape regardless of the inner body. It can droop and wrinkle. Even if the inner body is stationary, the simulation allows visual confirmation of how wrinkles are formed or how the ends hang down, which is significant. In this way, the shape of the 3D model of clothing changes when it is changed from the standard state (the state in which the inner body is not worn) to the state in which the inner body is in a stationary state. It is an example of "movement".
 別の例において、シミュレーションは、ユーザの3Dモデルに対象衣服を着せて所定のポーズを取らせた状態において、衣服の所定の部位とユーザの身体の所定の部位との相対的位置関係を示すものであってもよい。例えば、所定のポーズは椅子に座ったポーズであり、衣服の所定の部位はパンツの裾であり、ユーザの身体の所定の部位はくるぶしである。シミュレーション結果は、例えば3Dモデルにおけるこの部位の外観の拡大図(すなわち、ユーザのくるぶし付近の拡大図)である。あるいは、シミュレーション結果は、相対的位置関係を示す数値データ(すなわち、ユーザのくるぶしと対象衣服のパンツの裾の距離)であってもよい。 In another example, the simulation shows the relative positional relationship between a predetermined part of the clothing and a predetermined part of the user's body in a state in which the 3D model of the user is put on the target clothes and taken in a predetermined pose. may be For example, the predetermined pose is a pose of sitting on a chair, the predetermined part of the clothing is the hem of pants, and the predetermined part of the user's body is the ankle. The simulation result is, for example, a magnified view of the appearance of this part in the 3D model (ie, a magnified view near the user's ankle). Alternatively, the simulation result may be numerical data indicating the relative positional relationship (that is, the distance between the user's ankle and the hem of the pants of the target clothing).
3-2.インナーボディの動き及びポーズ
 データベース111において、インナーボディの動きが複数、定義されていてもよい。例えば、データベース111において、歩く動き、走る動き、ジャンプする動き、腕を回す動き、及び椅子に座る動きが定義される。サーバ10はこれら複数の動きのそれぞれについてシミュレーションを行う。サーバ10は、これら複数の動きについてシミュレーション結果をデータベース111に記録する。ユーザ端末20からの送信要求に対し、サーバ10はこれら複数の動きのシミュレーション結果をユーザ端末20に送信する。あるいは、送信要求がこれら複数の動きの中から一部の動きを指定する識別情報を含み、サーバ10はこの識別情報により指定される動きのシミュレーション結果をユーザ端末20に送信してもよい。この識別情報は、動きを直接指定するものであってもよいし、間接的に指定するものであってもよい。動きを間接的に指定する識別情報とは、例えばユーザ識別情報である。この例においては、データベース112において各ユーザが好む動きの識別情報が記録される。サーバ10は、データベース112を参照して、送信要求に含まれるユーザ識別情報により示されるユーザが好む動きを特定する。サーバ10は、こうして特定した動きのシミュレーション結果をユーザ端末20に送信する。インナーボディが動かずに静止したポーズの状態でシミュレーションが行われる場合も同様で、データベース111において複数のポーズが定義される。
3-2. Inner Body Motion and Pose In the database 111, multiple inner body motions may be defined. For example, walking motion, running motion, jumping motion, arm turning motion, and sitting motion are defined in database 111 . The server 10 simulates each of these multiple movements. The server 10 records simulation results for these multiple motions in the database 111 . In response to a transmission request from the user terminal 20 , the server 10 transmits these motion simulation results to the user terminal 20 . Alternatively, the transmission request may include identification information that designates some of the plurality of movements, and the server 10 may transmit the simulation result of the movement designated by this identification information to the user terminal 20 . This identification information may directly or indirectly specify the movement. The identification information that indirectly specifies movement is, for example, user identification information. In this example, database 112 records the identification information of each user's preferred movement. The server 10 refers to the database 112 to identify the movement preferred by the user indicated by the user identification information included in the transmission request. The server 10 transmits the motion simulation result identified in this way to the user terminal 20 . A plurality of poses are defined in the database 111 in the same way when the simulation is performed in a pose where the inner body remains stationary.
 別の例において、インナーボディの動きは、衣服毎に定義されてもよい。すなわち、各衣服に対して、シミュレーションに用いる動きが定義されてもよい。例えば、スポーツウェアに対してはシミュレーションに用いる動きとして走る動き及びジャンプする動きが定義され、スーツに対しては歩く動き及び椅子に座る動きが定義される。これらの動きは、衣服毎に独自のものが定義されてもよいし、あらかじめ用意された複数の動きの中からその衣服に適したものが選択されてもよい。これらはポーズについても同様である。 In another example, the movement of the inner body may be defined for each piece of clothing. That is, for each piece of clothing, the motions used in the simulation may be defined. For example, running motion and jumping motion are defined as motions used for simulation for sportswear, and walking motion and sitting motion are defined for suit. These movements may be uniquely defined for each piece of clothing, or may be selected from a plurality of previously prepared movements suitable for the particular piece of clothing. These are the same for poses.
 さらに別の例において、サーバ10は、複数の動きの中から自動的に一部の動きを選択し、選択された動きを用いたシミュレーション結果をユーザ端末20に送信してもよい。 In yet another example, the server 10 may automatically select some motions from a plurality of motions and transmit simulation results using the selected motions to the user terminal 20 .
 図6は、この変形例に係るサーバ10の機能構成を例示する図である。サーバ10は、選択手段16を有する。選択手段16は、複数の動きの中から自動的に一部の動きを選択する。一例において、選択手段16は、いま処理の対象となっている送信要求を送信したユーザ端末20のユーザだけでなく、情報処理システム1の他の複数のユーザにおけるシミュレーション結果の閲覧履歴に基づいて動きを選択する。この場合において、サーバ10は、ユーザがシミュレーション結果を閲覧した履歴を記録する。サーバ10は、この閲覧履歴を用いて、対象衣服に対して好まれる動きを推定する。閲覧履歴を解析すれば、例えばスポーツウェアに対しては走る動き及びジャンプする動きのシミュレーション結果が閲覧される頻度が高く、スーツに対しては歩く動き及び椅子に座る動きのシミュレーション結果が閲覧される頻度が高い、といったことが分かる。これらの解析には機械学習が用いられてもよい。例えば、衣服の属性及び動きの識別情報を機械学習モデルの入力層に、その衣服及び動きのシミュレーション結果が閲覧された頻度のデータを出力層に、教師データとして与えて機械学習が行われる。サーバ10は、こうして学習された機械学習モデルを用いて、対象衣服においてユーザが好みそうな(閲覧頻度が高いことが期待される)動きを予測する。 FIG. 6 is a diagram illustrating the functional configuration of the server 10 according to this modification. The server 10 has selection means 16 . A selection means 16 automatically selects a part of motions from a plurality of motions. In one example, the selection unit 16 operates based on the viewing history of the simulation results of not only the user of the user terminal 20 who has transmitted the transmission request to be processed now, but also a plurality of other users of the information processing system 1. to select. In this case, the server 10 records the user's browsing history of the simulation results. The server 10 uses this browsing history to estimate the preferred motion for the target clothing. If the browsing history is analyzed, for example, simulation results of running and jumping motions are frequently viewed for sportswear, and simulation results of walking motions and sitting motions are viewed for suits. It can be seen that the frequency is high. Machine learning may be used for these analyses. For example, machine learning is performed by giving clothing attribute and movement identification information to the input layer of the machine learning model and data on the frequency of viewing the clothing and movement simulation results to the output layer as teacher data. The server 10 uses the machine learning model learned in this way to predict the movement that the user is likely to like (expected to be viewed frequently) in the target clothing.
 別の例において、選択手段16は、処理の対象となっている送信要求を送信したユーザ端末20のユーザの属性に基づいて動きを選択する。複数のユーザ全体の閲覧履歴を解析すれば、例えば若い女性のユーザは歩く動きのシミュレーション結果を閲覧する頻度が高く、中年の男性は椅子に座る動きのシミュレーション結果を閲覧する頻度が高い、といったことが分かる。これらの解析には機械学習が用いられてもよい。例えば、ユーザの属性及び動きの識別情報を機械学習モデルの入力層に、そのユーザがその動きのシミュレーション結果を閲覧した頻度のデータを出力層に、教師データとして与えて機械学習が行われる。サーバ10は、こうして学習された機械学習モデルを用いて、対象衣服においてそのユーザが好みそうな(閲覧頻度が高いことが期待される)動きを予測する。なお以上の事項はインナーボディのポーズについても同様である。 In another example, the selection means 16 selects a motion based on the attributes of the user of the user terminal 20 that has transmitted the transmission request to be processed. By analyzing the browsing histories of multiple users, for example, young female users frequently browse simulation results of walking motion, while middle-aged male users frequently browse simulation results of motion of sitting on a chair. I understand. Machine learning may be used for these analyses. For example, machine learning is performed by giving user attribute and movement identification information to the input layer of the machine learning model, and data on the frequency with which the user browses the movement simulation result to the output layer as teacher data. The server 10 uses the machine learning model learned in this way to predict the movement that the user is likely to like (expected to be viewed frequently) in the target clothing. The above points also apply to the pose of the inner body.
3-3.シミュレーションのトリガ
 シミュレーションのトリガは実施形態において例示したものに限定されない。例えば、サーバ10は、新たな動きが定義されたことを契機としてシミュレーションを行ってもよい。この例において、取得手段13は、インナーボディにさせるための新たな動きを記述した動き情報を取得する。一例において、取得手段13は、ユーザ端末20から動き情報を取得する。この例では、ユーザ端末20は人体の3Dモデルにさせるための動きを編集又は作成する機能を有し、ユーザの指示に応じて新たな動き情報を生成する。ユーザ端末20は、この新たな動き情報を含む送信要求をサーバ10に送信する。取得手段13が新たな動き情報を取得すると、シミュレーション手段18は、対象衣服を着た標準体型のインナーボディの3Dモデルにその新たな動きをさせるシミュレーションを行うよう、シミュレーション手段18に要求する。シミュレーション手段18は、この要求に従ってシミュレーションを行う。シミュレーションが完了すると、送信手段15は、シミュレーション結果をユーザ端末20に送信する。対象衣服について新たな動きのシミュレーションが完了すると、シミュレーション手段18は、別の衣服についてその新たな動きのシミュレーションを行う。対象衣服の次にシミュレーションを行う衣服は、例えばユーザ端末20のユーザにより指定される。あるいは、ユーザが次にシミュレーション結果を要求しそうな(すなわちユーザが次に選択しそうな)衣服をサーバ10が予測し、予測した衣服について新たな動きのシミュレーションを行ってもよい。
3-3. Simulation Trigger Simulation triggers are not limited to those exemplified in the embodiments. For example, the server 10 may perform the simulation when a new motion is defined. In this example, the acquiring means 13 acquires motion information describing new motions to be made to the inner body. In one example, the acquisition means 13 acquires motion information from the user terminal 20 . In this example, the user terminal 20 has a function of editing or creating movements for making a 3D model of a human body, and generates new movement information in accordance with user instructions. The user terminal 20 transmits a transmission request including this new motion information to the server 10 . When the acquiring means 13 acquires new motion information, the simulating means 18 requests the simulating means 18 to perform a simulation of making the 3D model of the inner body of the standard figure wearing the target clothes perform the new motion. The simulation means 18 performs simulation according to this request. When the simulation is completed, the transmitting means 15 transmits the simulation result to the user terminal 20. FIG. After completing the simulation of the new movement for the target garment, the simulation means 18 simulates the new movement for another garment. The clothing to be simulated next to the target clothing is specified by the user of the user terminal 20, for example. Alternatively, the server 10 may predict clothes that the user is likely to request simulation results next (ie, the user is likely to select next), and perform new motion simulations on the predicted clothes.
3-4.他の実施形態
 情報処理システム1のハードウェア構成は実施形態において例示したものに限定されない。要求される機能を実現できるものであれば、情報処理システム1はどのようはハードウェア構成を有していてもよい。例えば、物理的に複数の装置が協働してサーバ10として機能してもよい。サーバ10は物理サーバでもよいし、仮想サーバ(いわゆるクラウドを含む)であってもよい。また、機能要素とハードウェアとの対応関係は実施形態において例示したものに限定されない。例えば、実施形態においてサーバ10に実装されるものとして説明した機能の少なくとも一部がユーザ端末20に実装されてもよい。特に、データベース111及びデータベース112の少なくとも1つは、サーバ10とは別のサーバ装置に実装されてもよい。また、データベース111及びデータベース112は統合されてもよいし、その一部がさらに細分化されてもよい。さらに、図2において例示した機能要素の一部が省略されてもよい。
3-4. Other Embodiments The hardware configuration of the information processing system 1 is not limited to those illustrated in the embodiments. The information processing system 1 may have any hardware configuration as long as it can implement the required functions. For example, a plurality of physical devices may work together to function as the server 10 . The server 10 may be a physical server or a virtual server (including so-called cloud). Also, the correspondence relationship between functional elements and hardware is not limited to the one illustrated in the embodiment. For example, at least part of the functions described as being implemented in the server 10 in the embodiments may be implemented in the user terminal 20 . In particular, at least one of database 111 and database 112 may be implemented in a server device different from server 10 . Also, the database 111 and the database 112 may be integrated, or part of them may be further subdivided. Furthermore, some of the functional elements illustrated in FIG. 2 may be omitted.
 CPU110等によって実行されるプログラムは、インターネット等のネットワークを介したダウンロードにより提供されるものであってもよいし、DVD-ROM等のコンピュータ読み取り可能な非一時的記録媒体に記録された状態で提供されてもよい。 The program executed by the CPU 110 or the like may be provided by downloading via a network such as the Internet, or may be provided in a state recorded on a computer-readable non-temporary recording medium such as a DVD-ROM. may be

Claims (11)

  1.  複数の衣服の各々について、当該衣服の3Dモデリングデータ、当該衣服を着せたインナーボディの3Dモデリングデータに所定の動きをさせたときの当該衣服の動きのシミュレーション結果が記録されたデータベースにアクセスするアクセス手段と、
     ユーザ端末から、前記複数の衣服の中から衣服を検索するための検索キー及びユーザの体型に関する体型情報を取得する取得手段と、
     前記データベースから、前記検索キーにより特定される衣服及び前記体型情報に対応するシミュレーション結果を抽出する抽出手段と、
     前記抽出されたシミュレーション結果を、前記ユーザ端末に送信する送信手段と
     を有する情報処理装置。
    Accessing a database in which, for each of a plurality of clothes, 3D modeling data of the clothes and 3D modeling data of the inner body wearing the clothes are recorded, and simulation results of the movements of the clothes are recorded means and
    Acquisition means for acquiring, from a user terminal, a search key for retrieving clothes from among the plurality of clothes and body shape information about the user's body shape;
    extracting means for extracting simulation results corresponding to the clothes specified by the search key and the body shape information from the database;
    and transmitting means for transmitting the extracted simulation result to the user terminal.
  2.  前記データベースにおいて、前記複数の衣服の各々について、当該衣服の3Dモデリングデータ、異なる体型を有する複数のインナーボディの3Dモデリングデータに当該衣服を着せて前記所定の動きをさせたときの当該衣服の動きのシミュレーション結果が記録され、
     前記抽出手段は、前記データベースから、前記複数のインナーボディのうち前記体型情報により示される体型との差が最も小さい体型を有するインナーボディの3Dモデリングデータに当該衣服を着せて前記所定の動きをさせたときの当該衣服の動きのシミュレーション結果を抽出する
     請求項1に記載の情報処理装置。
    In the database, for each of the plurality of clothing, 3D modeling data of the clothing, 3D modeling data of a plurality of inner bodies having different body types, and movement of the clothing when the clothing is put on and made to perform the predetermined movement. The simulation results of are recorded,
    The extracting means causes the 3D modeling data of the inner body having the smallest difference from the body shape indicated by the body shape information among the plurality of inner bodies from the database to wear the clothes and perform the predetermined movement. The information processing apparatus according to claim 1, wherein a simulation result of movement of the clothing when the clothing is worn is extracted.
  3.  前記シミュレーション結果が、前記衣服の形状の時間変化を含む
     請求項1又は2に記載の情報処理装置。
    The information processing apparatus according to claim 1 or 2, wherein the simulation result includes temporal changes in the shape of the clothing.
  4.  前記シミュレーション結果が、前記衣服の所定の部位と前記ユーザの身体の所定の部位との相対的位置関係を含む
     請求項1乃至3のいずれか一項に記載の情報処理装置。
    The information processing apparatus according to any one of claims 1 to 3, wherein the simulation result includes a relative positional relationship between a predetermined portion of the clothing and a predetermined portion of the user's body.
  5.  前記所定の動きが、異なる複数の動きを含み、
     前記抽出手段は、前記データベースから、前記検索キーにより特定される衣服、前記体型情報、及び前記複数の動きの中から選択された動きに対応するシミュレーション結果を抽出する
     請求項1乃至4のいずれか一項に記載の情報処理装置。
    the predetermined motion includes a plurality of different motions,
    5. The extracting means extracts, from the database, clothes identified by the search key, the body type information, and a simulation result corresponding to a motion selected from among the plurality of motions. The information processing device according to item 1.
  6.  前記取得手段が、前記複数の動きの中から少なくとも一部の動きを指定する識別情報を取得し、
     前記抽出手段は、前記識別情報により指定される動きに対応するシミュレーション結果を抽出する
     請求項5に記載の情報処理装置。
    The acquisition means acquires identification information designating at least some of the plurality of movements,
    6. The information processing apparatus according to claim 5, wherein said extracting means extracts a simulation result corresponding to the motion specified by said identification information.
  7.  前記検索キーにより特定される衣服に応じて前記複数の動きの中から少なくとも一部の動きを選択する選択手段を有し、
     前記抽出手段は、前記選択手段により選択された動きに対応するシミュレーション結果を抽出する
     請求項5に記載の情報処理装置。
    selecting means for selecting at least part of the plurality of motions according to the clothing specified by the search key;
    The information processing apparatus according to claim 5, wherein said extraction means extracts a simulation result corresponding to the movement selected by said selection means.
  8.  前記取得手段が、前記ユーザ端末から前記インナーボディにさせる新たな動きを記述した動き情報を取得し、
     前記検索キーにより特定される一の衣服を着せた、前記体型情報に対応するインナーボディの3Dモデリングデータに前記動き情報により記述される前記新たな動きをさせたときの当該衣服の動きをシミュレーションするシミュレーション手段を有し、
     前記シミュレーションが完了すると、前記送信手段が当該シミュレーションの結果を送信し、
     前記シミュレーション手段は、前記新たな動きのシミュレーション結果が送信された後で、前記一の衣服と異なる別の衣服を着せた、前記体型情報に対応するインナーボディの3Dモデリングデータに前記動き情報により記述される前記新たな動きをさせたときの当該衣服の動きをシミュレーションする
     請求項1乃至7のいずれか一項に記載の情報処理装置。
    the acquiring means acquires motion information describing a new motion to be made to the inner body from the user terminal;
    3D modeling data of the inner body corresponding to the body type information, which is put on one piece of clothing specified by the search key, is made to perform the new movement described by the movement information, and the movement of the clothing is simulated. having simulation means;
    When the simulation is completed, the transmission means transmits the result of the simulation;
    After the simulation result of the new movement is transmitted, the simulation means describes the movement information in the 3D modeling data of the inner body corresponding to the body shape information, which is dressed in another clothing different from the first clothing. The information processing apparatus according to any one of claims 1 to 7, wherein the movement of the clothing when the new movement is made to be performed is simulated.
  9.  サーバと、
     ユーザ端末と
     を有し、
     前記サーバは、
      複数の衣服の各々について、当該衣服の3Dモデリングデータ、当該衣服を着せたインナーボディの3Dモデリングデータに所定の動きをさせたときの当該衣服の動きのシミュレーション結果が記録されたデータベースにアクセスするアクセス手段と、
      前記ユーザ端末から、前記複数の衣服の中から衣服を検索するための検索キー及びユーザの体型に関する体型情報を取得する取得手段と、
      前記データベースから、前記検索キーにより特定される衣服及び前記体型情報に対応するシミュレーション結果を抽出する抽出手段と、
      前記抽出されたシミュレーション結果を、前記ユーザ端末に送信する送信手段と
     を有し、
     前記ユーザ端末は、
      前記衣服の3Dモデリングデータ及び前記シミュレーション結果を用いて生成された、当該ユーザに当該衣服を着せた3Dモデルに前記所定の動きをさせる動画を表示する表示手段
     を有する3Dシステム。
    a server;
    having a user terminal and
    The server is
    Accessing a database in which, for each of a plurality of clothes, 3D modeling data of the clothes and 3D modeling data of the inner body wearing the clothes are recorded, and simulation results of the movements of the clothes are recorded means and
    acquisition means for acquiring, from the user terminal, a search key for searching for clothes from among the plurality of clothes and body type information about the user's body type;
    extracting means for extracting simulation results corresponding to the clothes specified by the search key and the body shape information from the database;
    transmitting means for transmitting the extracted simulation result to the user terminal;
    The user terminal is
    A 3D system comprising: display means for displaying a moving image of a 3D model in which the user is wearing the clothing, which is generated using the 3D modeling data of the clothing and the simulation results, and causes the user to perform the predetermined movement.
  10.  前記表示手段は、前記インナーボディの3Dモデリングデータと前記ユーザの3Dモデリングデータとの体型差に応じて変形された前記衣服の3Dモデリングデータ及び前記シミュレーション結果を用いて生成された、当該ユーザに当該衣服を着せた3Dモデルに前記所定の動きをさせる動画を表示する
     請求項9に記載の3Dシステム。
    The display means displays the 3D modeling data of the clothes deformed in accordance with the body type difference between the 3D modeling data of the inner body and the 3D modeling data of the user, and the 3D modeling data of the clothing generated using the simulation result. 10. The 3D system according to claim 9, wherein the animated 3D model with clothes is displayed with the predetermined movement.
  11.  複数の衣服の各々について、当該衣服の3Dモデリングデータ、当該衣服を着せたインナーボディの3Dモデリングデータに所定の動きをさせたときの当該衣服の動きのシミュレーション結果が記録されたデータベースにアクセスするステップと、
     ユーザ端末から、前記複数の衣服の中から衣服を検索するための検索キー及びユーザの体型に関する体型情報を取得するステップと、
     前記データベースから、前記検索キーにより特定される衣服及び前記体型情報に対応するシミュレーション結果を抽出するステップと、
     前記抽出されたシミュレーション結果を、前記ユーザ端末に送信するステップと
     を有する情報処理方法。
    A step of accessing a database in which, for each of a plurality of clothes, 3D modeling data of the clothes and 3D modeling data of an inner body wearing the clothes are recorded in a simulation result of the movement of the clothes when a predetermined movement is performed. When,
    a step of acquiring a search key for searching for clothes from among the plurality of clothes and body shape information about the user's body shape from the user terminal;
    a step of extracting from the database simulation results corresponding to the clothing and body type information specified by the search key;
    and transmitting the extracted simulation result to the user terminal.
PCT/JP2021/023541 2021-06-22 2021-06-22 Information processing device, 3d system, and information processing method WO2022269741A1 (en)

Priority Applications (4)

Application Number Priority Date Filing Date Title
JP2021536724A JP7023558B1 (en) 2021-06-22 2021-06-22 Information processing equipment, 3D system, and information processing method
PCT/JP2021/023541 WO2022269741A1 (en) 2021-06-22 2021-06-22 Information processing device, 3d system, and information processing method
CN202180005716.9A CN114556332B (en) 2021-06-22 2021-06-22 Information processing apparatus, 3D system, and information processing method
JP2021202815A JP2023002440A (en) 2021-06-22 2021-12-14 Information processing device, 3D system, and information processing method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/JP2021/023541 WO2022269741A1 (en) 2021-06-22 2021-06-22 Information processing device, 3d system, and information processing method

Publications (1)

Publication Number Publication Date
WO2022269741A1 true WO2022269741A1 (en) 2022-12-29

Family

ID=81079695

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2021/023541 WO2022269741A1 (en) 2021-06-22 2021-06-22 Information processing device, 3d system, and information processing method

Country Status (3)

Country Link
JP (2) JP7023558B1 (en)
CN (1) CN114556332B (en)
WO (1) WO2022269741A1 (en)

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2002024319A (en) * 2000-07-04 2002-01-25 Toyobo Co Ltd Try-on image generation system
JP2009128997A (en) * 2007-11-20 2009-06-11 Fujifilm Corp Clothing image display device and clothing image display method
JP2013190974A (en) * 2012-03-13 2013-09-26 Satoru Ichimura Information processing apparatus, information processing method, and program
JP5605885B1 (en) * 2014-02-27 2014-10-15 木下 泰男 Virtual try-on system and virtual try-on program
JP2015180987A (en) * 2014-03-03 2015-10-15 株式会社東芝 Image processing apparatus, image processing system, image processing method, and program
JP2016038813A (en) * 2014-08-08 2016-03-22 株式会社東芝 Virtual try-on apparatus, virtual try-on system, virtual try-on method and program
JP2017004464A (en) * 2015-06-16 2017-01-05 株式会社東芝 Image processor, image processing system, image processing method and program
JP6631988B1 (en) * 2018-07-02 2020-01-15 株式会社ブルームスキーム Virtual fitting device, virtual fitting method, and virtual fitting program
JP2020170394A (en) * 2019-04-04 2020-10-15 株式会社Sapeet Clothing-wearing visualization system and clothing-wearing visualization method
JP6804125B1 (en) * 2020-07-27 2020-12-23 株式会社Vrc 3D data system and 3D data generation method

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101728588B1 (en) * 2014-03-27 2017-05-02 한국전자통신연구원 Smart device and virtual experience providing server provide virtual experience service method using digital clothes
US10204375B2 (en) * 2014-12-01 2019-02-12 Ebay Inc. Digital wardrobe using simulated forces on garment models
CN107578323B (en) * 2017-10-10 2020-05-12 中国科学院合肥物质科学研究院 Three-dimensional real human body online virtual fitting method
CN109003168A (en) * 2018-08-16 2018-12-14 深圳Tcl数字技术有限公司 Virtual fit method, smart television and computer readable storage medium
CN109523345A (en) * 2018-10-18 2019-03-26 河海大学常州校区 WebGL virtual fitting system and method based on virtual reality technology

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2002024319A (en) * 2000-07-04 2002-01-25 Toyobo Co Ltd Try-on image generation system
JP2009128997A (en) * 2007-11-20 2009-06-11 Fujifilm Corp Clothing image display device and clothing image display method
JP2013190974A (en) * 2012-03-13 2013-09-26 Satoru Ichimura Information processing apparatus, information processing method, and program
JP5605885B1 (en) * 2014-02-27 2014-10-15 木下 泰男 Virtual try-on system and virtual try-on program
JP2015180987A (en) * 2014-03-03 2015-10-15 株式会社東芝 Image processing apparatus, image processing system, image processing method, and program
JP2016038813A (en) * 2014-08-08 2016-03-22 株式会社東芝 Virtual try-on apparatus, virtual try-on system, virtual try-on method and program
JP2017004464A (en) * 2015-06-16 2017-01-05 株式会社東芝 Image processor, image processing system, image processing method and program
JP6631988B1 (en) * 2018-07-02 2020-01-15 株式会社ブルームスキーム Virtual fitting device, virtual fitting method, and virtual fitting program
JP2020170394A (en) * 2019-04-04 2020-10-15 株式会社Sapeet Clothing-wearing visualization system and clothing-wearing visualization method
JP6804125B1 (en) * 2020-07-27 2020-12-23 株式会社Vrc 3D data system and 3D data generation method

Also Published As

Publication number Publication date
JPWO2022269741A1 (en) 2022-12-29
CN114556332B (en) 2022-11-11
JP7023558B1 (en) 2022-02-22
CN114556332A (en) 2022-05-27
JP2023002440A (en) 2023-01-10

Similar Documents

Publication Publication Date Title
US12017142B2 (en) System and method for real-time calibration of virtual apparel using stateful neural network inferences and interactive body measurements
US8090465B2 (en) Fashion design method, system and apparatus
WO2020203656A1 (en) Information processing device, information processing method, and program
JP6242768B2 (en) Virtual try-on device, virtual try-on method, and program
CN105956912A (en) Method for realizing network fitting
CN107924532A (en) Method and apparatus for the description for providing dress form
KR20170068741A (en) Method and program for providing virtual fitting service
JP6320237B2 (en) Virtual try-on device, virtual try-on method, and program
JP6338966B2 (en) Virtual try-on device, virtual try-on system, virtual try-on method, and program
JP2008165807A (en) Terminal try-on simulation system, and operating and applying method
US20210326955A1 (en) Generation of Improved Clothing Models
Vitali et al. Acquisition of customer’s tailor measurements for 3D clothing design using virtual reality devices
CN113610612A (en) 3D virtual fitting method, system and storage medium
JP2018106736A (en) Virtual try-on apparatus, virtual try-on method and program
Gupta New directions in the field of anthropometry, sizing and clothing fit
JP2022106923A (en) Image creation apparatus, method and program, and virtual fitting system
KR102530461B1 (en) System for providing virtual cloth fitting service using three-dimensional avatar
JP7039094B1 (en) Information processing equipment, information processing methods, and programs
WO2022269741A1 (en) Information processing device, 3d system, and information processing method
WO2022081745A1 (en) Real-time rendering of 3d wearable articles on human bodies for camera-supported computing devices
JP2018113060A (en) Virtual try-on apparatus, virtual try-on system, virtual try-on method and program
KR20210130420A (en) System for smart three dimensional garment fitting and the method for providing garment fitting service using there of
TWI822476B (en) Information processing equipment, information processing method, information processing system, and program
JP2019112732A (en) Digital fitting support device, digital apparel support device and digital apparel support method
JP7418677B1 (en) Information processing system, information processing method, and information processing program

Legal Events

Date Code Title Description
ENP Entry into the national phase

Ref document number: 2021536724

Country of ref document: JP

Kind code of ref document: A

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21947028

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21947028

Country of ref document: EP

Kind code of ref document: A1