CN114556332A - Information processing apparatus, 3D system, and information processing method - Google Patents

Information processing apparatus, 3D system, and information processing method Download PDF

Info

Publication number
CN114556332A
CN114556332A CN202180005716.9A CN202180005716A CN114556332A CN 114556332 A CN114556332 A CN 114556332A CN 202180005716 A CN202180005716 A CN 202180005716A CN 114556332 A CN114556332 A CN 114556332A
Authority
CN
China
Prior art keywords
garment
motion
simulation result
body shape
user
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202180005716.9A
Other languages
Chinese (zh)
Other versions
CN114556332B (en
Inventor
谢英弟
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Viavision Co ltd
Original Assignee
Viavision Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Viavision Co ltd filed Critical Viavision Co ltd
Publication of CN114556332A publication Critical patent/CN114556332A/en
Application granted granted Critical
Publication of CN114556332B publication Critical patent/CN114556332B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/70Information retrieval; Database structures therefor; File system structures therefor of video data
    • G06F16/78Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • G06F16/7867Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using information manually generated, e.g. tags, keywords, comments, title and artist information, manually generated time, location and usage information, user ratings
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T17/00Three dimensional [3D] modelling, e.g. data description of 3D objects
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02PCLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
    • Y02P90/00Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
    • Y02P90/30Computing systems specially adapted for manufacturing

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Databases & Information Systems (AREA)
  • Data Mining & Analysis (AREA)
  • Multimedia (AREA)
  • Library & Information Science (AREA)
  • Computer Graphics (AREA)
  • Geometry (AREA)
  • Software Systems (AREA)
  • Processing Or Creating Images (AREA)

Abstract

An information processing apparatus includes: an access device that accesses a database in which 3D modeling data of a garment and a simulation result of a motion of the garment when the 3D modeling data of an inner body wearing the garment performs a predetermined motion are recorded for each of a plurality of garments; an obtaining means that obtains, from a user terminal, a search keyword for searching for a garment from a plurality of garments and body shape information related to a body shape of a user; an extracting means that extracts a simulation result corresponding to the clothing and the body shape information specified by the search keyword from the database; and a transmitting device that transmits the extracted simulation result to the user terminal.

Description

Information processing apparatus, 3D system, and information processing method
Technical Field
The present disclosure relates to a technique for displaying simulation results of a 3D model of a garment worn on a 3D model of a user.
Background
In a virtual fitting that is fitted in a virtual space, the movement and wrinkles of a 3D model of a garment worn by a human body are simulated according to the movement of the 3D model of the human body, thereby providing a more realistic and natural fitting experience. For example, patent document 1 discloses a virtual fitting system for confirming a wearing effect when a user performs various exercises in real time.
[ patent document ]
Patent document 1: CN 107578323A
Disclosure of Invention
[ problems to be solved by the invention ]
Although the simulation result of the virtual try-on can be displayed on a portable terminal such as a smartphone, in general, the portable terminal has low calculation processing capability. In the technique described in patent document 1, there is a problem that simulation of virtual try-on in the portable terminal requires a large amount of computer resources.
In contrast, the present disclosure provides a technique for displaying simulation results of a 3D model of a garment worn on a 3D model of a user using lower computer resources.
[ solution ]
According to an aspect of the present disclosure, there is provided an information processing apparatus including: an access device that accesses a database in which 3D modeling data of a plurality of garments and a simulation result of a motion of the garment when the 3D modeling data of an inner body wearing the garment performs a predetermined motion are recorded for each of the garments; an obtaining means that obtains, from a user terminal, a search keyword for searching for a garment from the plurality of garments and body shape information related to a body shape of the user; extracting means that extracts a simulation result corresponding to the clothing specified by the search keyword and the body shape information from the database; and a transmitting device that transmits the extracted simulation result to the user terminal.
The database may include, for each of the plurality of garments, a simulation result of a motion of the garment when the garment is worn by each of a plurality of 3D modeling data of the inner body, and the extracting means may extract the simulation result of a predetermined motion of the garment when the garment is worn on the 3D modeling data of the inner body having a body shape that differs least from the body shape indicated by the body shape information among the plurality of inner bodies from the database.
The simulation results may include changes in the shape of the garment over time.
The simulation result may include a relative positional relationship between a predetermined portion of the garment and a predetermined portion of the user's body.
The predetermined motion may include a plurality of different motions, and the extracting means may extract a simulation result corresponding to the clothing specified by the search keyword, the body shape information, and a motion selected from the plurality of motions from the database.
The obtaining means may obtain identification information that specifies at least a part of the plurality of motions, and the extracting means may extract a simulation result corresponding to the motion specified by the identification information.
The information processing apparatus may further include: selection means for selecting at least a part of the plurality of motions in accordance with the costume specified by the search keyword, wherein the extraction means may extract the simulation result corresponding to the motion selected by the selection means.
The obtaining means may obtain motion information describing a new motion to be performed by the internal body from the user terminal, the information processing apparatus may further include simulation means for simulating a motion of the garment when the 3D modeling data of the inner body corresponding to the body shape information performs the new motion described by the motion information while wearing the garment, the garment being specified by the search keyword, the transmitting means may transmit the simulation result when the simulation is completed, the simulating means simulating the motion of the garment when the 3D modeling data of the internal body corresponding to the body shape information performs the new motion described by the motion information, after the simulation result of the new motion is transmitted, the 3D modeling data of the inner body is worn on another garment different from the garment.
According to another aspect of the present disclosure, there is provided a 3D system, the 3D system including: a server; and a user terminal, wherein the server comprises: an access device that accesses a database in which 3D modeling data of a plurality of garments and a simulation result of a motion of the garment when the 3D modeling data of an inner body wearing the garment performs a predetermined motion are recorded for each of the garments; an obtaining means that obtains, from a user terminal, a search keyword for searching for a garment from the plurality of garments and body shape information related to a body shape of the user; extracting means that extracts a simulation result corresponding to the clothing specified by the search keyword and the body shape information from the database; and a transmitting device that transmits the extracted simulation result to the user terminal, the user terminal including: a display device that displays a movie generated using the 3D modeling data of the garment and the simulation result, the movie showing the 3D model of the user wearing the garment and performing the predetermined motion.
The display device may display the movie showing the 3D model of the user wearing the garment, the 3D modeling data of the garment being deformed based on a body shape difference between the 3D modeling data of the inner body and the 3D modeling data of the user.
According to still another aspect of the present disclosure, there is provided an information processing method including: accessing a database in which 3D modeling data of a plurality of garments and a simulation result of a motion of the garment when the 3D modeling data of an inner body wearing the garment performs a predetermined motion are recorded for each of the garments; obtaining a search keyword for searching for a garment from the plurality of garments and body shape information related to a body shape of the user from the user terminal; extracting a simulation result corresponding to the clothing specified by the search keyword and the body shape information from the database; and transmitting the extracted simulation result to the user terminal.
[ advantageous effects of the invention ]
According to the present disclosure, simulation results obtained by wearing a 3D model of a garment on a 3D model of a user can be displayed using lower computer resources.
Drawings
Fig. 1 exemplarily shows a functional configuration of an information processing system 1 according to an embodiment;
fig. 2 exemplarily shows a hardware configuration of the server 10.
Fig. 3 is a sequence chart showing the operation of the information processing system 1.
Fig. 4 exemplarily shows data recorded in the database 111.
Fig. 5 exemplarily shows a simulation result.
Fig. 6 exemplarily shows a functional configuration of the server 10 according to the modification.
[ description of reference numerals ]
Information processing system, 10.. server, 11.. storage device, 12.. access device, 13.. obtaining device, 14.. extracting device, 15.. transmitting device, 18.. simulating device, 19.. control device, 20.. user terminal, 21.. storage device, 22.. UI device, 23.. modifying device, 24.. display device, 29.. control device, 101.. CPU, 102.. memory, 103.. memory device, 104.. communication IF
Detailed Description
1. Configuration of
Fig. 1 exemplarily shows a functional configuration of an information processing system 1 according to an embodiment. The information processing system 1, which is an example of a 3D system, is a system that provides information about a garment, and more specifically, the information processing system 1 is a system that outputs information about a result of a simulation in which a 3D model of a garment is worn on a 3D model of a human body, which is an example of an inner body. In one example, the information processing system 1 is used to search for a garment matching the user's preference from among a plurality of garments. A 3D model is a three-dimensional virtual object that represents the shape of the object in virtual space. Here, data representing a 3D model is referred to as 3D modeling data (or three-dimensional modeling data). The 3D modeling data of the garment refers to data representing a 3D model of the garment. The 3D modeling data of the user refers to data representing a 3D model of the user's body.
The information processing system 1 provides a clothing search service. The information processing system 1 includes a server 10 and a user terminal 20 as hardware. The server 10 is a computer apparatus (which is an example of an information processing apparatus) serving as a server in the clothing search service. The user terminal 20 is a computing device that acts as a client in a clothing search service.
The information processing system 1 includes a storage device 11, an access device 12, an acquisition device 13, an extraction device 14, a transmission device 15, a simulation device 18, a control device 19, a storage device 21, a UI device 22, a modification device 23, a display device 24, and a control device 29. In this example, the storage means 11, the accessing means 12, the obtaining means 13, the extracting means 14, the transmitting means 15, the simulating means 18 and the controlling means 19 are implemented in the server 10, and the storage means 21, the UI means 22, the modifying means 23, the display means 24 and the controlling means 29 are implemented in the user terminal 20.
The storage device 11 stores various data. The data stored in the storage device 11 includes, for example, a database 111 and a database 112. The database 111 is a database as follows: for each of a plurality of garments, 3D modeling data of the garment and simulation results of the motion of the garment when a predetermined motion is performed on the 3D modeling data of the inner body wearing the garment are recorded in the database. The database 112 is a database in which user attribute information is recorded. The user attribute information includes, for example, name, age, sex, and body shape information of the user. The body shape information is information indicating the body shape of the user, and in one example, identification information of one standard body shape closest to the body shape of the user (i.e., the body shape having the smallest difference from the body shape of the user) among a plurality of predetermined standard body shapes. Alternatively, the body shape information may include a set of sizes of specific parts of the body, such as height, chest circumference, upper arm circumference, torso circumference, thigh circumference, and leg length.
The accessing means 12 access the database 111. The obtaining means 13 obtains, from the user terminal 20, a search keyword for searching for a garment from the plurality of garments and body shape information related to the body shape of the user. The extraction means 14 extracts the simulation result corresponding to the clothing and body shape information specified by the search key from the database. The transmission means 15 transmits the extracted simulation result to the user terminal 20. The simulation means 18 simulate the movement of the garment using a 3D model of the garment worn on the 3D model of the inner body. The simulation means 18 writes the simulation result in the database 111. The control device 19 controls various elements.
The storage device 21 stores various data. The UI device 22 provides a user interface. The modification means 23 modifies the simulation result data received from the server 10 based on the difference between the body shape of the user and the standard body shape. The display device 24 displays the modified simulation results. The control device 29 controls various elements.
Fig. 2 exemplarily shows a hardware configuration of the server 10. The server 10 is a computer device having a CPU101, a memory 102, a storage device 103, and a communication IF 104. The CPU101 is a processing unit that performs various operations according to a program. The memory 102 is a main storage device used as a work area when the CPU101 executes a program and includes, for example, a RAM. The storage device 103 is an auxiliary storage device for storing various types of data, including, for example, an SSD or an HDD. The communication IF104 is a device that communicates with other devices according to a predetermined standard (e.g., ethernet) and includes, for example, a NIC.
In this example, the program stored in the storage device 103 includes a program for causing a computer device to function as the server 10 in the information processing system 1 (hereinafter referred to as "server program"). At least one of the memory 102 and the storage device 103 is an example of the storage device 11 when the CPU101 executes the server program. The CPU101 is an example of the accessing means 12, the obtaining means 13, the extracting means 14, and the controlling means 19. The communication IF104 is an example of the transmitting device 15.
Although detailed description of the hardware configuration is omitted, the user terminal 20 is a general-purpose computer device such as a smartphone or a personal computer. A program for causing a computer device to function as the user terminal 20 (hereinafter referred to as "client program") is installed in the user terminal 20 in the information processing system 1. The client program is an application program or a general-purpose web browser dedicated to the information processing system 1.
2. Operation of
2-1, basic operation
Fig. 3 is a sequence chart showing the operation of the information processing system 1. Before the start of the sequence diagram shown in fig. 3, the user terminal 20 is executing a client program. The information processing system 1 is, for example, a system for providing electronic commerce of clothing. The user performs a virtual fitting to wear a 3D model of a garment on his/her own 3D model (so-called avatar), and selects a garment to be purchased.
In step S101, the user terminal 20 transmits a request to transmit the simulation result to the server 10. The specific details are as follows. First, the user inputs information (e.g., brand, product number, size, etc.) specifying a piece of clothing to be simulated in the user terminal 20 (hereinafter referred to as "target clothing"). In response to this input, the user terminal 20 identifies the target garment. Alternatively, the user terminal 20 transmits information input therein to the server 10. The server 10 identifies the target garment from these pieces of information, and transmits the identification information of the target garment to the user terminal 20. The user terminal 20 generates a transmission request of the simulation result. The transmission request includes identification information of the target garment and user identification information.
When receiving a request to transmit the simulation result, the server 10 identifies (in step S102) the target garment according to this transmission request. The group of target garments is garments recorded in the database 111.
Fig. 4 exemplarily shows data recorded in the database 111. The database 111 includes a plurality of records. Each record includes a garment ID, attribute information, image location information, and 3D model location information for a garment. The garment ID is identification information for specifying a garment. The attribute information is information indicating an attribute of the garment. The attributes of the garment include, for example, at least one of brand, designer, type (e.g., jacket, shirt, pants, skirt, etc.), model, price range, size, material, color, pattern, and description. In this example, if there are multiple sizes and colors in the same design, they are given a common garment ID. The position information of the image is information identifying a resource storing image data of the garment, such as a URL. The position information of the 3D model is information, such as a URL, that specifies a resource storing 3D modeling data of the garment. If an image is provided for each of a plurality of sizes, the location information of the image includes a different URL for each size. The same applies to colors and patterns. The same applies to 3D models.
The database 111 also includes data indicating the results of simulating the movement of the garment when the 3D model of the inner body wearing the garment undergoes a predetermined movement, or information indicating the location of the data. The simulation result data includes one or more data sets. The corresponding data set includes identification information of the 3D modeling data of the inner body, identification information of the motion, and data of a simulation result of the motion of the garment when the garment is put on the 3D modeling data of the inner body while the garment is put on, or position information of the data. The database 111 has, for each of the plurality of garments, simulation results indicative of a motion of the garment worn by each of the plurality of 3D models of the inner body, wherein each 3D model of the inner body performs a predetermined motion.
Fig. 4 shows a specific example. Database 111 has twenty 3D models SB [1] through SB [20 ]. The 3D models SB [1] to SB [20] are collectively referred to as the 3D model SB. The 3D model SB is a 3D model of an endosome having a normal body shape. Of these 20 types of inner bodies, only 10 types of inner bodies SB 1 to SB 10 can wear a garment having garment ID "12345" due to size limitations. The inner bodies of the 3D models SB 1 to SB 10 cannot wear the clothes with clothes ID of "12345" because the chest circumference of these inner bodies is larger than that of the clothes. The database 111 has 10 simulation results in which each of the 3D models SB [1] to SB [10] of the internal body wears a garment having a garment ID of "12345" and causes the internal body to perform a predetermined motion.
The simulation is triggered by a predetermined event. The simulation may be triggered by an event, for example, that a new garment has been registered in the database 111. Alternatively, the simulation may be triggered by events that have accumulated a predetermined number of garments for which no simulation has been performed. Further, the simulation may be triggered by an event in which the operating rate of the computing resources of the server 10 meets a predetermined condition (e.g., the operating rate is less than or equal to a threshold). That is, in these examples, the simulation is performed independently of the transmission request from the user terminal 20.
Fig. 5 exemplarily shows a simulation result. In one example, the simulation results include data indicative of garment motion if a 3D model of an inner body wearing the garment performs a predetermined motion. The 3D modeling data of the garment includes information for moving the polygon meshes and the 3D model, such as skeletal information. Bones are information used as joints when moving a 3D model. The bone information is information indicating the position (relative position or absolute position) and direction of the bone. The data indicating the motion of the garment are, for example, skeletal information and data indicating temporal changes of a polygon mesh (or skin mesh). The predetermined movement is, for example, a movement of a walking body. In this example, the simulation results include skeletal information of the target garment and the change in the polygonal mesh over time as the endosome walks while wearing the garment. That is, it can be said that the simulation result includes a change in the shape of the target garment over time.
Reference is again made to fig. 3. In step S103, the server 10 obtains the body shape information of the user. In this example, the server 10 obtains body shape information corresponding to the user identification information included in the request from the database 112.
In step S104, the server 10 extracts a simulation result of the motion of the state garment when the target garment is worn on the 3D model of the internal body corresponding to the body shape information of the user and the target garment is caused to perform a predetermined motion from the database 111. In one example, the body shape information is identification information of a standard body shape closest to the body shape of the user. For example, if the body shape information indicates SB 3, the server 10 extracts data of a simulation result obtained by causing the internal body to perform a predetermined motion on the 3D model SB 3 of the internal body while wearing the target garment from the database 111.
In step S105, the server 10 transmits the extracted simulation result data to the user terminal 20 as the request source.
In step S106, the user terminal 20 modifies the data received from the server 10. Specifically, the following is made. The user terminal 20 obtains the user's figure data and the standard figure data. The body shape data of the user is data indicating the body shape of the user. The body shape data may be the 3D modeling data itself of the user, or may be the size of a set of multiple body parts extracted from a 3D model of the user. The standard volume data is data indicating the body shape of the internal body used in the simulation, and may be 3D modeling data itself of the internal body of the standard body shape, or may be the size of a set of multiple body parts extracted from a 3D model of the internal body. The user terminal 20 calculates the difference between the user's figure data and the standard figure data. In one example, the difference is a size difference of a set of multiple specific parts in the human body. The user terminal 20 transforms the 3D modeling data (e.g., polygonal mesh) of the target garment by using the calculated differences and a well-known calculation method (e.g., deformer). That is, in the 3D model of the target garment, the result of the internal body simulation using the standard body shape is deformed according to the body shape of the user.
In step S107, the user terminal 20 generates a 3D model in which the 3D model of the target garment is attached (i.e., synthesized) to the 3D model of the user. In step S108, the user terminal 20 displays a movie that causes the 3D model of the user to perform a predetermined motion. That is, the user terminal 20 may display or reproduce a movie in which the 3D model of the target garment is worn on the 3D model of the user and a predetermined motion is made, without simulating the 3D model of the user to make the predetermined motion on the 3D model of the user without the user himself wearing the 3D model of the target garment.
As described above, according to the present embodiment, for example, in a service for electronic commerce for providing clothing, a simulation result can be displayed more quickly using less computer resources than a service in which a user terminal itself performs a simulation for causing a 3D model of a user to perform a predetermined motion while the 3D model of the user wears a target clothing on the 3D model of the user.
3. Modified examples
The present invention is not limited to the above-described embodiments, and various modifications may be made. Some modifications will be described below. Two or more items described in the following modifications may be combined.
3-1, simulation
The specific contents of the simulation performed while wearing the 3D model of the target garment on the 3D model of the internal body of the standard body shape are not limited to the examples described in the embodiments. That is, the simulation is not limited to a simulation in which the 3D model of the inner body of the standard body shape is caused to perform a predetermined motion while wearing the 3D model of the target garment. In one embodiment, the 3D model of the internal volume may remain stationary at a predetermined pose. Even if the 3D model of the inner body remains stationary, the garment is not a fixed shape regardless of the inner body. The garment deforms according to the shape of the inner body or warps by hanging the ends by gravitational attraction. Even if the inner body is stationary, it is meaningful because the way the ends buckle or sag can be visually indicated by simulation. It should be noted that although the shape of the garment is changed from a normal state (a state of not being inside the inner body) of the 3D model of the garment to a state of being attached to the inner body in a rest state, such a change is an example of "movement" of the garment.
In another example, the simulation may indicate a relative position between a predetermined portion of the garment and a predetermined portion of the user's body, where the target garment is worn on the 3D model of the user and has a predetermined pose. For example, the predetermined posture may be a sitting posture on a chair, the predetermined portion of the garment may be a skirt of pants, and the predetermined portion of the user's body may be an ankle. The simulation result is, for example, an enlarged view of the appearance of the part in the 3D model, i.e., the appearance of the part near the ankle of the user. Alternatively, the simulation result may be numerical data indicating the relative positional relationship (i.e., the distance between the ankle of the user and the skirt of the pants of the target garment).
3-2, internal body movements and gestures
In the database 111, a plurality of intrabody motions may be defined. For example, in database 111, walking, running, jumping, turning arms, and sitting on a chair are defined. The server 10 simulates each of a plurality of motions. The server 10 records the simulation results of the plurality of movements in the database 111. In response to the transmission request from the user terminal 20, the server 10 transmits the simulation results of the plurality of motions to the user terminal 20. Alternatively, the transmission request may include identification information specifying a part of the plurality of motions, and the server 10 may transmit the simulation result of the motion specified by the identification information to the user terminal 20. The identification information may directly specify the motion, or may indirectly specify the motion. The identification information indirectly specifying the motion is, for example, user identification information. In this example, database 112 records the identity of each user's preferred motion. The server 10 refers to the database 112 and identifies the motion of the user preference indicated by the user identification information included in the transmission request. The server 10 transmits the simulation result of the recognized motion to the user terminal 20. In the same manner, in the case where the simulation is performed in a state where the internal body is in a stationary posture with no motion, a plurality of postures are defined in the database 111.
In another example, the motion of the inner body can be defined for each garment. That is, for each garment, a motion for simulation may be defined. For example, for sportswear, running and jumping motions are defined as motions for simulation, while for western-style clothes, walking and sitting motions are defined as motions for simulation. These motions may be uniquely defined for each garment, or may be selected from a plurality of motions prepared in advance to be suitable for the garment. These are similar for gestures.
In yet another example, the server 10 may automatically select a portion of the plurality of motions and transmit the simulation result to the user terminal 20 using the selected motion.
Fig. 6 exemplarily shows a functional configuration of the server 10 according to the modification. The server 10 has selection means 16. The selection means 16 automatically selects some movements from among said plurality of movements. In one example, the selection unit 16 selects the motion based on not only the browsing history of the simulation results of the user terminal 20 that has transmitted the transmission request to be processed, but also browsing histories of the simulation results of other users of the information processing system 1. In this case, the server 10 records the history of the user viewing the simulation results. The server 10 uses this browsing history to estimate the preferred motion of the target garment. An analysis of the browsing history reveals, for example, that the simulation results of running movements and jumping movements are frequently browsed for sportswear, and the simulation results of walking movements and sitting movements on a chair are frequently browsed for western-style clothes. Machine learning may be used for these analyses. For example, machine learning is performed by providing identification information of attributes and motions of clothing to an input layer of a machine learning model and providing data of a frequency at which simulation results of clothing and motions are regarded as teaching data to an output layer. The server 10 uses the machine learning model so learned to predict movements that the user may prefer (and is expected to be viewed frequently) in the target apparel.
In another example, the selection means 16 selects the movement based on an attribute of the user terminal 20 that sent the pending send request. Analysis of the browsing history of the entire plurality of users reveals that, for example, young female users frequently browse the results of simulation of walking exercise, and middle-aged males frequently browse the results of simulation of exercise sitting on a chair. Machine learning may be used for these analyses. For example, machine learning is performed by giving the attribute and motion recognition information of the user to an input layer of a machine learning model and giving data of the frequency at which the user browses simulation results of motion to an output layer as teaching data. The server 10 uses the machine learning model so learned to predict the movements that the user may like (expected to be viewed frequently) in the target garment. The same applies to the posture of the internal body.
3-3, triggering
The triggering of the simulation is not limited to the examples described in the embodiments. For example, the server 10 may perform a simulation when defining a new motion. In this example, the obtaining means 13 obtains movement information describing the new movement performed by the internal body. In one example, the obtaining means 13 obtains motion information from the user terminal 20. In this embodiment, the user terminal 20 has a function of editing or creating motion for making a 3D model of a human body, and generates new motion information according to a user's instruction. The user terminal 20 transmits a transmission request including new motion information to the server 10. When the obtaining means 13 obtains new motion information, the simulation means 18 requests the simulation means 18 to perform a simulation in which the 3D model of the inner body of the standard body shape wearing the target garment is caused to perform a new motion. The simulation means 18 performs the simulation according to the request. When the simulation is completed, the transmission means 15 transmits the simulation result to the user terminal 20. When the simulation of the new motion of the target garment is completed, the simulation device 18 simulates the new motion of another garment. For example, the target garment to be simulated is attached by the user of the user terminal 20. Alternatively, the server 10 may predict the garment that the user may next request for simulation results, i.e., the garment that the user may next select, and may perform a new motion simulation on the predicted garment.
3-4, other examples
The hardware configuration of the information processing system 1 is not limited to the hardware configuration illustrated in the embodiment. The information processing system 1 may have a hardware configuration that can realize the required functions. For example, a plurality of physically cooperating devices may act as the server 10. The server 10 may be a physical server or a virtual server (including a so-called cloud). In addition, the correspondence relationship between the functional elements and the hardware is not limited to the relationship shown in the embodiments. For example, at least some of the functions described in the embodiments as being implemented in the server 10 may be implemented in the user terminal 20. Specifically, at least one of database 111 and database 112 may be implemented in a server apparatus separate from server 10. Database 111 may be integrated with database 112 or portions thereof may be further subdivided. In addition, some of the functional elements shown in fig. 2 may be omitted.
The program executed by the CPU101 or the like may be provided by being downloaded via a network such as the internet, or may be provided in a state of being recorded on a computer-readable non-transitory recording medium such as a DVD-ROM.

Claims (11)

1. An information processing apparatus comprising:
an access device that accesses a database in which 3D modeling data of a plurality of garments and a simulation result of a motion of the garment when the 3D modeling data of an inner body wearing the garment performs a predetermined motion are recorded for each of the garments;
an obtaining means that obtains, from a user terminal, a search keyword for searching for a garment from the plurality of garments and body shape information related to a body shape of the user;
extracting means that extracts a simulation result corresponding to the clothing specified by the search keyword and the body shape information from the database; and
a transmitting device that transmits the extracted simulation result to the user terminal.
2. The information processing apparatus according to claim 1, wherein
The database includes, for each of the plurality of garments, a simulation result of a motion of the garment while the garment is worn by each of a plurality of 3D modeling data of an inner body, and
the extracting means extracts a simulation result of a predetermined motion of the garment when the garment is worn on the 3D modeling data of an inner body having a body shape that is least different from the body shape indicated by the body shape information among the plurality of inner bodies from the database.
3. The information processing apparatus according to claim 1 or 2, wherein
The simulation results include changes in the shape of the garment over time.
4. The information processing apparatus according to any one of claims 1 to 3, wherein
The simulation result includes a relative positional relationship between a predetermined portion of the garment and a predetermined portion of the user's body.
5. The information processing apparatus according to any one of claims 1 to 4, wherein
The predetermined movement comprises a plurality of different movements,
the extraction means extracts, from the database, simulation results corresponding to the clothing specified by the search keyword, the body shape information, and a motion selected from the plurality of motions.
6. The information processing apparatus according to claim 5, wherein
The obtaining means obtains identification information specifying at least a part of the plurality of motions,
the extraction means extracts a simulation result corresponding to the motion specified by the identification information.
7. The information processing apparatus according to claim 5, further comprising:
a selection device that selects at least a part of the plurality of motions according to the clothing specified by the search keyword, wherein
The extracting means extracts the simulation result corresponding to the motion selected by the selecting means.
8. The information processing apparatus according to any one of claims 1 to 7, wherein
The obtaining means obtains motion information describing a new motion to be performed by the internal body from the user terminal,
the information processing apparatus further includes:
simulation means that simulates a motion of the garment when the new motion described by the motion information is performed while the 3D modeling data of the internal body corresponding to the body shape information is worn by the garment, the garment being specified by the search keyword,
upon completion of the simulation, the transmission means transmits the simulation result,
the simulation means simulates the movement of the garment when the 3D modeling data of the inner body corresponding to the body shape information performs the new movement described by the movement information, and causes the 3D modeling data of the inner body to wear another garment different from the garment after the simulation result of the new movement is transmitted.
9. A 3D system, comprising:
a server; and
user terminal of which
The server includes:
an access device that accesses a database in which 3D modeling data of a plurality of garments and a simulation result of a motion of the garment when the 3D modeling data of an inner body wearing the garment performs a predetermined motion are recorded for each of the garments;
an obtaining means that obtains, from a user terminal, a search keyword for searching for a garment from the plurality of garments and body shape information related to a body shape of the user;
extracting means that extracts a simulation result corresponding to the clothing specified by the search keyword and the body shape information from the database; and
a transmitting means that transmits the extracted simulation result to the user terminal,
the user terminal includes:
a display device that displays a movie generated using the 3D modeling data of the garment and the simulation result, the movie showing the 3D model of the user wearing the garment and performing the predetermined motion.
10. The 3D system of claim 9, wherein
The display device displays the movie showing the 3D model of the user wearing the garment, the 3D modeling data of the garment being deformed based on a body shape difference between the 3D modeling data of the inner body and the 3D modeling data of the user.
11. An information processing method comprising:
accessing a database in which 3D modeling data of a plurality of garments and a simulation result of a motion of the garment when the 3D modeling data of an inner body wearing the garment performs a predetermined motion are recorded for each of the garments;
obtaining a search keyword for searching for a garment from the plurality of garments and body shape information related to a body shape of the user from the user terminal;
extracting a simulation result corresponding to the clothing specified by the search keyword and the body shape information from the database; and
and sending the extracted simulation result to the user terminal.
CN202180005716.9A 2021-06-22 2021-06-22 Information processing apparatus, 3D system, and information processing method Active CN114556332B (en)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/JP2021/023541 WO2022269741A1 (en) 2021-06-22 2021-06-22 Information processing device, 3d system, and information processing method

Publications (2)

Publication Number Publication Date
CN114556332A true CN114556332A (en) 2022-05-27
CN114556332B CN114556332B (en) 2022-11-11

Family

ID=81079695

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202180005716.9A Active CN114556332B (en) 2021-06-22 2021-06-22 Information processing apparatus, 3D system, and information processing method

Country Status (3)

Country Link
JP (2) JP7023558B1 (en)
CN (1) CN114556332B (en)
WO (1) WO2022269741A1 (en)

Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2002024319A (en) * 2000-07-04 2002-01-25 Toyobo Co Ltd Try-on image generation system
JP5605885B1 (en) * 2014-02-27 2014-10-15 木下 泰男 Virtual try-on system and virtual try-on program
US20150279098A1 (en) * 2014-03-27 2015-10-01 Electronics And Telecommunications Research Institute Smart device and virtual experience providing server providing virtual experience service method using digitalexperience service method using digital clothes
JP2015180987A (en) * 2014-03-03 2015-10-15 株式会社東芝 Image processing apparatus, image processing system, image processing method, and program
US20160155186A1 (en) * 2014-12-01 2016-06-02 Ebay Inc. Digital wardrobe
JP2017004464A (en) * 2015-06-16 2017-01-05 株式会社東芝 Image processor, image processing system, image processing method and program
CN107578323A (en) * 2017-10-10 2018-01-12 中国科学院合肥物质科学研究院 The three-dimensional online virtual fitting system of real human body
CN109003168A (en) * 2018-08-16 2018-12-14 深圳Tcl数字技术有限公司 Virtual fit method, smart television and computer readable storage medium
CN109523345A (en) * 2018-10-18 2019-03-26 河海大学常州校区 WebGL virtual fitting system and method based on virtual reality technology
JP6631988B1 (en) * 2018-07-02 2020-01-15 株式会社ブルームスキーム Virtual fitting device, virtual fitting method, and virtual fitting program
JP6804125B1 (en) * 2020-07-27 2020-12-23 株式会社Vrc 3D data system and 3D data generation method

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2009128997A (en) * 2007-11-20 2009-06-11 Fujifilm Corp Clothing image display device and clothing image display method
JP2013190974A (en) * 2012-03-13 2013-09-26 Satoru Ichimura Information processing apparatus, information processing method, and program
JP6338966B2 (en) * 2014-08-08 2018-06-06 株式会社東芝 Virtual try-on device, virtual try-on system, virtual try-on method, and program
JP2020170394A (en) * 2019-04-04 2020-10-15 株式会社Sapeet Clothing-wearing visualization system and clothing-wearing visualization method

Patent Citations (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2002024319A (en) * 2000-07-04 2002-01-25 Toyobo Co Ltd Try-on image generation system
JP5605885B1 (en) * 2014-02-27 2014-10-15 木下 泰男 Virtual try-on system and virtual try-on program
JP2015180987A (en) * 2014-03-03 2015-10-15 株式会社東芝 Image processing apparatus, image processing system, image processing method, and program
US20150279098A1 (en) * 2014-03-27 2015-10-01 Electronics And Telecommunications Research Institute Smart device and virtual experience providing server providing virtual experience service method using digitalexperience service method using digital clothes
US20160155186A1 (en) * 2014-12-01 2016-06-02 Ebay Inc. Digital wardrobe
JP2017004464A (en) * 2015-06-16 2017-01-05 株式会社東芝 Image processor, image processing system, image processing method and program
CN107578323A (en) * 2017-10-10 2018-01-12 中国科学院合肥物质科学研究院 The three-dimensional online virtual fitting system of real human body
JP6631988B1 (en) * 2018-07-02 2020-01-15 株式会社ブルームスキーム Virtual fitting device, virtual fitting method, and virtual fitting program
CN109003168A (en) * 2018-08-16 2018-12-14 深圳Tcl数字技术有限公司 Virtual fit method, smart television and computer readable storage medium
CN109523345A (en) * 2018-10-18 2019-03-26 河海大学常州校区 WebGL virtual fitting system and method based on virtual reality technology
JP6804125B1 (en) * 2020-07-27 2020-12-23 株式会社Vrc 3D data system and 3D data generation method

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
张裕文: "三维虚拟服装建模与试衣算法研究", 《中国优秀硕士学位论文全文数据库(信息科技辑)》 *
杨思: "三维服装建模及其虚拟试衣应用", 《中国优秀硕士学位论文全文数据库(工程科技Ⅰ辑)》 *

Also Published As

Publication number Publication date
JPWO2022269741A1 (en) 2022-12-29
CN114556332B (en) 2022-11-11
JP2023002440A (en) 2023-01-10
JP7023558B1 (en) 2022-02-22
WO2022269741A1 (en) 2022-12-29

Similar Documents

Publication Publication Date Title
KR101775327B1 (en) Method and program for providing virtual fitting service
CN107924532A (en) Method and apparatus for the description for providing dress form
US20220258049A1 (en) System and method for real-time calibration of virtual apparel using stateful neural network inferences and interactive body measurements
CN105956912A (en) Method for realizing network fitting
WO2020203656A1 (en) Information processing device, information processing method, and program
JP6242768B2 (en) Virtual try-on device, virtual try-on method, and program
JP6320237B2 (en) Virtual try-on device, virtual try-on method, and program
JP6338966B2 (en) Virtual try-on device, virtual try-on system, virtual try-on method, and program
JP2016038811A (en) Virtual try-on apparatus, virtual try-on method and program
US20210326955A1 (en) Generation of Improved Clothing Models
Jevšnik et al. 3D virtual prototyping of garments: approaches, developments and challenges
JP6262105B2 (en) Image processing apparatus, image processing system, image processing method, and program
Vitali et al. Acquisition of customer’s tailor measurements for 3D clothing design using virtual reality devices
Gupta New directions in the field of anthropometry, sizing and clothing fit
KR102530461B1 (en) System for providing virtual cloth fitting service using three-dimensional avatar
JP7039094B1 (en) Information processing equipment, information processing methods, and programs
JP2018106736A (en) Virtual try-on apparatus, virtual try-on method and program
Zong et al. An exploratory study of integrative approach between 3D body scanning technology and motion capture systems in the apparel industry
CN114556332B (en) Information processing apparatus, 3D system, and information processing method
WO2022081745A1 (en) Real-time rendering of 3d wearable articles on human bodies for camera-supported computing devices
KR20210130420A (en) System for smart three dimensional garment fitting and the method for providing garment fitting service using there of
TWI822476B (en) Information processing equipment, information processing method, information processing system, and program
JP7418677B1 (en) Information processing system, information processing method, and information processing program
Viziteu et al. Development of climbing clothes using computerized 3D clothing simulation
CN113837835B (en) Role model-based wearable product display method and device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant