TW202322058A - Information processing equipment, information processing method, information processing system, and program - Google Patents

Information processing equipment, information processing method, information processing system, and program Download PDF

Info

Publication number
TW202322058A
TW202322058A TW111144460A TW111144460A TW202322058A TW 202322058 A TW202322058 A TW 202322058A TW 111144460 A TW111144460 A TW 111144460A TW 111144460 A TW111144460 A TW 111144460A TW 202322058 A TW202322058 A TW 202322058A
Authority
TW
Taiwan
Prior art keywords
information
model
clothing
user
action
Prior art date
Application number
TW111144460A
Other languages
Chinese (zh)
Other versions
TWI822476B (en
Inventor
謝英弟
井口道久
張彥鵬
許夢璇
劉雨佳
Original Assignee
日商威亞視股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 日商威亞視股份有限公司 filed Critical 日商威亞視股份有限公司
Publication of TW202322058A publication Critical patent/TW202322058A/en
Application granted granted Critical
Publication of TWI822476B publication Critical patent/TWI822476B/en

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00Commerce
    • G06Q30/06Buying, selling or leasing transactions
    • G06Q30/0601Electronic shopping [e-shopping]
    • G06Q30/0641Shopping interfaces
    • G06Q30/0643Graphical representation of items or shoppers
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00Commerce
    • G06Q30/06Buying, selling or leasing transactions
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00Manipulating 3D models or images for computer graphics
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2210/00Indexing scheme for image generation or computer graphics
    • G06T2210/16Cloth

Abstract

An information processing equipment, an information processing method, an information processing system, and a program are provided, wherein the information processing equipment includes: a 3D model obtaining device for obtaining a 3D model of a body wearing clothing; a target information obtaining device for obtaining at least one of target information related to the clothing and the body; a display device for displaying the 3D model in a virtual space; a receiving device for receiving a input of a command of a motion to instruct a user in the virtual space; and a feedback device for feeding feedback information back to a 3D model providing device corresponded to a goal, wherein the feedback information includes: target information and motion information. The motion information indicates the motion of the user when the display device display the 3D model.

Description

資訊處理設備、資訊處理方法、資訊處理系統以及程式Information processing equipment, information processing method, information processing system and program

本發明涉及一種用於從多個服裝物項中選擇適合於用戶偏好的服裝的技術。The present invention relates to a technique for selecting clothing suited to a user's preferences from a plurality of clothing items.

與虛擬試衣相關的技術是已知的。例如,專利文獻1公開了一種虛擬試衣系統,所述虛擬試衣系統提供已試穿所期望服裝的使用者的圖像。Technologies related to virtual fittings are known. For example, Patent Document 1 discloses a virtual fitting system that provides an image of a user who has tried on desired clothing.

[專利文獻]專利文獻1:JP 2019-144890。[Patent Document] Patent Document 1: JP 2019-144890.

[發明所要解決的問題][Problem to be Solved by the Invention]

儘管虛擬試衣包括各種元素,然而在專利文獻1中描述的虛擬試衣系統中,難以獲得關於使用者在虛擬試衣期間的動作的資訊反饋。Although virtual fitting includes various elements, in the virtual fitting system described in Patent Document 1, it is difficult to obtain information feedback on the user's actions during the virtual fitting.

相比之下,本發明提供了一種便於在虛擬試衣期間獲得關於使用者的動作的資訊反饋的技術。In contrast, the present invention provides a technique that facilitates obtaining informational feedback about a user's actions during a virtual fitting.

[解决方案][solution]

本公開的一個方面提供一種資訊處理設備,所述資訊處理設備包括:3D模型獲得裝置,所述3D模型獲得裝置從3D模型提供裝置獲得穿著服裝的軀體的3D模型;目標資訊獲得裝置,所述目標資訊獲得裝置獲得關於服裝及所述軀體中的至少一者的目標資訊;顯示裝置,所述顯示裝置在虛擬空間中顯示所述3D模型;接收裝置,所述接收裝置接收指示使用者在所述虛擬空間中的動作的指令的輸入;以及反饋裝置,所述反饋裝置將反饋資訊反饋回到與所述3D模型提供裝置對應的目的地,所述反饋資訊包括目標資訊和動作資訊,所述動作資訊指示在所述顯示裝置顯示3D模型時所述使用者的動作。One aspect of the present disclosure provides an information processing device, the information processing device includes: a 3D model obtaining device, the 3D model obtaining device obtains a 3D model of a body wearing clothing from a 3D model providing device; a target information obtaining device, the A target information obtaining device obtains target information about at least one of the clothing and the body; a display device that displays the 3D model in a virtual space; a receiving device that receives instructions indicating that the user is in the input of an action instruction in the virtual space; and a feedback device, the feedback device feeds feedback information back to the destination corresponding to the 3D model providing device, the feedback information includes target information and action information, the The motion information indicates the user's motion when the display device displays the 3D model.

所述動作資訊可包括關於在所述虛擬空間中顯示3D模型時的視點位置的資訊。The motion information may include information on a viewpoint position when a 3D model is displayed in the virtual space.

所述動作資訊可包括關於在穿著所述服裝的狀態下穿著所述服裝的所述軀體的運動的資訊。The motion information may include information on motion of the body wearing the garment while wearing the garment.

所述運動資訊可包括關於從多個預定義的運動中選擇的運動的資訊。The sport information may include information about a sport selected from a plurality of predefined sports.

所述動作資訊可包括所述軀體在預定時間段內已穿著所述服裝的次數。The motion information may include the number of times the body has worn the garment within a predetermined period of time.

所述動作信可息包括關於所述3D模型被查看的時間長度的資訊。The action information may include information about the length of time the 3D model was viewed.

所述動作資訊可包括關於針對所述服裝輸入的使用者偏好的資訊。The action information may include information about user preferences entered for the garment.

所述動作資訊可包括關於對所述服裝的購買動作的資訊。The action information may include information on purchase actions for the garment.

所述目標資訊可包括關於所述軀體與所述服裝之間的形狀或尺寸的差異的資訊。The target information may include information about differences in shape or size between the body and the garment.

所述目標資訊可包括關於當所述軀體穿著所述服裝時施加在所述軀體上的壓力或者所述服裝中產生的張力的資訊。The target information may include information about pressure exerted on the body when the body is wearing the garment or tension generated in the garment.

所述目標資訊可包括關於服裝材料的資訊。The target information may include information about clothing materials.

所述目標資訊可包括關於用於在所述虛擬空間中顯示3D模型的背景的資訊。The object information may include information about a background for displaying a 3D model in the virtual space.

所述反饋資訊可包括在獲得所述動作資訊時的公眾趨勢的趨勢資訊。The feedback information may include trend information of public trends when the action information is obtained.

所述3D模型獲得裝置可獲得穿著基於以往獲得的所述反饋資訊選擇的服裝的3D模型。The 3D model obtaining means may obtain a 3D model of clothing selected based on the previously obtained feedback information.

本公開的另一方面提供一種資訊處理系統,所述資訊處理系統包括:伺服器;以及資訊處理設備,其中所述伺服器包括3D模型提供裝置,所述3D模型提供裝置提供穿著服裝的軀體的3D模型,所述資訊處理設備包括:3D模型獲得裝置,所述3D模型獲得裝置從3D模型提供裝置獲得穿著所述服裝的所述軀體的3D模型;目標資訊獲得裝置,所述目標資訊獲得裝置獲得關於服裝及所述軀體中的至少一者的目標資訊;顯示裝置,所述顯示裝置在虛擬空間中顯示所述3D模型;接收裝置,所述接收裝置接收指示使用者在所述虛擬空間中的動作的指令的輸入;以及反饋裝置,所述反饋裝置將反饋資訊反饋回到與3D模型提供裝置對應的目的地,所述反饋資訊包括目標資訊和動作資訊,所述動作資訊指示在所述顯示裝置顯示所述3D模型時所述使用者的動作。Another aspect of the present disclosure provides an information processing system, the information processing system includes: a server; and an information processing device, wherein the server includes a 3D model providing device, and the 3D model providing device provides a body wearing clothing 3D model, the information processing equipment includes: a 3D model obtaining device, the 3D model obtaining device obtains a 3D model of the body wearing the clothing from a 3D model providing device; a target information obtaining device, the target information obtaining device Obtaining target information about at least one of the clothing and the body; a display device that displays the 3D model in a virtual space; a receiving device that receives instructions indicating that the user is in the virtual space The input of the command of the action; and the feedback device, the feedback device feeds back the feedback information to the destination corresponding to the 3D model providing device, the feedback information includes target information and action information, and the action information indicates that in the The actions of the user when the display device displays the 3D model.

本公開的又一方面提供一種致使電腦執行處理的程式,所述處理包括:從3D模型提供裝置獲得穿著服裝的軀體的3D模型;獲得關於所述服裝及所述軀體中的至少一者的目標資訊;在虛擬空間中顯示所述3D模型;接收指示使用者在所述虛擬空間中的動作的指令的輸入;以及將反饋資訊反饋回到與所述3D模型提供裝置對應的目的地,所述反饋資訊包括所述目標資訊和動作資訊,所述動作資訊指示在顯示所述3D模型時所述使用者的動作。Still another aspect of the present disclosure provides a program for causing a computer to execute processing including: obtaining a 3D model of a body wearing a garment from a 3D model providing device; obtaining an object related to at least one of the clothing and the body information; displaying the 3D model in a virtual space; receiving an input indicating a user's action in the virtual space; and feeding feedback information back to a destination corresponding to the 3D model providing device, the The feedback information includes the target information and action information indicating the user's action when displaying the 3D model.

本公開的又一方面提供一種資訊處理方法,所述資訊處理方法包括:從3D模型提供裝置獲得穿著服裝的軀體的3D模型;獲得關於所述服裝及所述軀體中的至少一者的目標資訊;在虛擬空間中顯示所述03D模型;接收指示使用者在所述虛擬空間中的動作的指令的輸入;以及將反饋資訊反饋回到與所述3D模型提供裝置對應的目的地,所述反饋資訊包括所述目標資訊和動作資訊,所述動作資訊指示在顯示3D模型時所述使用者的動作。Yet another aspect of the present disclosure provides an information processing method, the information processing method comprising: obtaining a 3D model of a body wearing clothing from a 3D model providing device; obtaining target information about at least one of the clothing and the body ; displaying the 03D model in a virtual space; receiving an input indicating an action of a user in the virtual space; and feeding back feedback information to a destination corresponding to the 3D model providing device, the feedback The information includes the target information and action information, and the action information indicates the action of the user when displaying the 3D model.

[發明的有利效果][Advantageous Effects of the Invention]

根據本實施例,由於包括目標資訊和動作資訊的反饋資訊被反饋回到與3D模型提供裝置對應的目的地,因此3D模型提供裝置可提供穿著適合於使用者偏好的服裝的軀體的3D模型。因此,當存在許多服裝要進行虛擬試衣時,使用者從所述服裝中選擇適合他/她的偏好的服裝會變得容易。According to the present embodiment, since the feedback information including target information and action information is fed back to the destination corresponding to the 3D model providing device, the 3D model providing device can provide a 3D model of the body wearing clothes suitable for the user's preference. Therefore, when there are many clothes to be virtually tried on, it becomes easy for the user to select clothes that suit his/her preference from among the clothes.

1、配置1. Configuration

圖1是示出虛擬試衣系統1的功能配置的圖,虛擬試衣系統1是本公開的資訊處理系統的實施例。虛擬試衣系統1是提供關於服裝的資訊的系統,且更具體來說虛擬試衣系統1是輸出關於執行其中服裝的3D模型被穿在人體的3D模型上的類比的結果的資訊的系統。在一個示例中,虛擬試衣系統1用於從多件服裝之中搜索符合使用者偏好的服裝。3D模型是表示物件在虛擬空間中的三維形狀的三維虛擬物件。FIG. 1 is a diagram showing a functional configuration of a virtual fitting system 1 which is an embodiment of the information processing system of the present disclosure. The virtual fitting system 1 is a system that provides information on clothing, and more specifically, the virtual fitting system 1 is a system that outputs information on a result of performing an analogy in which a 3D model of clothing is worn on a 3D model of a human body. In one example, the virtual fitting system 1 is used to search for a clothing that meets the user's preference from among multiple pieces of clothing. A 3D model is a three-dimensional virtual object representing the three-dimensional shape of the object in a virtual space.

虛擬試衣系統1提供服裝搜索服務。虛擬試衣系統1包括作為硬體的伺服器20和使用者終端10。伺服器20與使用者終端10經由網路300連接。伺服器20是在服裝檢索服務中充當伺服器的電腦。使用者終端10是根據本公開的資訊處理設備的示例並且是在服裝搜索服務中用作客戶端的電腦。儘管在圖1中示出一個使用者終端10,然而可提供多個使用者終端10。The virtual fitting system 1 provides clothing search service. The virtual fitting system 1 includes a server 20 and a user terminal 10 as hardware. The server 20 is connected to the user terminal 10 via the network 300 . The server 20 is a computer serving as a server in the clothing search service. The user terminal 10 is an example of an information processing device according to the present disclosure and is a computer used as a client in the clothing search service. Although one user terminal 10 is shown in FIG. 1, a plurality of user terminals 10 may be provided.

圖2是示出虛擬試衣系統1的功能配置的方塊圖。虛擬試衣系統1包括3D模型獲得裝置11、目標資訊獲得裝置12、接收裝置13、顯示裝置14、反饋裝置15、動作資訊獲得裝置16、儲存裝置17、控制裝置19、3D模型提供裝置21、分析裝置22、儲存裝置23及控制裝置29。在本實施例中,3D模型獲得裝置11、目標資訊獲得裝置12、接收裝置13、顯示裝置14、反饋裝置15、儲存裝置17及控制裝置19在使用者終端10中實施。3D模型提供裝置21、分析裝置22、儲存裝置23及控制裝置29在伺服器20中實施。FIG. 2 is a block diagram showing the functional configuration of the virtual fitting system 1 . The virtual fitting system 1 includes a 3D model obtaining device 11, a target information obtaining device 12, a receiving device 13, a display device 14, a feedback device 15, an action information obtaining device 16, a storage device 17, a control device 19, a 3D model providing device 21, Analysis device 22 , storage device 23 and control device 29 . In this embodiment, the 3D model obtaining device 11 , the object information obtaining device 12 , the receiving device 13 , the display device 14 , the feedback device 15 , the storage device 17 and the control device 19 are implemented in the user terminal 10 . The 3D model providing device 21 , analyzing device 22 , storage device 23 and control device 29 are implemented in the server 20 .

3D模型提供裝置21向使用者終端10提供3D模型。3D模型提供裝置21儲存服裝模型DB 211和使用者模型DB 212。服裝模型DB 211是儲存關於多件服裝的資訊的DB。關於服裝的資訊包括表示服裝的三維形狀的3D模型。使用者模型DB是儲存關於多個使用者的資訊的DB。使用者資訊包括表示使用者的人體的三維形狀的3D模型。3D模型提供裝置21利用服裝模型DB 211及使用者模型DB 212來檢索適合於使用者終端10的使用者的服裝並向使用者終端10提供所述服裝的3D模型。3D模型提供裝置21使用服裝模型DB 211和使用者模型DB 212對穿著所期望服裝的人體(使用者終端10的使用者的人體)的3D的模型進行合成(即,虛擬試衣)並將所合成的模型提供給使用者終端10。The 3D model providing device 21 provides the 3D model to the user terminal 10 . The 3D model providing device 21 stores a clothing model DB 211 and a user model DB 212 . The clothing model DB 211 is a DB that stores information on a plurality of clothing. The information about the garment includes a 3D model representing the three-dimensional shape of the garment. The user profile DB is a DB that stores information on a plurality of users. The user information includes a 3D model representing the three-dimensional shape of the user's human body. The 3D model providing device 21 retrieves clothing suitable for the user of the user terminal 10 using the clothing model DB 211 and the user model DB 212 and provides the 3D model of the clothing to the user terminal 10 . The 3D model providing device 21 uses the clothing model DB 211 and the user model DB 212 to synthesize a 3D model of the human body (the human body of the user of the user terminal 10) wearing the desired clothing (that is, virtual fitting) and The synthesized model is provided to the user terminal 10 .

3D模型獲得裝置11從3D模型提供裝置21獲得服裝或穿著服裝的人體(例如,使用者終端10的使用者的人體)的3D模型。The 3D model obtaining means 11 obtains a 3D model of clothing or a human body wearing the clothing (for example, the human body of the user of the user terminal 10 ) from the 3D model providing means 21 .

目標資訊獲得裝置12基於由3D模型獲得裝置11獲得的3D模型獲得關於服裝及人體中的至少一者的目標資訊。在一個示例中,目標資訊包括關於當服裝被穿在人體上時人體的3D模型和服裝的3D模型的特定部位(例如,臀部和/或頸部)的尺寸差異的資訊。目標資訊還包括當服裝被穿在人體上時施加在人體的特定部位(例如,兩臂和/或胸部)上的壓力的資訊或者施加在服裝上的張力的資訊。可以壓力圖或張力圖的形式提供關於壓力或張力的資訊。目標資訊還包括關於服裝材料的資訊(例如,諸如棉、聚酯、絲等材料或者諸如摩擦係數等參數)。目標資訊還包括關於在虛擬空間中顯示3D模型的背景的資訊(例如,山脈、海洋、街道、住宅等)。The object information obtaining means 12 obtains object information on at least one of clothing and a human body based on the 3D model obtained by the 3D model obtaining means 11 . In one example, the target information includes information about the difference in size of specific parts (eg, hips and/or neck) of the 3D model of the human body and the 3D model of the garment when the garment is worn on the human body. Target information also includes information on pressure exerted on specific parts of the human body (eg, arms and/or chest) or information on tension applied to the garment when the garment is worn on the human body. Information about pressure or tension can be provided in the form of a pressure map or tension map. The target information also includes information about clothing materials (eg, materials such as cotton, polyester, silk, or parameters such as coefficient of friction). The target information also includes information on the background (for example, mountains, seas, streets, houses, etc.) in which the 3D model is displayed in the virtual space.

接收裝置13接收指示使用者的動作的指令的輸入。顯示裝置14是由3D模型獲得裝置11獲得的3D模型(即,服裝的3D模型或穿著服裝的人體的3D模型)並且在虛擬空間中顯示3D模型。顯示裝置14可根據由接收裝置13接收的指令來改變正在顯示的3D模型的外觀或運動。The receiving device 13 receives an input of a command indicating a user's action. The display device 14 is a 3D model (ie, a 3D model of clothing or a 3D model of a human body wearing the clothing) obtained by the 3D model obtaining device 11 and displays the 3D model in a virtual space. The display device 14 may change the appearance or movement of the 3D model being displayed according to the instructions received by the receiving device 13 .

反饋裝置15將反饋資訊輸出到與3D模型提供裝置21對應的目的地,具體來說輸出到分析裝置22。反饋資訊包括目標資訊和動作資訊。此處,動作資訊包括操作使用者終端10的使用者的動作資訊和使用者(人體)在虛擬空間中的動作資訊。The feedback device 15 outputs the feedback information to the destination corresponding to the 3D model providing device 21 , specifically to the analyzing device 22 . The feedback information includes target information and action information. Here, the motion information includes motion information of the user operating the user terminal 10 and motion information of the user (human body) in the virtual space.

前者動作資訊的示例包括關於在虛擬空間中顯示3D模型時視點位置的資訊或者關於位置的移動歷史的資訊、關於查看3D模型的時間長度的資訊、關於使用者對服裝的偏好輸入的資訊(例如,“喜歡按鈕”等輸入)以及關於對服裝的購買動作的資訊(例如,是否購買所顯示的服裝)。Examples of the former action information include information on the position of the viewpoint when displaying the 3D model in the virtual space or information on the movement history of the position, information on the length of time for viewing the 3D model, information on the user's preference input for clothing (such as , "like button" etc. input) and information about purchase actions on apparel (eg, whether to purchase the displayed apparel).

另外,後者動作資訊包括關於使使用者(人體)穿著服裝的運動(例如,行走、跑步、舉手等)的資訊以及使用者(人體)在預定時間段期間已穿著服裝的次數、使用者(人體)在顯示期間已更換服裝的次數或者使用者已經服裝更換成其他服裝的次數。與使用者要進行的移動相關的資訊可為與從多個預定義的移動中選擇的移動相關的資訊。關於使用者(人體)要進行的運動的資訊可指定開始姿勢(例如,姿勢)和結束姿勢(例如,坐在椅子上的姿勢)。在虛擬試衣中,穿著服裝的使用者的3D模型從規定的開始姿勢移動到結束姿勢。In addition, the latter action information includes information on motions (for example, walking, running, raising hands, etc.) that cause the user (human body) to wear the garment and the number of times the user (human body) has worn the garment during a predetermined period of time, the user (human body) Human body) the number of times the clothing has been changed during the display period or the number of times the user has changed clothing to another clothing. The information related to the movement to be performed by the user may be information related to a movement selected from a plurality of predefined movements. Information about the movement to be performed by the user (human body) may specify a starting pose (eg, pose) and an ending pose (eg, pose sitting on a chair). During a virtual fitting, a 3D model of the user wearing the garment moves from a prescribed start pose to an end pose.

儲存裝置17儲存各種資料和程式。控制裝置19執行各種控制。The storage device 17 stores various data and programs. The control device 19 executes various controls.

分析裝置22對從一個或多個使用者終端10獲得的反饋資訊進行分析。分析裝置22儲存反饋資訊DB 221。反饋資訊DB 221是儲存來自執行服裝的虛擬試衣處理的使用者終端10的反饋資訊的DB。分析裝置22對反饋資訊DB 221進行分析且基於分析結果向例如3D模型提供裝置21提供用於增強3D模型提供裝置21搜索適合於使用者偏好的服裝的能力的資訊。The analysis device 22 analyzes the feedback information obtained from one or more user terminals 10 . The analysis device 22 stores the feedback information DB 221 . The feedback information DB 221 is a DB that stores feedback information from the user terminal 10 that executes the virtual fitting process of clothing. The analyzing device 22 analyzes the feedback information DB 221 and provides, for example, information for enhancing the ability of the 3D model providing device 21 to search for clothing suitable for the user's preference to the 3D model providing device 21 based on the analysis result.

儲存裝置23儲存各種資料和程式。控制裝置29執行各種控制。The storage device 23 stores various data and programs. The control device 29 executes various controls.

圖3是示出使用者終端10的硬體配置的方塊圖。使用者終端10是電腦設備(例如,智慧型電話或個人電腦),具有中央處理器(CPU)101、儲存器102、儲存器件103、通訊設備104、輸入裝置105及輸出設備106。CPU 101是以編程方式對使用者終端10的其他元件進行控制的處理器。儲存器102是當CPU 101執行程式時用作工作區域的主儲存設備。儲存器102包括例如隨機存取儲存器(RAM)。儲存器件103是用於儲存各種資料和程式的輔助儲存設備,包括例如傳統硬碟(HDD)或固態硬碟(SSD)。通訊設備104是根據預定通訊協定(例如,長期演進(LTE)、WiFi、乙太網等)與其他設備進行通訊的設備。輸入裝置105是用於向使用者終端10輸入資訊或指令的設備並且包括例如觸控式螢幕、鍵盤、按鈕及麥克風中的至少一者。輸出設備106是用於向使用者輸出資訊的設備並且包括例如顯示器和/或揚聲器。FIG. 3 is a block diagram showing the hardware configuration of the user terminal 10 . The user terminal 10 is a computer device (eg, a smart phone or a personal computer) having a central processing unit (CPU) 101 , a memory 102 , a storage device 103 , a communication device 104 , an input device 105 and an output device 106 . The CPU 101 is a processor for programmatically controlling other components of the user terminal 10 . The storage 102 is a main storage device used as a work area when the CPU 101 executes programs. The storage 102 includes, for example, random access memory (RAM). The storage device 103 is an auxiliary storage device for storing various data and programs, including, for example, a conventional hard disk (HDD) or solid state disk (SSD). The communication device 104 is a device that communicates with other devices according to a predetermined communication protocol (eg, Long Term Evolution (LTE), WiFi, Ethernet, etc.). The input device 105 is a device for inputting information or commands to the user terminal 10 and includes, for example, at least one of a touch screen, a keyboard, buttons, and a microphone. Output device 106 is a device for outputting information to a user and includes, for example, a display and/or a speaker.

在此示例中,儲存器件103安裝有執行服裝的虛擬試衣處理的應用程式(在下文中被稱為“客戶端程式”)。當CPU 101執行此客戶端程式時,實施圖2中所示的功能。當CPU 101執行客戶端程式時,CPU 101是3D模型獲得裝置11、目標資訊獲得裝置12、反饋裝置15及控制裝置19的示例,輸入裝置105是接收裝置13的示例,並且儲存器102及儲存器件103中的至少一者是儲存裝置17的示例。In this example, the storage device 103 is installed with an application program (hereinafter referred to as a “client program”) that executes virtual fitting processing of clothes. When the CPU 101 executes this client program, the functions shown in FIG. 2 are implemented. When the CPU 101 executes the client program, the CPU 101 is an example of the 3D model obtaining device 11, the object information obtaining device 12, the feedback device 15, and the control device 19, the input device 105 is an example of the receiving device 13, and the storage device 102 and the storage device At least one of the devices 103 is an example of a storage device 17 .

儘管未在圖中示出,然而伺服器20是具有CPU、儲存器、儲存器件及通訊介面(IF)的電腦設備。儲存器件儲存用於使電腦設備在虛擬試衣系統1中用作伺服器的程式(在下文中被稱為“伺服器程式”)。通過CPU執行伺服器程式,實施圖中所示的功能。當CPU執行伺服器程式時,CPU是3D模型提供裝置21、分析裝置22及控制裝置29的示例,並且儲存器及儲存器件中的至少一者是儲存裝置23的示例。Although not shown in the figure, the server 20 is a computer device having a CPU, a memory, a storage device, and a communication interface (IF). The storage device stores a program for causing the computer device to function as a server in the virtual fitting system 1 (hereinafter referred to as “server program”). The functions shown in the figure are implemented by executing the server program through the CPU. When the CPU executes the server program, the CPU is an example of the 3D model providing means 21 , the analysis means 22 and the control means 29 , and at least one of the memory and the storage device is an example of the storage means 23 .

2、操作2. Operation

圖4是示出虛擬試衣系統1的操作示例的時序圖。在此操作示例中,使用者終端10的3D模型獲得裝置11向伺服器20發送(在步驟S2中)服裝的搜索請求(或提取請求)。搜索請求包括用作對服裝進行提取或搜索的搜索關鍵字的資訊,即用於縮小服裝範圍的搜索條件。搜索關鍵字包括例如諸如使用者終端10的使用者的使用者ID、服裝類型、尺寸及價格區間等資訊。FIG. 4 is a sequence diagram showing an example of the operation of the virtual fitting system 1 . In this operation example, the 3D model obtaining means 11 of the user terminal 10 sends (in step S2 ) a search request (or extraction request) for clothing to the server 20 . The search request includes information used as a search key for extracting or searching for clothing, ie, search conditions for narrowing down clothing. The search keywords include, for example, information such as the user ID of the user of the user terminal 10 , clothing type, size, and price range.

當接收到搜索請求時,伺服器20的3D模型提供裝置21從記錄在服裝模型DB 211中的記錄中提取(在步驟S4中)符合搜索請求(或搜索條件)的服裝記錄。When a search request is received, the 3D model providing means 21 of the server 20 extracts (in step S4 ) clothing records matching the search request (or search condition) from records recorded in the clothing model DB 211 .

圖5是示出服裝模型DB 211的示例性配置的圖。服裝模型DB 211包括多個記錄。每一記錄對應於一件服裝。所述記錄包括服裝ID 211a、品牌211b、類型211c、尺寸211d、價格211e及3D模型211f。服裝ID 211a是唯一標識服裝的標識符。品牌211b指示服裝的品牌。類型211c指示服裝的類型,例如襯衫、夾克、裙子、褲子等。尺寸211d指示服裝的尺寸。價格211e指示服裝的價格。3D模型211f指示3D建模資料本身或服裝的3D建模資料的位置。應注意,本文中所示的資料僅是示例,並且除了這些資訊之外或代替這些資訊,服裝模型DB 211可包括諸如服裝顏色、服裝設計師、服裝製造商、服裝製造商、服裝品牌、服裝銷售年份、服裝生產地點、服裝銷售地點等資訊。FIG. 5 is a diagram showing an exemplary configuration of the clothing model DB 211 . The clothing model DB 211 includes a plurality of records. Each record corresponds to a garment. The records include Garment ID 211a, Brand 211b, Type 211c, Size 211d, Price 211e, and 3D Model 211f. The clothing ID 211a is an identifier for uniquely identifying clothing. Brand 211b indicates the brand of the garment. Type 211c indicates the type of clothing, such as shirt, jacket, skirt, pants, and the like. Dimension 211d indicates the size of the garment. Price 211e indicates the price of the garment. The 3D model 211f indicates the position of the 3D modeling material itself or the 3D modeling material of clothing. It should be noted that the data shown herein are examples only, and that in addition to or instead of these information, the clothing model DB 211 may include items such as clothing color, clothing designer, clothing manufacturer, clothing manufacturer, clothing brand, clothing Sales year, clothing production location, clothing sales location and other information.

在此實施例中,當從服裝模型DB 211提取服裝時,3D模型提供裝置21參考由分析裝置22提供的分析結果。3D模型提供裝置21響應於例如從使用者終端10接收到搜索請求而從分析裝置22獲得分析結果。分析結果包括(a)發出搜索請求的個人使用者的偏好以及(b)利用虛擬試衣系統1的多個使用者的偏好中的至少一者。此分析的結果將在稍後進行描述。In this embodiment, when extracting clothing from the clothing model DB 211 , the 3D model providing means 21 refers to the analysis result provided by the analyzing means 22 . The 3D model providing device 21 obtains the analysis result from the analysis device 22 in response to receiving a search request from the user terminal 10 , for example. The analysis results include at least one of (a) the preference of the individual user who issued the search request and (b) the preferences of multiple users using the virtual fitting system 1 . The results of this analysis will be described later.

3D模型提供裝置21從服裝模型DB 211提取適合於從使用者終端10接收的搜索請求和從分析裝置22獲得的分析結果的服裝。例如,如果搜索請求包括類型“襯衫”、尺寸“M”及價格範圍“10,000至20,000日元”的資訊,並且分析結果包括“使用者更喜歡柔軟膚感及寬鬆合身”及“深藏青色在此搜索中流行”的資訊,則3D模型提供裝置21從服裝模型DB 211提取服裝條件的記錄。在此示例中,3D建模裝置21提取滿足這些條件的多個記錄。The 3D model providing means 21 extracts clothing suitable for the search request received from the user terminal 10 and the analysis result obtained from the analysis means 22 from the clothing model DB 211 . For example, if a search request includes information for type "shirt," size "M," and price range "10,000 to 20,000 yen," and analysis results include "users prefer soft skin and loose fit" and "dark navy in If there is information of "popular in this search", the 3D model providing device 21 extracts the records of clothing conditions from the clothing model DB 211. In this example, the 3D modeling apparatus 21 extracts a plurality of records satisfying these conditions.

再次參照圖4。在步驟S6中,3D模型提供裝置21將所提取的服裝資訊發送到使用者終端10。此資訊包括例如所提取服裝及縮略圖的列表。這些服裝候選進行虛擬試衣。Referring again to FIG. 4 . In step S6 , the 3D model providing device 21 sends the extracted clothing information to the user terminal 10 . This information includes, for example, a list of extracted garments and thumbnail images. These garment candidates are subjected to virtual fittings.

在使用者終端10中,3D模型獲得裝置11獲得關於服裝的資訊。顯示裝置14顯示關於服裝的資訊。此外,顯示裝置14顯示提示使用者從多件服裝之中選擇要進行虛擬試穿的服裝的螢幕。在步驟S8中,接受裝置13接受使用者對服裝的選擇。In the user terminal 10, the 3D model obtaining means 11 obtains information about clothing. The display device 14 displays information about the garment. In addition, the display device 14 displays a screen prompting the user to select a garment to be virtually tried on from a plurality of garments. In step S8, the accepting device 13 accepts the user's selection of clothing.

當使用者選擇服裝時,3D建模獲得裝置11向伺服器20發送進行虛擬試衣的請求(步驟S10)。虛擬試衣請求包括由使用者選擇的服裝的服裝ID。When the user selects clothing, the 3D modeling acquisition device 11 sends a request for virtual fitting to the server 20 (step S10 ). The virtual fitting request includes the garment ID of the garment selected by the user.

當從使用者終端10接收到虛擬試衣請求時,在步驟S12中,伺服器20的3D模型提供裝置21從使用者模型DB 212讀取與在步驟S2中接收到的使用者ID對應的記錄並從所述記錄獲得使用者的人體的3D模型212c。另外,3D模型提供裝置21從服裝模型DB 211讀取與虛擬裝置請求中所包括的服裝ID對應的記錄並從所述記錄獲得3D模型。When a virtual fitting request is received from the user terminal 10, in step S12, the 3D model providing means 21 of the server 20 reads the record corresponding to the user ID received in step S2 from the user model DB 212 And a 3D model 212c of the user's human body is obtained from the records. In addition, the 3D model providing device 21 reads the record corresponding to the clothing ID included in the virtual device request from the clothing model DB 211 and obtains the 3D model from the record.

圖6是示出使用者模型DB 212的示例性配置的圖。使用者模型DB 212包括多個記錄。每一記錄對應於一個使用者。每一記錄包括使用者ID 212a、屬性212b、3D模型212c及購買歷史212d。使用者ID 212a是唯一標識使用者的標識符。屬性212b是指示使用者的屬性的資訊並且包括例如使用者的姓名212b1、性別212b2及年齡212b3。3D模型212c指示3D建模資料本身或使用者的人體的3D建模資料的位置。購買歷史212d指示使用者以往購買的服裝的歷史。FIG. 6 is a diagram showing an exemplary configuration of the user profile DB 212 . User model DB 212 includes a plurality of records. Each record corresponds to a user. Each record includes a user ID 212a, attributes 212b, 3D model 212c, and purchase history 212d. The user ID 212a is an identifier that uniquely identifies the user. The attribute 212b is information indicating attributes of the user and includes, for example, the user's name 212b1, gender 212b2, and age 212b3. The 3D model 212c indicates the position of the 3D modeling data itself or the 3D modeling data of the user's human body. The purchase history 212d indicates the history of clothing purchased by the user in the past.

3D模型提供裝置21使用3D模型211f及3D模型212c來生成(在步驟S14中)表示穿著所選服裝的使用者(人體)的三維形狀的3D模型。在此種情況下,為穿著服裝的使用者生成3D模型的處理包括對服裝被穿在人體上時的改變(諸如服裝沿其體形起皺或者由於重力使其裙子或袖子下垂)進行模擬。3D模型提供裝置21將指示穿著服裝的人體的3D模型的類比結果的資料發送到使用者終端10(步驟S16)。指示模擬結果的資料例如是穿著服裝的人體的3D建模資料本身、其中穿著服裝的人體的3D模型採取預定姿勢的靜止圖像的資料、其中穿著服裝的人體的3D模型執行預定移動(行走、奔跑、跳躍、舉起右手等)的移動圖像資料或者指示穿著服裝的人體的壓力圖的圖像資料。The 3D model providing device 21 uses the 3D model 211f and the 3D model 212c to generate (in step S14 ) a 3D model representing the three-dimensional shape of the user (human body) wearing the selected clothing. In this case, the process of generating a 3D model of a user wearing the garment includes simulating changes to the garment as it is worn on the body, such as the garment wrinkling along its body shape or its skirt or sleeves drooping due to gravity. The 3D model providing device 21 transmits to the user terminal 10 data indicating the result of the analogy of the 3D model of the human body wearing the clothing (step S16 ). The material indicating the simulation result is, for example, 3D modeling material itself of a human body wearing clothing, material of a still image in which the 3D model of the human body wearing clothing takes a predetermined pose, material in which the 3D model of the human body wearing clothing performs predetermined movements (walking, running, jumping, raising the right hand, etc.) or image data indicating pressure maps of the human body wearing clothing.

在使用者終端10中,3D模型獲得裝置11從伺服器20獲得指示模擬結果的資料。在步驟S18中,顯示裝置14顯示模擬結果。In the user terminal 10 , the 3D model obtaining device 11 obtains data indicating the simulation result from the server 20 . In step S18, the display device 14 displays the simulation result.

圖7是例示出顯示在使用者終端10上的虛擬試衣螢幕的圖。虛擬試衣螢幕包括用於顯示3D建模的區域91和用於輸入使用者指令的UI對象92。在區域91中,顯示穿著服裝的人體的3D模型的圖像UD。UI對象92包括用於接受使用者動作(例如購買服裝、改變視點等)的指令的軟按鈕。FIG. 7 is a diagram illustrating an example of a virtual fitting screen displayed on the user terminal 10 . The virtual fitting screen includes an area 91 for displaying 3D modeling and a UI object 92 for inputting user instructions. In area 91 an image UD of a 3D model of a human body wearing clothing is displayed. UI objects 92 include soft buttons for accepting instructions for user actions (eg, purchase clothing, change viewpoint, etc.).

當顯示裝置14顯示虛擬試衣的3D模型時,接收裝置13接收關於使用者的動作的指令(步驟S20)。如果模擬結果是穿著服裝的人體的3D建模資料本身,則顯示裝置14可根據由接收裝置13接收的操作來改變對3D模型的顯示。例如,根據使用者的按鈕操作,可即時改變3D模型的視點或者可改變3D模型的姿勢。接收裝置13在儲存裝置17中儲存關於所接收的指令的資訊。When the display device 14 displays the 3D model of the virtual fitting, the receiving device 13 receives an instruction about the user's action (step S20 ). If the simulation result is the 3D modeling material itself of the human body wearing clothes, the display device 14 may change the display of the 3D model according to the operation received by the receiving device 13 . For example, according to the user's button operation, the viewpoint of the 3D model can be changed instantly or the posture of the 3D model can be changed. The receiving device 13 stores information on the received command in the storage device 17 .

在步驟S22中,在顯示裝置14顯示穿著服裝的人體的3D模型的同時,動作資訊獲得裝置16基於由接收裝置13接收的關於使用者的動作的指令獲得表示使用者的動作的動作資訊。在此示例中,動作資訊獲得裝置16從儲存裝置17獲得動作資訊。如上所述,動作資訊包括操作使用者終端10的使用者的動作資訊及由顯示裝置14顯示的使用者(人體)在虛擬空間中的動作資訊中的至少一者。當接受裝置13獲得後者動作資訊時,顯示裝置14根據所獲得的動作資訊使正在顯示的3D模型移動。In step S22, while the display device 14 displays the 3D model of the human body wearing the clothing, the motion information obtaining device 16 obtains motion information representing the user's motion based on the command received by the receiving device 13 regarding the user's motion. In this example, the action information obtaining device 16 obtains the action information from the storage device 17 . As mentioned above, the motion information includes at least one of the motion information of the user operating the user terminal 10 and the motion information of the user (human body) in the virtual space displayed by the display device 14 . When the receiving device 13 obtains the latter motion information, the display device 14 moves the displayed 3D model according to the obtained motion information.

接下來,目標資訊獲得裝置12獲得由3D模型獲得裝置11獲得的(步驟S16)關於3D模型的目標資訊(步驟S24)。在一個實施例中,關於3D模型的目標資訊與3D模型一起從伺服器20獲得並儲存在儲存裝置17中。目標資訊獲得裝置12從儲存裝置17獲得目標資訊。Next, the object information obtaining means 12 obtains object information on the 3D model obtained by the 3D model obtaining means 11 (step S16 ) (step S24 ). In one embodiment, the object information about the 3D model is obtained from the server 20 and stored in the storage device 17 together with the 3D model. The target information obtaining device 12 obtains target information from the storage device 17 .

在步驟S26中,反饋裝置15將反饋資訊發送到伺服器20。反饋資訊包括在步驟S24中獲得的目標資訊、在步驟S22中獲得的動作資訊及指示當前時間的時間戳。步驟S26中的處理由預定事件觸發。此事件例如是使正在顯示的3D模型的顯示停止的時間,且具體來說例如是將服裝更換成其他服裝的指令、終止虛擬試衣的指令或採購服裝的指令。In step S26 , the feedback device 15 sends the feedback information to the server 20 . The feedback information includes the target information obtained in step S24, the action information obtained in step S22, and a time stamp indicating the current time. The processing in step S26 is triggered by a predetermined event. This event is, for example, when the display of the 3D model being displayed is stopped, and specifically, is an instruction to change clothes to other clothes, an instruction to end a virtual fitting, or an instruction to purchase clothes.

在伺服器20中,分析裝置22接收反饋資訊並將所接收的反饋資訊儲存在反饋資訊DB 221中(步驟S28)。In the server 20, the analyzing device 22 receives the feedback information and stores the received feedback information in the feedback information DB 221 (step S28).

圖8是示出反饋資訊DB 221的示例性配置的圖。如圖8中所示,在反饋資訊DB 221中,目標資訊221c及動作資訊221d與一組使用者ID 221a及服裝ID 221b相關聯。FIG. 8 is a diagram showing an exemplary configuration of the feedback information DB 221 . As shown in FIG. 8, in the feedback information DB 221, target information 221c and action information 221d are associated with a set of user ID 221a and clothing ID 221b.

此處,使用者ID 221a是作為反饋資訊的提供者的使用者的識別資訊並且是在步驟S2中由3D模型獲得裝置11發送的使用者ID。服裝ID 221b是穿著在步驟S16中由3D模型獲得裝置11獲得的服裝的使用者的3D模型中的服裝的ID。Here, the user ID 221a is identification information of the user who is the provider of the feedback information and is the user ID sent by the 3D model obtaining device 11 in step S2. The clothing ID 221b is the ID of the clothing in the 3D model of the user wearing the clothing obtained by the 3D model obtaining device 11 in step S16.

目標資訊221c是由目標資訊獲得裝置12從穿著服裝的使用者的3D模型獲得的資訊。目標資訊包括例如3D模型中的服裝與人體之間的尺寸差221c1(在預定位置處)、壓力圖中的典型值(例如,施加到特定部分的壓力)221c2、服裝的材料221c3及指示顯示3D模型的背景的資訊221c4,所述典型值221c2指示當人體穿著服裝時施加到人體的每一部位的壓力分佈。The object information 221c is information obtained by the object information obtaining device 12 from the 3D model of the user wearing the clothing. The object information includes, for example, the size difference 221c1 between the clothing and the human body in the 3D model (at a predetermined position), typical values in the pressure map (for example, pressure applied to a specific part) 221c2, the material of the clothing 221c3, and the indication display 3D Information 221c4 of the background of the model, the typical value 221c2 indicating the distribution of pressure applied to each part of the human body when the human body wears the garment.

動作資訊221d是指示在穿著服裝的使用者的3D模型顯示在顯示器上時由接收裝置13接收的關於使用者的動作的指令的資訊。動作資訊包括當在虛擬空間中顯示3D模型時用於在虛擬空間中查看3D模型212c的視點221d1、所顯示的3D模型的移動221d2、3D模型的查看時間(即,顯示時間)221d3以及指示使用者是否已購買所顯示服裝的購買動作221d4。The motion information 221d is information indicating instructions regarding the user's motion received by the receiving device 13 when the 3D model of the user wearing the clothing is displayed on the display. The action information includes the viewpoint 221d1 for viewing the 3D model 212c in the virtual space when the 3D model is displayed in the virtual space, the movement 221d2 of the displayed 3D model, the viewing time (ie, display time) 221d3 of the 3D model, and instructions to use Whether the user has already purchased the purchase action 221d4 of the displayed clothing.

接下來,在伺服器20中,分析裝置22對反饋資訊DB 221進行分析(步驟S30)。分析工具22使用反饋資訊DB 221執行兩種主要類型的分析。(a)對具體個人的分析。(b)對不針對特定個人的使用者群體的分析。在前一種分析中,分析裝置22對記錄在反饋資訊DB 221中的來自使用者的反饋資訊進行分析,以確定各個使用者關於服裝的偏好。然後,分析裝置22向3D模型提供裝置21提供指示分析結果的資訊。3D模型提供裝置21使用從分析裝置22提供的資訊執行過濾,使得在提取服裝的3D模型時提取適合於使用者品味的服裝。例如,當對與特定使用者對應的多條反饋資訊進行分析並且通過分析發現使用者傾向于購買合身寬鬆的襯衫(例如,胸部、軀幹及兩臂的尺寸差221c1是大於參考值的正值的服裝)時,3D模型提供裝置21可執行增大合身寬鬆的服裝的優先級並提取對服裝的處理。Next, in the server 20, the analysis device 22 analyzes the feedback information DB 221 (step S30). The analysis tool 22 uses the feedback information DB 221 to perform two main types of analysis. (a) Analysis of specific individuals. (b) Analysis of user groups that do not target specific individuals. In the former analysis, the analysis device 22 analyzes the feedback information from the users recorded in the feedback information DB 221 to determine the preference of each user regarding clothing. Then, the analysis device 22 provides information indicating the analysis result to the 3D model providing device 21 . The 3D model providing means 21 performs filtering using the information supplied from the analyzing means 22, so that when extracting the 3D model of clothing, clothing suitable for the user's taste is extracted. For example, when a plurality of pieces of feedback information corresponding to a specific user are analyzed and it is found through the analysis that the user tends to purchase loose-fitting shirts (for example, the size difference 221c1 of the chest, torso, and two arms is a positive value greater than the reference value clothing), the 3D model providing device 21 may execute the process of increasing the priority of clothing that fits loosely and extracting the clothing.

在後一種分析中,分析裝置22對記錄在反饋資訊DB 221中的來自使用者群體的反饋資訊進行分析,以確定使用者群體對服裝的偏好。例如,基於諸如年齡、性別、居住地、身高、體重及購買歷史等使用者屬性來設定使用者群體。可選地,所有使用者可被視為單個使用者群體。例如,如果身高高於參考值的男性使用者傾向於購買緊身褲(例如,腰圍、臀圍及大腿尺寸221c1均是小於參考值的正值的服裝),則3D模型提供處理器21可通過增大緊身褲的優先級來提取服裝。In the latter analysis, the analysis device 22 analyzes the feedback information from the user groups recorded in the feedback information DB 221 to determine the user group's preference for clothing. For example, user groups are set based on user attributes such as age, sex, place of residence, height, weight, and purchase history. Alternatively, all users may be considered a single user group. For example, if a male user whose height is higher than the reference value tends to buy tight pants (for example, the waistline, hip circumference and thigh size 221c1 are all positive values smaller than the reference value), the 3D model providing processor 21 may increase the Priority for large tights to extract clothing.

如上所述,根據本實施例,由於包括目標資訊和動作資訊的反饋資訊被反饋回到與3D模型提供裝置21對應的分析裝置22,因此3D模型提供裝置21可提供穿著適合於使用者偏好的服裝的軀體的3D模型。因此,當存在許多服裝要進行虛擬試衣時,使用者從所述服裝選擇適合他/她的偏好的服裝變得容易。As described above, according to the present embodiment, since the feedback information including target information and action information is fed back to the analysis device 22 corresponding to the 3D model providing device 21, the 3D model providing device 21 can provide clothing suitable for user preferences. 3D model of the torso of the garment. Therefore, when there are many clothes to be virtually tried on, it becomes easy for the user to select clothes that suit his/her preference from among the clothes.

3、修改示例3. Modify the example

本發明不限於上述實施例並且可進行各種修改。將在以下描述變化。以下修改示例中描述的物項的部件可結合一些其他物項來實施。The present invention is not limited to the above-described embodiments and various modifications can be made. Changes will be described below. Components of items described in modified examples below may be implemented in combination with some other items.

(1)從使用者終端10發送到伺服器20的反饋資訊可包括趨勢資訊。趨勢資訊可包括關於時尚的資訊(例如,今年的紅色流行)及關於社會狀況的趨勢資訊(例如,SDG、環境問題等。在這種情況下,當使用者操作使用者終端10來訪問互聯網網站時,可從訪問歷史生成趨勢資訊並將所述趨勢資訊包括在反饋資訊中。(1) The feedback information sent from the user terminal 10 to the server 20 may include trend information. The trend information may include information about fashion (for example, this year's red fashion) and trend information about social conditions (for example, SDG, environmental issues, etc. In this case, when the user operates the user terminal 10 to access the Internet website , trend information may be generated from the access history and included in the feedback information.

(2)在以上實施例中,對作為軀體的人體執行虛擬試衣,但虛擬試衣可對除人體之外的軀體(例如作為寵物的動物)執行。在以上實施例中,對使用者終端10的使用者他/她自己的3D模型執行虛擬試衣,但是可使用除所述使用者之外的另一個人的3D模型來執行虛擬試衣。例如,可預期使用者使另一個人進行服裝的虛擬試衣並將使用者喜歡的服裝呈現給所述另一個人。(2) In the above embodiments, virtual fitting is performed on a human body as a body, but virtual fitting may be performed on a body other than a human body (for example, an animal as a pet). In the above embodiments, the virtual fitting is performed on his/her own 3D model of the user of the user terminal 10, but the virtual fitting may be performed using a 3D model of another person other than the user. For example, a user may be expected to have another person perform a virtual fitting of a garment and present the user's favorite garment to the other person.

(3)動作資訊中所包括的關於購買行動的資訊不限於實施例中例示的資訊。與購買動作相關的資訊可為例如指示是否已購買服裝的3D建模資料(而不是實際資料)的資訊。購買動作還可包括租賃或免費下載以及購買的歷史記錄。對於3D建模資料,應用程式比真實服裝更容易識別。例如,還容易記錄遊戲標題或應用程式名稱的歷史,其中使用服裝的應用程式3D建模資料。可選地,如果使用者在購買3D建模資料之後購買實際服裝,則可提供諸如對實際服裝的價格打折的服務。(3) The information on the purchase action included in the action information is not limited to the information exemplified in the embodiments. The information related to the purchase action may be, for example, information indicating whether 3D modeling data (not actual data) of clothing has been purchased. Purchase actions may also include rental or free downloads as well as purchase history. For 3D modeling data, apps are easier to identify than real garments. For example, it is also easy to record the history of game titles or application names in which application 3D modeling data of clothing is used. Alternatively, if the user purchases actual clothing after purchasing 3D modeling materials, a service such as a discount on the price of the actual clothing may be provided.

關於購買動作的資訊可包括“使用者未購買服裝的原因”,特別是在使用者進行虛擬試衣後未購買服裝的情況下。在實際商店中對實際服裝進行試衣時,通常難以記錄並且儲存顧客未購買試穿服裝的原因。然而,虛擬試衣系統1可容易地獲取目標資訊(例如服裝與使用者人體之間的尺寸差異)並且可通過執行調查問卷來記錄原因,以便在虛擬試衣系統中記錄未達成購買的原因。另外,虛擬試衣系統1還可為每件服裝記錄試穿所述服裝的使用者之中實際購買的使用者的百分比。可通過使用關於購買動作的資訊將服裝分類為試衣之後容易購買的服裝與不容易購買的服裝。Information about purchase actions may include "reason why the user did not purchase the garment," particularly if the user did not purchase the garment after a virtual fitting. When trying on actual garments in an actual store, it is often difficult to record and store the reasons why a customer did not purchase the try-on garment. However, the virtual fitting system 1 can easily acquire target information such as the size difference between the garment and the user's body and can record the reason by performing a questionnaire in order to record the reason for the non-concluded purchase in the virtual fitting system. In addition, the virtual fitting system 1 can also record for each piece of clothing the percentage of users who actually buy the clothes among the users who try on the clothes. Clothes may be classified into clothes that are easy to buy after fitting and clothes that are not easy to buy by using information on purchase actions.

(4)資訊處理系統1的硬體配置不是虛擬裝配。只要能夠實現所需的功能,虛擬試衣系統1即可具有硬體配置。例如,多個物理上協作的設備可用作伺服器20。伺服器20可為物理伺服器或虛擬伺服器(包括所謂的雲)。另外,功能元件與硬體之間的對應關係不限於實施例中所示的關係。例如,在實施例中描述為使用者終端10的實施方案的至少一些功能可為伺服器20的實施方案。(4) The hardware configuration of the information processing system 1 is not a virtual assembly. As long as the required functions can be realized, the virtual fitting system 1 can have a hardware configuration. For example, multiple physically cooperating devices can be used as server 20 . Server 20 may be a physical server or a virtual server (including a so-called cloud). In addition, the corresponding relationship between functional elements and hardware is not limited to the relationship shown in the embodiments. For example, at least some of the functions described in the embodiments as implementations of the user terminal 10 may be implementations of the server 20 .

(5)由CPU 101執行的應用程式可通過經由網路(諸如互聯網)下載來提供,或者可以記錄在電腦可讀非臨時記錄介質(諸如高密度唯讀光碟(DVD-ROM))上的狀態來提供。(5) The application program executed by the CPU 101 may be provided by downloading via a network such as the Internet, or may be recorded on a computer-readable non-transitory recording medium such as a compact disc (DVD-ROM) to provide.

1:虛擬試衣系統 10:使用者終端 11:3D模型獲得裝置 12:目標資訊獲得裝置 13:接收裝置 14:顯示裝置 15:反饋裝置 16:動作資訊獲得裝置 17:儲存裝置 19:控制裝置 20:伺服器 21:3D模型提供裝置 22:分析裝置 23:儲存裝置 29:控制裝置 91:區域 92:UI對象 100:使用者終端 101:CPU 102:儲存器 103:儲存器件 104:通訊設備 105:輸入設備 106:輸出設備 200:伺服器 211:服裝模型DB 211a:服裝ID 211b:品牌 211c:類型 211d:尺寸 211e:價格 211f:3D模型 212:使用者模型DB 212a:使用者ID 212b:屬性 212b1:姓名 212b2:性別 212b3:年齡 212c:3D模型 212d:購買歷史 213:反饋資訊DB 221:反饋資訊DB 221a:使用者ID 221b:服裝ID 221c:目標資訊 221c1:尺寸差 221c2:典型值 221c3:材料 221c4:背景的資訊 221d:動作資訊 221d1:視點 221d2:移動 221d3:查看時間 221d4:購買動作 300:網路 B:軟按鈕 UD:圖像 S2~S30:流程 1: Virtual fitting system 10: User terminal 11: 3D model acquisition device 12: target information acquisition device 13: Receiver 14: Display device 15: Feedback device 16: Action information acquisition device 17: storage device 19: Control device 20: Server 21: 3D model providing device 22: Analysis device 23: storage device 29: Control device 91: area 92: UI object 100: user terminal 101: CPU 102: Storage 103: storage device 104: Communication equipment 105: Input device 106: output device 200: server 211: clothing model DB 211a: clothing ID 211b: Brand 211c: type 211d: size 211e: price 211f: 3D model 212: user model DB 212a: User ID 212b: attribute 212b1: name 212b2: Gender 212b3: age 212c: 3D model 212d: purchase history 213: Feedback information DB 221: Feedback information DB 221a: User ID 221b: clothing ID 221c: Target information 221c1: Size difference 221c2: typical value 221c3: Materials 221c4: Background information 221d: Action information 221d1: Viewpoint 221d2: move 221d3: View time 221d4: buy action 300: network B: soft button UD: Image S2~S30: Process

圖1是示出虛擬試衣系統1的功能配置的圖。 圖2是示出虛擬試衣系統1的功能配置的方塊圖。 圖3是示出使用者終端10的硬體配置的方塊圖。 圖4是示出虛擬試衣系統1的操作的時序圖。 圖5是示出服裝模型DB 211的配置的圖。 圖6是示出使用者模型DB 212的配置的圖。 圖7是示出虛擬試衣螢幕的圖。 圖8是示出反饋資訊DB 221的配置的圖。 FIG. 1 is a diagram showing a functional configuration of a virtual fitting system 1 . FIG. 2 is a block diagram showing the functional configuration of the virtual fitting system 1 . FIG. 3 is a block diagram showing the hardware configuration of the user terminal 10 . FIG. 4 is a sequence diagram showing the operation of the virtual fitting system 1 . FIG. 5 is a diagram showing the configuration of the clothing model DB 211 . FIG. 6 is a diagram showing the configuration of the user profile DB 212 . Fig. 7 is a diagram showing a virtual fitting screen. FIG. 8 is a diagram showing the configuration of the feedback information DB 221 .

10:使用者終端 10: User terminal

11:3D模型獲得裝置 11: 3D model acquisition device

12:目標資訊獲得裝置 12: target information acquisition device

13:接收裝置 13: Receiver

14:顯示裝置 14: Display device

15:反饋裝置 15: Feedback device

16:動作資訊獲得裝置 16: Action information acquisition device

17:儲存裝置 17: storage device

19:控制裝置 19: Control device

20:伺服器 20: Server

21:3D模型提供裝置 21: 3D model providing device

22:分析裝置 22: Analysis device

23:儲存裝置 23: storage device

29:控制裝置 29: Control device

211:服裝模型DB 211: clothing model DB

212:使用者模型DB 212: user model DB

213:反饋資訊DB 213: Feedback information DB

Claims (17)

一種資訊處理設備,包括: 3D模型獲得裝置,所述3D模型獲得裝置從3D模型提供裝置獲得穿著服裝的軀體的3D模型; 目標資訊獲得裝置,所述目標資訊獲得裝置獲得關於服裝及所述軀體中的至少一者的目標資訊; 顯示裝置,所述顯示裝置在虛擬空間中顯示所述3D模型; 接收裝置,所述接收裝置接收指示使用者在所述虛擬空間中的動作的指令的輸入;以及 反饋裝置,所述反饋裝置將反饋資訊反饋回到與所述3D模型提供裝置對應的目的地,所述反饋資訊包括目標資訊和動作資訊,所述動作資訊在所述顯示裝置顯示3D模型時,根據通過所述接收裝置輸入的指令,指示所述使用者的動作。 An information processing device, comprising: 3D model obtaining means, the 3D model obtaining means obtains the 3D model of the body wearing the clothing from the 3D model providing means; target information obtaining means for obtaining target information on at least one of the clothing and the body; a display device that displays the 3D model in a virtual space; receiving means for receiving an input of an instruction indicating a user's action in the virtual space; and a feedback device, the feedback device feeds back the feedback information to the destination corresponding to the 3D model providing device, the feedback information includes target information and action information, and the action information is displayed when the display device displays the 3D model, An action of the user is instructed according to an instruction input through the receiving device. 如請求項1所述之資訊處理設備,其中,所述動作資訊包括關於在所述虛擬空間中顯示3D模型時的視點位置的資訊。The information processing device according to claim 1, wherein the motion information includes information on a viewpoint position when a 3D model is displayed in the virtual space. 如請求項1所述之資訊處理設備,其中,所述動作資訊包括關於在穿著所述服裝的狀態下穿著所述服裝的所述軀體的運動的資訊。The information processing device according to claim 1, wherein the motion information includes information on motion of the body wearing the clothing in a state of wearing the clothing. 如請求項1所述之資訊處理設備,其中,所述運動資訊包括關於從多個預定義的運動中選擇的運動的資訊。The information processing device according to claim 1, wherein the exercise information includes information about a exercise selected from a plurality of predefined exercises. 如請求項1所述之資訊處理設備,其中,所述動作資訊包括所述軀體在預定時間段內已穿著所述服裝的次數。The information processing device according to claim 1, wherein the motion information includes the number of times the body has worn the garment within a predetermined period of time. 如請求項1所述之資訊處理設備,其中,所述動作資訊包括關於所述3D模型被查看的時間長度的資訊。The information processing device according to claim 1, wherein the action information includes information about the length of time the 3D model is viewed. 如請求項1所述之資訊處理設備,其中,所述動作資訊包括關於針對所述服裝輸入的使用者偏好的資訊。The information processing device according to claim 1, wherein the action information includes information on user preference input for the clothing. 如請求項1所述之資訊處理設備,其中,所述動作資訊包括關於對所述服裝的購買動作的資訊。The information processing device according to claim 1, wherein the action information includes information on a purchase action of the clothing. 如請求項1所述之資訊處理設備,其中,所述目標資訊包括關於所述軀體與所述服裝之間的形狀或尺寸的差異的資訊。The information processing device according to claim 1, wherein the target information includes information on a difference in shape or size between the body and the clothing. 如請求項1所述之資訊處理設備,其中,所述目標資訊包括關於當所述軀體穿著所述服裝時施加在所述軀體上的壓力或者所述服裝中產生的張力的資訊。The information processing apparatus according to claim 1, wherein the target information includes information on pressure applied to the body when the body wears the garment or tension generated in the garment. 如請求項1所述之資訊處理設備,其中,所述目標資訊包括關於服裝材料的資訊。The information processing device according to claim 1, wherein the target information includes information on clothing materials. 如請求項1所述之資訊處理設備,其中,所述目標資訊包括關於用於在所述虛擬空間中顯示3D模型的背景的資訊。The information processing device according to claim 1, wherein the object information includes information on a background for displaying a 3D model in the virtual space. 如請求項1所述之資訊處理設備,其中,所述反饋資訊包括在獲得所述動作資訊時的公眾趨勢的趨勢資訊。The information processing device according to claim 1, wherein the feedback information includes trend information of public trends when the action information is obtained. 如請求項1所述之資訊處理設備,其中,所述3D模型獲得裝置獲得穿著基於以往獲得的所述反饋資訊選擇的服裝的3D模型。The information processing device according to claim 1, wherein the 3D model obtaining means obtains a 3D model of clothing selected based on the previously obtained feedback information. 一種資訊處理系統,包括: 伺服器;以及 資訊處理設備; 其中,所述伺服器包括: 3D模型提供裝置,所述3D模型提供裝置提供穿著服裝的軀體的3D模型; 所述資訊處理設備包括: 3D模型獲得裝置,所述3D模型獲得裝置從3D模型提供裝置獲得穿著所述服裝的所述軀體的3D模型; 目標資訊獲得裝置,所述目標資訊獲得裝置獲得關於服裝及所述軀體中的至少一者的目標資訊,顯示裝置,所述顯示裝置在虛擬空間中顯示所述3D模型; 接收裝置,所述接收裝置接收指示使用者在所述虛擬空間中的動作的指令的輸入;以及 反饋裝置,所述反饋裝置將反饋資訊反饋回到與3D模型提供裝置對應的目的地,所述反饋資訊包括目標資訊和動作資訊,所述動作資訊在所述顯示裝置顯示3D模型時,根據通過所述接收裝置輸入的指令,指示所述使用者的動作。 An information processing system comprising: server; and information processing equipment; Wherein, the server includes: 3D model providing means that provides a 3D model of the torso wearing the garment; The information processing equipment includes: 3D model obtaining means, the 3D model obtaining means obtains the 3D model of the body wearing the clothing from the 3D model providing means; target information obtaining means for obtaining target information on at least one of the clothing and the body, a display device for displaying the 3D model in a virtual space; receiving means for receiving an input of an instruction indicating a user's action in the virtual space; and A feedback device, the feedback device feeds back the feedback information to the destination corresponding to the 3D model providing device, the feedback information includes target information and action information, and the action information is passed according to the 3D model displayed by the display device The instruction input by the receiving device indicates the action of the user. 一種致使電腦執行處理的程式,所述處理包括: 從3D模型提供裝置獲得穿著服裝的軀體的3D模型; 獲得關於所述服裝及所述軀體中的至少一者的目標資訊; 在虛擬空間中顯示所述3D模型; 通過接收裝置接收指示使用者在所述虛擬空間中的動作的指令的輸入;以及 將反饋資訊反饋回到與3D模型提供裝置對應的目的地,所述反饋資訊包括所述目標資訊和動作資訊,所述動作資訊指示在顯示所述3D模型時,根據通過所述接收裝置輸入的指令,指示所述使用者的動作。 A program that causes a computer to perform processes including: Obtaining a 3D model of the garmented torso from the 3D model providing means; obtaining target information about at least one of the garment and the torso; displaying said 3D model in a virtual space; receiving an input of an instruction indicative of a user's action in said virtual space via the receiving means; and Feedback the feedback information back to the destination corresponding to the 3D model providing device, the feedback information includes the target information and action information, the action information indicates that when the 3D model is displayed, according to the input through the receiving device Instructions directing actions of the user. 一種資訊處理方法,包括: 從3D模型提供裝置獲得穿著服裝的軀體的3D模型; 獲得關於所述服裝及所述軀體中的至少一者的目標資訊; 在虛擬空間中顯示所述3D模型; 通過接收裝置接收指示使用者在所述虛擬空間中的動作的指令的輸入;以及 將反饋資訊反饋回到與所述3D模型提供裝置對應的目的地,所述反饋資訊包括所述目標資訊和動作資訊,所述動作資訊指示在顯示3D模型時,根據通過所述接收裝置輸入的指令,指示所述使用者的動作。 An information processing method, comprising: Obtaining a 3D model of the garmented torso from the 3D model providing device; obtaining target information about at least one of the garment and the torso; displaying said 3D model in a virtual space; receiving an input of an instruction indicative of a user's action in said virtual space via the receiving means; and feeding back the feedback information to the destination corresponding to the 3D model providing device, the feedback information including the target information and action information, the action information indicating that when displaying the 3D model, according to the input through the receiving device Instructions directing actions of the user.
TW111144460A 2021-11-26 2022-11-21 Information processing equipment, information processing method, information processing system, and program TWI822476B (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
WOPCT/JP2021/043402 2021-11-26
PCT/JP2021/043402 WO2022185631A1 (en) 2021-11-26 2021-11-26 Information processing device, information processing method, information processing system, and program

Publications (2)

Publication Number Publication Date
TW202322058A true TW202322058A (en) 2023-06-01
TWI822476B TWI822476B (en) 2023-11-11

Family

ID=81289284

Family Applications (1)

Application Number Title Priority Date Filing Date
TW111144460A TWI822476B (en) 2021-11-26 2022-11-21 Information processing equipment, information processing method, information processing system, and program

Country Status (4)

Country Link
JP (2) JP7055526B1 (en)
CN (1) CN114902266A (en)
TW (1) TWI822476B (en)
WO (1) WO2022185631A1 (en)

Family Cites Families (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7149665B2 (en) * 2000-04-03 2006-12-12 Browzwear International Ltd System and method for simulation of virtual wear articles on virtual models
KR20150031706A (en) * 2013-09-16 2015-03-25 이윤재 Welding quality control system
JP5605885B1 (en) * 2014-02-27 2014-10-15 木下 泰男 Virtual try-on system and virtual try-on program
CN105913486A (en) * 2016-04-08 2016-08-31 东华大学 Digital mixing human body rapid modeling method applied to apparel industries
CN106651498A (en) * 2016-09-29 2017-05-10 宇龙计算机通信科技(深圳)有限公司 Information processing method and device
CN106502399B (en) * 2016-10-31 2019-08-23 江西服装学院 Virtual fit method, apparatus and system and three-dimensional fabric Materials Library method for building up and device
CN107633440A (en) * 2017-08-11 2018-01-26 捷开通讯(深圳)有限公司 The method of virtual fitting, mobile terminal and storage device for virtual fitting
CN109003168A (en) * 2018-08-16 2018-12-14 深圳Tcl数字技术有限公司 Virtual fit method, smart television and computer readable storage medium
KR20200023970A (en) * 2018-08-27 2020-03-06 전호윤 Virtual fitting support system
CN110021057B (en) * 2019-02-22 2023-03-14 维沃移动通信有限公司 Information display method and terminal
US20220198780A1 (en) * 2019-04-05 2022-06-23 Sony Group Corporation Information processing apparatus, information processing method, and program
CN110148040A (en) * 2019-05-22 2019-08-20 珠海随变科技有限公司 A kind of virtual fit method, device, equipment and storage medium
US20220327747A1 (en) * 2019-07-25 2022-10-13 Sony Group Corporation Information processing device, information processing method, and program
CN112116430A (en) * 2020-09-28 2020-12-22 西安万像电子科技有限公司 Virtual wearing system and control method thereof, virtual fitting system and virtual wearing glasses
CN113129450B (en) * 2021-04-21 2024-04-05 北京百度网讯科技有限公司 Virtual fitting method, device, electronic equipment and medium

Also Published As

Publication number Publication date
WO2022185631A1 (en) 2022-09-09
JPWO2022185631A1 (en) 2022-09-09
JP7055526B1 (en) 2022-04-18
JP2023079142A (en) 2023-06-07
CN114902266A (en) 2022-08-12
TWI822476B (en) 2023-11-11

Similar Documents

Publication Publication Date Title
US8818883B2 (en) Personalized shopping avatar
JP6242768B2 (en) Virtual try-on device, virtual try-on method, and program
WO2018165239A1 (en) Methods and systems for customized garment and outfit design generation
JP6320237B2 (en) Virtual try-on device, virtual try-on method, and program
KR20160145732A (en) Fashion preference analysis
JP6338966B2 (en) Virtual try-on device, virtual try-on system, virtual try-on method, and program
KR20170112267A (en) Method for composing image and an electronic device thereof
KR20170068741A (en) Method and program for providing virtual fitting service
JP2016038811A (en) Virtual try-on apparatus, virtual try-on method and program
KR101682769B1 (en) The user fitting type automatic online fashion coordination matching method
KR20200023970A (en) Virtual fitting support system
KR20200141929A (en) Method, device and program for customizing object design
JP2018106736A (en) Virtual try-on apparatus, virtual try-on method and program
KR20110041628A (en) Method and apparatus for recommending apparel
JP7039094B1 (en) Information processing equipment, information processing methods, and programs
TWI822476B (en) Information processing equipment, information processing method, information processing system, and program
WO2020079235A1 (en) Method and apparatus for accessing clothing
JP2018113060A (en) Virtual try-on apparatus, virtual try-on system, virtual try-on method and program
KR20210130420A (en) System for smart three dimensional garment fitting and the method for providing garment fitting service using there of
WO2022269741A1 (en) Information processing device, 3d system, and information processing method
KR20200071196A (en) A virtual fitting system based on face recognition
JP2019112732A (en) Digital fitting support device, digital apparel support device and digital apparel support method
CN113837835B (en) Role model-based wearable product display method and device
JP2012194782A (en) Server for outfit simulation, system for automatically creating image data of clothes or the like for outfit simulation, and method for automatically creating image data of clothes or the like for outfit simulation
NL2022937B1 (en) Method and Apparatus for Accessing Clothing