TWI822476B - Information processing equipment, information processing method, information processing system, and program - Google Patents

Information processing equipment, information processing method, information processing system, and program Download PDF

Info

Publication number
TWI822476B
TWI822476B TW111144460A TW111144460A TWI822476B TW I822476 B TWI822476 B TW I822476B TW 111144460 A TW111144460 A TW 111144460A TW 111144460 A TW111144460 A TW 111144460A TW I822476 B TWI822476 B TW I822476B
Authority
TW
Taiwan
Prior art keywords
information
model
clothing
user
action
Prior art date
Application number
TW111144460A
Other languages
Chinese (zh)
Other versions
TW202322058A (en
Inventor
謝英弟
井口道久
張彥鵬
許夢璇
劉雨佳
Original Assignee
日商威亞視股份有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 日商威亞視股份有限公司 filed Critical 日商威亞視股份有限公司
Publication of TW202322058A publication Critical patent/TW202322058A/en
Application granted granted Critical
Publication of TWI822476B publication Critical patent/TWI822476B/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00Commerce
    • G06Q30/06Buying, selling or leasing transactions
    • G06Q30/0601Electronic shopping [e-shopping]
    • G06Q30/0641Shopping interfaces
    • G06Q30/0643Graphical representation of items or shoppers
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00Commerce
    • G06Q30/06Buying, selling or leasing transactions
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00Manipulating 3D models or images for computer graphics
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2210/00Indexing scheme for image generation or computer graphics
    • G06T2210/16Cloth

Landscapes

  • Engineering & Computer Science (AREA)
  • Business, Economics & Management (AREA)
  • Physics & Mathematics (AREA)
  • Accounting & Taxation (AREA)
  • Finance (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • General Business, Economics & Management (AREA)
  • Strategic Management (AREA)
  • Marketing (AREA)
  • Economics (AREA)
  • Development Economics (AREA)
  • Computer Graphics (AREA)
  • Computer Hardware Design (AREA)
  • General Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Management, Administration, Business Operations System, And Electronic Commerce (AREA)
  • Processing Or Creating Images (AREA)
  • Computer And Data Communications (AREA)

Abstract

An information processing equipment, an information processing method, an information processing system, and a program are provided, wherein the information processing equipment includes: a 3D model obtaining device for obtaining a 3D model of a body wearing clothing; a target information obtaining device for obtaining at least one of target information related to the clothing and the body; a display device for displaying the 3D model in a virtual space; a receiving device for receiving a input of a command of a motion to instruct a user in the virtual space; and a feedback device for feeding feedback information back to a 3D model providing device corresponded to a goal, wherein the feedback information includes: target information and motion information. The motion information indicates the motion of the user when the display device display the 3D model.

Description

資訊處理設備、資訊處理方法、資訊處理系統以及程式Information processing equipment, information processing methods, information processing systems and programs

本發明涉及一種用於從多個服裝物項中選擇適合於用戶偏好的服裝的技術。The present invention relates to a technology for selecting clothing suitable for a user's preference from a plurality of clothing items.

與虛擬試衣相關的技術是已知的。例如,專利文獻1公開了一種虛擬試衣系統,所述虛擬試衣系統提供已試穿所期望服裝的使用者的圖像。Technologies related to virtual fitting are known. For example, Patent Document 1 discloses a virtual fitting system that provides an image of a user who has tried on desired clothing.

[專利文獻]專利文獻1:JP 2019-144890。[Patent Document] Patent Document 1: JP 2019-144890.

[發明所要解決的問題][Problem to be solved by the invention]

儘管虛擬試衣包括各種元素,然而在專利文獻1中描述的虛擬試衣系統中,難以獲得關於使用者在虛擬試衣期間的動作的資訊反饋。Although virtual fitting includes various elements, in the virtual fitting system described in Patent Document 1, it is difficult to obtain information feedback on the user's actions during virtual fitting.

相比之下,本發明提供了一種便於在虛擬試衣期間獲得關於使用者的動作的資訊反饋的技術。In contrast, the present invention provides a technology that facilitates obtaining information feedback about the user's actions during virtual fitting.

[解决方案][solution]

本公開的一個方面提供一種資訊處理設備,所述資訊處理設備包括:3D模型獲得裝置,所述3D模型獲得裝置從3D模型提供裝置獲得穿著服裝的軀體的3D模型;目標資訊獲得裝置,所述目標資訊獲得裝置獲得關於服裝及所述軀體中的至少一者的目標資訊;顯示裝置,所述顯示裝置在虛擬空間中顯示所述3D模型;接收裝置,所述接收裝置接收指示使用者在所述虛擬空間中的動作的指令的輸入;以及反饋裝置,所述反饋裝置將反饋資訊反饋回到與所述3D模型提供裝置對應的目的地,所述反饋資訊包括目標資訊和動作資訊,所述動作資訊指示在所述顯示裝置顯示3D模型時所述使用者的動作。One aspect of the present disclosure provides an information processing device. The information processing device includes: a 3D model obtaining device that obtains a 3D model of a body wearing clothing from a 3D model providing device; a target information obtaining device, the A target information obtaining device obtains target information about at least one of clothing and the body; a display device that displays the 3D model in a virtual space; a receiving device that receives instructions indicating where the user is located. Input of instructions for actions in the virtual space; and a feedback device that feeds feedback information back to a destination corresponding to the 3D model providing device, where the feedback information includes target information and action information, The action information indicates the user's action when the display device displays the 3D model.

所述動作資訊可包括關於在所述虛擬空間中顯示3D模型時的視點位置的資訊。The motion information may include information about a viewpoint position when a 3D model is displayed in the virtual space.

所述動作資訊可包括關於在穿著所述服裝的狀態下穿著所述服裝的所述軀體的運動的資訊。The motion information may include information on the movement of the body wearing the garment while wearing the garment.

所述運動資訊可包括關於從多個預定義的運動中選擇的運動的資訊。The movement information may include information regarding a movement selected from a plurality of predefined movements.

所述動作資訊可包括所述軀體在預定時間段內已穿著所述服裝的次數。The action information may include the number of times the garment has been worn by the body within a predetermined period of time.

所述動作信可息包括關於所述3D模型被查看的時間長度的資訊。The action information may include information about the length of time the 3D model was viewed.

所述動作資訊可包括關於針對所述服裝輸入的使用者偏好的資訊。The action information may include information regarding user preferences entered for the garment.

所述動作資訊可包括關於對所述服裝的購買動作的資訊。The action information may include information about purchasing actions for the clothing.

所述目標資訊可包括關於所述軀體與所述服裝之間的形狀或尺寸的差異的資訊。The target information may include information regarding differences in shape or size between the body and the garment.

所述目標資訊可包括關於當所述軀體穿著所述服裝時施加在所述軀體上的壓力或者所述服裝中產生的張力的資訊。The target information may include information regarding pressure exerted on the body when the garment is worn by the body or tension generated in the garment.

所述目標資訊可包括關於服裝材料的資訊。The target information may include information about clothing materials.

所述目標資訊可包括關於用於在所述虛擬空間中顯示3D模型的背景的資訊。The target information may include information about a background used to display a 3D model in the virtual space.

所述反饋資訊可包括在獲得所述動作資訊時的公眾趨勢的趨勢資訊。The feedback information may include trend information of public trends when the action information is obtained.

所述3D模型獲得裝置可獲得穿著基於以往獲得的所述反饋資訊選擇的服裝的3D模型。The 3D model obtaining device may obtain a 3D model wearing clothing selected based on the feedback information obtained in the past.

本公開的另一方面提供一種資訊處理系統,所述資訊處理系統包括:伺服器;以及資訊處理設備,其中所述伺服器包括3D模型提供裝置,所述3D模型提供裝置提供穿著服裝的軀體的3D模型,所述資訊處理設備包括:3D模型獲得裝置,所述3D模型獲得裝置從3D模型提供裝置獲得穿著所述服裝的所述軀體的3D模型;目標資訊獲得裝置,所述目標資訊獲得裝置獲得關於服裝及所述軀體中的至少一者的目標資訊;顯示裝置,所述顯示裝置在虛擬空間中顯示所述3D模型;接收裝置,所述接收裝置接收指示使用者在所述虛擬空間中的動作的指令的輸入;以及反饋裝置,所述反饋裝置將反饋資訊反饋回到與3D模型提供裝置對應的目的地,所述反饋資訊包括目標資訊和動作資訊,所述動作資訊指示在所述顯示裝置顯示所述3D模型時所述使用者的動作。Another aspect of the present disclosure provides an information processing system, the information processing system including: a server; and an information processing device, wherein the server includes a 3D model providing device, the 3D model providing device provides a representation of a body wearing clothing. 3D model, the information processing equipment includes: a 3D model obtaining device, the 3D model obtaining device obtains a 3D model of the body wearing the clothing from a 3D model providing device; a target information obtaining device, the target information obtaining device Obtain target information about at least one of clothing and the body; a display device that displays the 3D model in a virtual space; a receiving device that receives an instruction indicating that the user is in the virtual space input of action instructions; and a feedback device that feeds back feedback information to a destination corresponding to the 3D model providing device, where the feedback information includes target information and action information, and the action information is indicated in the The user's actions when the display device displays the 3D model.

本公開的又一方面提供一種致使電腦執行處理的程式,所述處理包括:從3D模型提供裝置獲得穿著服裝的軀體的3D模型;獲得關於所述服裝及所述軀體中的至少一者的目標資訊;在虛擬空間中顯示所述3D模型;接收指示使用者在所述虛擬空間中的動作的指令的輸入;以及將反饋資訊反饋回到與所述3D模型提供裝置對應的目的地,所述反饋資訊包括所述目標資訊和動作資訊,所述動作資訊指示在顯示所述3D模型時所述使用者的動作。Yet another aspect of the present disclosure provides a program that causes a computer to perform a process including: obtaining a 3D model of a body wearing clothing from a 3D model providing device; obtaining an object with respect to at least one of the clothing and the body information; displaying the 3D model in the virtual space; receiving input of instructions indicating the user's actions in the virtual space; and feeding feedback information back to a destination corresponding to the 3D model providing device, the The feedback information includes the target information and action information, and the action information indicates the user's action when the 3D model is displayed.

本公開的又一方面提供一種資訊處理方法,所述資訊處理方法包括:從3D模型提供裝置獲得穿著服裝的軀體的3D模型;獲得關於所述服裝及所述軀體中的至少一者的目標資訊;在虛擬空間中顯示所述03D模型;接收指示使用者在所述虛擬空間中的動作的指令的輸入;以及將反饋資訊反饋回到與所述3D模型提供裝置對應的目的地,所述反饋資訊包括所述目標資訊和動作資訊,所述動作資訊指示在顯示3D模型時所述使用者的動作。Another aspect of the present disclosure provides an information processing method, which includes: obtaining a 3D model of a body wearing clothing from a 3D model providing device; obtaining target information about at least one of the clothing and the body ; Display the 03D model in the virtual space; receive input of instructions indicating the user's actions in the virtual space; and feed back feedback information to a destination corresponding to the 3D model providing device, the feedback The information includes the target information and action information, and the action information indicates the user's action when displaying the 3D model.

[發明的有利效果][Beneficial effects of the invention]

根據本實施例,由於包括目標資訊和動作資訊的反饋資訊被反饋回到與3D模型提供裝置對應的目的地,因此3D模型提供裝置可提供穿著適合於使用者偏好的服裝的軀體的3D模型。因此,當存在許多服裝要進行虛擬試衣時,使用者從所述服裝中選擇適合他/她的偏好的服裝會變得容易。According to this embodiment, since the feedback information including the target information and the action information is fed back to the destination corresponding to the 3D model providing device, the 3D model providing device can provide a 3D model of the body wearing clothing suitable for the user's preference. Therefore, when there are many garments to be virtually tried on, it becomes easy for the user to select the garment that suits his/her preference from the garments.

1、配置1. Configuration

圖1是示出虛擬試衣系統1的功能配置的圖,虛擬試衣系統1是本公開的資訊處理系統的實施例。虛擬試衣系統1是提供關於服裝的資訊的系統,且更具體來說虛擬試衣系統1是輸出關於執行其中服裝的3D模型被穿在人體的3D模型上的類比的結果的資訊的系統。在一個示例中,虛擬試衣系統1用於從多件服裝之中搜索符合使用者偏好的服裝。3D模型是表示物件在虛擬空間中的三維形狀的三維虛擬物件。FIG. 1 is a diagram showing the functional configuration of a virtual fitting system 1 which is an embodiment of the information processing system of the present disclosure. The virtual fitting system 1 is a system that provides information about clothing, and more specifically, the virtual fitting system 1 is a system that outputs information about a result of performing an analogy in which a 3D model of clothing is worn on a 3D model of a human body. In one example, the virtual fitting system 1 is used to search for clothing that meets the user's preference from multiple pieces of clothing. A 3D model is a three-dimensional virtual object that represents the three-dimensional shape of an object in virtual space.

虛擬試衣系統1提供服裝搜索服務。虛擬試衣系統1包括作為硬體的伺服器20和使用者終端10。伺服器20與使用者終端10經由網路300連接。伺服器20是在服裝檢索服務中充當伺服器的電腦。使用者終端10是根據本公開的資訊處理設備的示例並且是在服裝搜索服務中用作客戶端的電腦。儘管在圖1中示出一個使用者終端10,然而可提供多個使用者終端10。The virtual fitting system 1 provides clothing search services. The virtual fitting system 1 includes a server 20 and a user terminal 10 as hardware. The server 20 and the user terminal 10 are connected via the network 300. The server 20 is a computer serving as a server in the clothing search service. The user terminal 10 is an example of the information processing device according to the present disclosure and is a computer used as a client in the clothing search service. Although one user terminal 10 is shown in FIG. 1, a plurality of user terminals 10 may be provided.

圖2是示出虛擬試衣系統1的功能配置的方塊圖。虛擬試衣系統1包括3D模型獲得裝置11、目標資訊獲得裝置12、接收裝置13、顯示裝置14、反饋裝置15、動作資訊獲得裝置16、儲存裝置17、控制裝置19、3D模型提供裝置21、分析裝置22、儲存裝置23及控制裝置29。在本實施例中,3D模型獲得裝置11、目標資訊獲得裝置12、接收裝置13、顯示裝置14、反饋裝置15、儲存裝置17及控制裝置19在使用者終端10中實施。3D模型提供裝置21、分析裝置22、儲存裝置23及控制裝置29在伺服器20中實施。FIG. 2 is a block diagram showing the functional configuration of the virtual fitting system 1. The virtual fitting system 1 includes a 3D model obtaining device 11, a target information obtaining device 12, a receiving device 13, a display device 14, a feedback device 15, a motion information obtaining device 16, a storage device 17, a control device 19, a 3D model providing device 21, Analysis device 22, storage device 23 and control device 29. In this embodiment, the 3D model obtaining device 11 , the target information obtaining device 12 , the receiving device 13 , the display device 14 , the feedback device 15 , the storage device 17 and the control device 19 are implemented in the user terminal 10 . The 3D model providing device 21, analysis device 22, storage device 23 and control device 29 are implemented in the server 20.

3D模型提供裝置21向使用者終端10提供3D模型。3D模型提供裝置21儲存服裝模型DB 211和使用者模型DB 212。服裝模型DB 211是儲存關於多件服裝的資訊的DB。關於服裝的資訊包括表示服裝的三維形狀的3D模型。使用者模型DB是儲存關於多個使用者的資訊的DB。使用者資訊包括表示使用者的人體的三維形狀的3D模型。3D模型提供裝置21利用服裝模型DB 211及使用者模型DB 212來檢索適合於使用者終端10的使用者的服裝並向使用者終端10提供所述服裝的3D模型。3D模型提供裝置21使用服裝模型DB 211和使用者模型DB 212對穿著所期望服裝的人體(使用者終端10的使用者的人體)的3D的模型進行合成(即,虛擬試衣)並將所合成的模型提供給使用者終端10。The 3D model providing device 21 provides a 3D model to the user terminal 10 . The 3D model providing device 21 stores a clothing model DB 211 and a user model DB 212. The clothing model DB 211 is a DB that stores information on a plurality of pieces of clothing. The information about the garment includes a 3D model representing the three-dimensional shape of the garment. The user model DB is a DB that stores information about multiple users. The user information includes a 3D model representing the three-dimensional shape of the user's human body. The 3D model providing device 21 uses the clothing model DB 211 and the user model DB 212 to retrieve clothing suitable for the user of the user terminal 10 and provides the user terminal 10 with a 3D model of the clothing. The 3D model providing device 21 uses the clothing model DB 211 and the user model DB 212 to synthesize (ie, virtual try on) a 3D model of a human body wearing desired clothing (the human body of the user terminal 10 ) and The synthesized model is provided to the user terminal 10.

3D模型獲得裝置11從3D模型提供裝置21獲得服裝或穿著服裝的人體(例如,使用者終端10的使用者的人體)的3D模型。The 3D model obtaining device 11 obtains a 3D model of clothing or a human body wearing the clothing (for example, the human body of the user of the user terminal 10 ) from the 3D model providing device 21 .

目標資訊獲得裝置12基於由3D模型獲得裝置11獲得的3D模型獲得關於服裝及人體中的至少一者的目標資訊。在一個示例中,目標資訊包括關於當服裝被穿在人體上時人體的3D模型和服裝的3D模型的特定部位(例如,臀部和/或頸部)的尺寸差異的資訊。目標資訊還包括當服裝被穿在人體上時施加在人體的特定部位(例如,兩臂和/或胸部)上的壓力的資訊或者施加在服裝上的張力的資訊。可以壓力圖或張力圖的形式提供關於壓力或張力的資訊。目標資訊還包括關於服裝材料的資訊(例如,諸如棉、聚酯、絲等材料或者諸如摩擦係數等參數)。目標資訊還包括關於在虛擬空間中顯示3D模型的背景的資訊(例如,山脈、海洋、街道、住宅等)。The target information obtaining device 12 obtains target information about at least one of clothing and the human body based on the 3D model obtained by the 3D model obtaining device 11 . In one example, the target information includes information about size differences of specific parts (eg, hips and/or neck) of the 3D model of the human body and the 3D model of the garment when the garment is worn on the human body. The target information also includes information about the pressure exerted on specific parts of the human body (for example, the arms and/or the chest) when the garment is worn on the human body or the information about the tension exerted on the garment. Information about pressure or tension can be provided in the form of pressure or tension diagrams. The target information also includes information about the clothing material (for example, materials such as cotton, polyester, silk, etc. or parameters such as friction coefficient). The target information also includes information about the background in which the 3D model is displayed in the virtual space (eg, mountains, oceans, streets, houses, etc.).

接收裝置13接收指示使用者的動作的指令的輸入。顯示裝置14是由3D模型獲得裝置11獲得的3D模型(即,服裝的3D模型或穿著服裝的人體的3D模型)並且在虛擬空間中顯示3D模型。顯示裝置14可根據由接收裝置13接收的指令來改變正在顯示的3D模型的外觀或運動。The receiving device 13 receives an input of an instruction instructing the user's action. The display device 14 is a 3D model obtained by the 3D model obtaining device 11 (ie, a 3D model of clothing or a 3D model of a human body wearing clothing) and displays the 3D model in a virtual space. The display device 14 may change the appearance or movement of the 3D model being displayed according to instructions received by the receiving device 13 .

反饋裝置15將反饋資訊輸出到與3D模型提供裝置21對應的目的地,具體來說輸出到分析裝置22。反饋資訊包括目標資訊和動作資訊。此處,動作資訊包括操作使用者終端10的使用者的動作資訊和使用者(人體)在虛擬空間中的動作資訊。The feedback device 15 outputs the feedback information to a destination corresponding to the 3D model providing device 21 , specifically to the analysis device 22 . Feedback information includes target information and action information. Here, the motion information includes motion information of the user operating the user terminal 10 and motion information of the user (human body) in the virtual space.

前者動作資訊的示例包括關於在虛擬空間中顯示3D模型時視點位置的資訊或者關於位置的移動歷史的資訊、關於查看3D模型的時間長度的資訊、關於使用者對服裝的偏好輸入的資訊(例如,“喜歡按鈕”等輸入)以及關於對服裝的購買動作的資訊(例如,是否購買所顯示的服裝)。Examples of the former action information include information about the position of the viewpoint when displaying the 3D model in the virtual space or information about the movement history of the position, information about the length of time the 3D model was viewed, information about the user's preference input for clothing (e.g. , "like button" and other inputs) as well as information about purchase actions on clothing (e.g., whether to purchase the displayed clothing).

另外,後者動作資訊包括關於使使用者(人體)穿著服裝的運動(例如,行走、跑步、舉手等)的資訊以及使用者(人體)在預定時間段期間已穿著服裝的次數、使用者(人體)在顯示期間已更換服裝的次數或者使用者已經服裝更換成其他服裝的次數。與使用者要進行的移動相關的資訊可為與從多個預定義的移動中選擇的移動相關的資訊。關於使用者(人體)要進行的運動的資訊可指定開始姿勢(例如,姿勢)和結束姿勢(例如,坐在椅子上的姿勢)。在虛擬試衣中,穿著服裝的使用者的3D模型從規定的開始姿勢移動到結束姿勢。In addition, the latter action information includes information on movements (for example, walking, running, raising hands, etc.) that cause the user (human body) to wear the clothing, as well as the number of times the user (human body) has worn the clothing during a predetermined time period, the user ( Human body) The number of times the clothing has been changed during the display period or the number of times the user has changed clothing to other clothing. The information related to the movement to be performed by the user may be information related to the movement selected from a plurality of predefined movements. Information about the movement to be performed by the user (human body) may specify a start pose (e.g., a pose) and an end pose (e.g., a posture while sitting in a chair). In a virtual fitting, the 3D model of the user wearing the garment moves from a prescribed start pose to an end pose.

儲存裝置17儲存各種資料和程式。控制裝置19執行各種控制。The storage device 17 stores various data and programs. The control device 19 performs various controls.

分析裝置22對從一個或多個使用者終端10獲得的反饋資訊進行分析。分析裝置22儲存反饋資訊DB 221。反饋資訊DB 221是儲存來自執行服裝的虛擬試衣處理的使用者終端10的反饋資訊的DB。分析裝置22對反饋資訊DB 221進行分析且基於分析結果向例如3D模型提供裝置21提供用於增強3D模型提供裝置21搜索適合於使用者偏好的服裝的能力的資訊。The analysis device 22 analyzes feedback information obtained from one or more user terminals 10 . The analysis device 22 stores the feedback information DB 221. The feedback information DB 221 is a DB that stores feedback information from the user terminal 10 that executes the virtual fitting process of clothing. The analysis device 22 analyzes the feedback information DB 221 and provides, for example, the 3D model providing device 21 with information for enhancing the ability of the 3D model providing device 21 to search for clothing suitable for the user's preference based on the analysis results.

儲存裝置23儲存各種資料和程式。控制裝置29執行各種控制。The storage device 23 stores various data and programs. The control device 29 performs various controls.

圖3是示出使用者終端10的硬體配置的方塊圖。使用者終端10是電腦設備(例如,智慧型電話或個人電腦),具有中央處理器(CPU)101、儲存器102、儲存器件103、通訊設備104、輸入裝置105及輸出設備106。CPU 101是以編程方式對使用者終端10的其他元件進行控制的處理器。儲存器102是當CPU 101執行程式時用作工作區域的主儲存設備。儲存器102包括例如隨機存取儲存器(RAM)。儲存器件103是用於儲存各種資料和程式的輔助儲存設備,包括例如傳統硬碟(HDD)或固態硬碟(SSD)。通訊設備104是根據預定通訊協定(例如,長期演進(LTE)、WiFi、乙太網等)與其他設備進行通訊的設備。輸入裝置105是用於向使用者終端10輸入資訊或指令的設備並且包括例如觸控式螢幕、鍵盤、按鈕及麥克風中的至少一者。輸出設備106是用於向使用者輸出資訊的設備並且包括例如顯示器和/或揚聲器。FIG. 3 is a block diagram showing the hardware configuration of the user terminal 10 . The user terminal 10 is a computer device (eg, a smart phone or a personal computer) having a central processing unit (CPU) 101, a memory 102, a storage device 103, a communication device 104, an input device 105, and an output device 106. The CPU 101 is a processor that controls other components of the user terminal 10 in a programmatic manner. The memory 102 is the main storage device used as a work area when the CPU 101 executes a program. Storage 102 includes, for example, random access memory (RAM). The storage device 103 is an auxiliary storage device used to store various data and programs, including, for example, a traditional hard disk drive (HDD) or a solid state drive (SSD). The communication device 104 is a device that communicates with other devices according to a predetermined communication protocol (eg, Long Term Evolution (LTE), WiFi, Ethernet, etc.). The input device 105 is a device for inputting information or instructions to the user terminal 10 and includes, for example, at least one of a touch screen, a keyboard, buttons, and a microphone. Output device 106 is a device for outputting information to a user and includes, for example, a display and/or speakers.

在此示例中,儲存器件103安裝有執行服裝的虛擬試衣處理的應用程式(在下文中被稱為“客戶端程式”)。當CPU 101執行此客戶端程式時,實施圖2中所示的功能。當CPU 101執行客戶端程式時,CPU 101是3D模型獲得裝置11、目標資訊獲得裝置12、反饋裝置15及控制裝置19的示例,輸入裝置105是接收裝置13的示例,並且儲存器102及儲存器件103中的至少一者是儲存裝置17的示例。In this example, the storage device 103 is installed with an application program (hereinafter referred to as a "client program") that performs virtual fitting processing of clothing. When the CPU 101 executes this client program, the functions shown in Figure 2 are implemented. When the CPU 101 executes the client program, the CPU 101 is an example of the 3D model obtaining device 11, the target information obtaining device 12, the feedback device 15 and the control device 19, the input device 105 is an example of the receiving device 13, and the memory 102 and storage At least one of devices 103 is an example of storage device 17 .

儘管未在圖中示出,然而伺服器20是具有CPU、儲存器、儲存器件及通訊介面(IF)的電腦設備。儲存器件儲存用於使電腦設備在虛擬試衣系統1中用作伺服器的程式(在下文中被稱為“伺服器程式”)。通過CPU執行伺服器程式,實施圖中所示的功能。當CPU執行伺服器程式時,CPU是3D模型提供裝置21、分析裝置22及控制裝置29的示例,並且儲存器及儲存器件中的至少一者是儲存裝置23的示例。Although not shown in the figure, the server 20 is a computer device having a CPU, a memory, a storage device and a communication interface (IF). The storage device stores a program for causing the computer device to function as a server in the virtual fitting system 1 (hereinafter referred to as the "server program"). The server program is executed by the CPU to implement the functions shown in the figure. When the CPU executes the server program, the CPU is an example of the 3D model providing device 21 , the analysis device 22 and the control device 29 , and at least one of the memory and the storage device is an example of the storage device 23 .

2、操作2. Operation

圖4是示出虛擬試衣系統1的操作示例的時序圖。在此操作示例中,使用者終端10的3D模型獲得裝置11向伺服器20發送(在步驟S2中)服裝的搜索請求(或提取請求)。搜索請求包括用作對服裝進行提取或搜索的搜索關鍵字的資訊,即用於縮小服裝範圍的搜索條件。搜索關鍵字包括例如諸如使用者終端10的使用者的使用者ID、服裝類型、尺寸及價格區間等資訊。FIG. 4 is a sequence diagram showing an operation example of the virtual fitting system 1 . In this operation example, the 3D model obtaining device 11 of the user terminal 10 sends (in step S2 ) a search request (or extraction request) for clothing to the server 20 . The search request includes information used as search keywords to extract or search clothing, that is, search criteria used to narrow down the range of clothing. The search keywords include, for example, information such as the user ID of the user of the user terminal 10, clothing type, size, and price range.

當接收到搜索請求時,伺服器20的3D模型提供裝置21從記錄在服裝模型DB 211中的記錄中提取(在步驟S4中)符合搜索請求(或搜索條件)的服裝記錄。When receiving the search request, the 3D model providing device 21 of the server 20 extracts (in step S4) clothing records that meet the search request (or search conditions) from the records recorded in the clothing model DB 211.

圖5是示出服裝模型DB 211的示例性配置的圖。服裝模型DB 211包括多個記錄。每一記錄對應於一件服裝。所述記錄包括服裝ID 211a、品牌211b、類型211c、尺寸211d、價格211e及3D模型211f。服裝ID 211a是唯一標識服裝的標識符。品牌211b指示服裝的品牌。類型211c指示服裝的類型,例如襯衫、夾克、裙子、褲子等。尺寸211d指示服裝的尺寸。價格211e指示服裝的價格。3D模型211f指示3D建模資料本身或服裝的3D建模資料的位置。應注意,本文中所示的資料僅是示例,並且除了這些資訊之外或代替這些資訊,服裝模型DB 211可包括諸如服裝顏色、服裝設計師、服裝製造商、服裝製造商、服裝品牌、服裝銷售年份、服裝生產地點、服裝銷售地點等資訊。FIG. 5 is a diagram showing an exemplary configuration of the clothing model DB 211. The clothing model DB 211 includes a plurality of records. Each record corresponds to a garment. The record includes clothing ID 211a, brand 211b, type 211c, size 211d, price 211e and 3D model 211f. The garment ID 211a is an identifier that uniquely identifies the garment. Brand 211b indicates the brand of clothing. Type 211c indicates the type of clothing, such as shirt, jacket, skirt, pants, etc. Size 211d indicates the size of the garment. Price 211e indicates the price of the garment. The 3D model 211f indicates the position of the 3D modeling data itself or the 3D modeling data of the garment. It should be noted that the information shown herein is only an example, and in addition to or instead of these information, the clothing model DB 211 may include information such as clothing color, clothing designer, clothing manufacturer, clothing manufacturer, clothing brand, clothing Sales year, clothing production location, clothing sales location and other information.

在此實施例中,當從服裝模型DB 211提取服裝時,3D模型提供裝置21參考由分析裝置22提供的分析結果。3D模型提供裝置21響應於例如從使用者終端10接收到搜索請求而從分析裝置22獲得分析結果。分析結果包括(a)發出搜索請求的個人使用者的偏好以及(b)利用虛擬試衣系統1的多個使用者的偏好中的至少一者。此分析的結果將在稍後進行描述。In this embodiment, when extracting clothing from the clothing model DB 211, the 3D model providing device 21 refers to the analysis result provided by the analyzing device 22. The 3D model providing device 21 obtains the analysis result from the analysis device 22 in response to, for example, receiving a search request from the user terminal 10 . The analysis results include (a) the preferences of the individual user who issued the search request and (b) at least one of the preferences of multiple users utilizing the virtual fitting system 1 . The results of this analysis will be described later.

3D模型提供裝置21從服裝模型DB 211提取適合於從使用者終端10接收的搜索請求和從分析裝置22獲得的分析結果的服裝。例如,如果搜索請求包括類型“襯衫”、尺寸“M”及價格範圍“10,000至20,000日元”的資訊,並且分析結果包括“使用者更喜歡柔軟膚感及寬鬆合身”及“深藏青色在此搜索中流行”的資訊,則3D模型提供裝置21從服裝模型DB 211提取服裝條件的記錄。在此示例中,3D建模裝置21提取滿足這些條件的多個記錄。The 3D model providing device 21 extracts clothing suitable for the search request received from the user terminal 10 and the analysis result obtained from the analysis device 22 from the clothing model DB 211 . For example, if a search request includes information for type "shirt," size "M" and price range "10,000 to 20,000 yen," and the analysis results include "Users prefer a softer feel and looser fit" and "Dark navy in "popular" information in this search, the 3D model providing device 21 extracts the record of clothing conditions from the clothing model DB 211. In this example, the 3D modeling device 21 extracts a plurality of records that satisfy these conditions.

再次參照圖4。在步驟S6中,3D模型提供裝置21將所提取的服裝資訊發送到使用者終端10。此資訊包括例如所提取服裝及縮略圖的列表。這些服裝候選進行虛擬試衣。Refer again to Figure 4. In step S6, the 3D model providing device 21 sends the extracted clothing information to the user terminal 10. This information includes, for example, a list of extracted outfits and thumbnails. These clothing candidates undergo virtual fittings.

在使用者終端10中,3D模型獲得裝置11獲得關於服裝的資訊。顯示裝置14顯示關於服裝的資訊。此外,顯示裝置14顯示提示使用者從多件服裝之中選擇要進行虛擬試穿的服裝的螢幕。在步驟S8中,接受裝置13接受使用者對服裝的選擇。In the user terminal 10, the 3D model obtaining device 11 obtains information about clothing. The display device 14 displays information about clothing. In addition, the display device 14 displays a screen prompting the user to select a garment to be virtually tried on from a plurality of garments. In step S8, the accepting device 13 accepts the user's selection of clothing.

當使用者選擇服裝時,3D建模獲得裝置11向伺服器20發送進行虛擬試衣的請求(步驟S10)。虛擬試衣請求包括由使用者選擇的服裝的服裝ID。When the user selects clothing, the 3D modeling obtaining device 11 sends a request for virtual fitting to the server 20 (step S10 ). The virtual fitting request includes the garment ID of the garment selected by the user.

當從使用者終端10接收到虛擬試衣請求時,在步驟S12中,伺服器20的3D模型提供裝置21從使用者模型DB 212讀取與在步驟S2中接收到的使用者ID對應的記錄並從所述記錄獲得使用者的人體的3D模型212c。另外,3D模型提供裝置21從服裝模型DB 211讀取與虛擬裝置請求中所包括的服裝ID對應的記錄並從所述記錄獲得3D模型。When a virtual fitting request is received from the user terminal 10, in step S12, the 3D model providing device 21 of the server 20 reads the record corresponding to the user ID received in step S2 from the user model DB 212. And a 3D model 212c of the user's human body is obtained from the record. In addition, the 3D model providing device 21 reads the record corresponding to the clothing ID included in the virtual device request from the clothing model DB 211 and obtains the 3D model from the record.

圖6是示出使用者模型DB 212的示例性配置的圖。使用者模型DB 212包括多個記錄。每一記錄對應於一個使用者。每一記錄包括使用者ID 212a、屬性212b、3D模型212c及購買歷史212d。使用者ID 212a是唯一標識使用者的標識符。屬性212b是指示使用者的屬性的資訊並且包括例如使用者的姓名212b1、性別212b2及年齡212b3。3D模型212c指示3D建模資料本身或使用者的人體的3D建模資料的位置。購買歷史212d指示使用者以往購買的服裝的歷史。FIG. 6 is a diagram showing an exemplary configuration of the user model DB 212. The user model DB 212 includes a plurality of records. Each record corresponds to a user. Each record includes user ID 212a, attributes 212b, 3D model 212c and purchase history 212d. The user ID 212a is an identifier that uniquely identifies the user. The attributes 212b are information indicating attributes of the user and include, for example, the user's name 212b1, gender 212b2, and age 212b3. The 3D model 212c indicates the 3D modeling data itself or the position of the 3D modeling data of the user's human body. The purchase history 212d indicates the history of clothing purchased by the user in the past.

3D模型提供裝置21使用3D模型211f及3D模型212c來生成(在步驟S14中)表示穿著所選服裝的使用者(人體)的三維形狀的3D模型。在此種情況下,為穿著服裝的使用者生成3D模型的處理包括對服裝被穿在人體上時的改變(諸如服裝沿其體形起皺或者由於重力使其裙子或袖子下垂)進行模擬。3D模型提供裝置21將指示穿著服裝的人體的3D模型的類比結果的資料發送到使用者終端10(步驟S16)。指示模擬結果的資料例如是穿著服裝的人體的3D建模資料本身、其中穿著服裝的人體的3D模型採取預定姿勢的靜止圖像的資料、其中穿著服裝的人體的3D模型執行預定移動(行走、奔跑、跳躍、舉起右手等)的移動圖像資料或者指示穿著服裝的人體的壓力圖的圖像資料。The 3D model providing device 21 uses the 3D model 211f and the 3D model 212c to generate (in step S14) a 3D model representing the three-dimensional shape of the user (human body) wearing the selected clothing. In this case, the process of generating a 3D model of a user wearing the garment includes simulating the changes that occur when the garment is worn on a human body, such as the garment wrinkling along its body shape or causing its skirt or sleeves to droop due to gravity. The 3D model providing device 21 transmits data indicating the analogy result of the 3D model of the human body wearing clothing to the user terminal 10 (step S16). The data indicating the simulation results are, for example, 3D modeling data of the human body wearing clothing itself, data of still images in which the 3D model of the human body wearing clothing takes a predetermined posture, data in which the 3D model of the human body wearing clothing performs a predetermined movement (walking, Running, jumping, raising the right hand, etc.) moving image data or image data indicating the pressure map of the human body wearing clothing.

在使用者終端10中,3D模型獲得裝置11從伺服器20獲得指示模擬結果的資料。在步驟S18中,顯示裝置14顯示模擬結果。In the user terminal 10, the 3D model obtaining device 11 obtains data indicating the simulation results from the server 20. In step S18, the display device 14 displays the simulation results.

圖7是例示出顯示在使用者終端10上的虛擬試衣螢幕的圖。虛擬試衣螢幕包括用於顯示3D建模的區域91和用於輸入使用者指令的UI對象92。在區域91中,顯示穿著服裝的人體的3D模型的圖像UD。UI對象92包括用於接受使用者動作(例如購買服裝、改變視點等)的指令的軟按鈕。FIG. 7 is a diagram illustrating a virtual fitting screen displayed on the user terminal 10 . The virtual fitting screen includes an area 91 for displaying the 3D model and a UI object 92 for inputting user instructions. In area 91, an image UD of a 3D model of a human body wearing clothing is displayed. UI object 92 includes soft buttons for accepting instructions for user actions (eg, purchasing clothing, changing viewpoints, etc.).

當顯示裝置14顯示虛擬試衣的3D模型時,接收裝置13接收關於使用者的動作的指令(步驟S20)。如果模擬結果是穿著服裝的人體的3D建模資料本身,則顯示裝置14可根據由接收裝置13接收的操作來改變對3D模型的顯示。例如,根據使用者的按鈕操作,可即時改變3D模型的視點或者可改變3D模型的姿勢。接收裝置13在儲存裝置17中儲存關於所接收的指令的資訊。When the display device 14 displays the 3D model of the virtual fitting, the receiving device 13 receives instructions regarding the user's actions (step S20 ). If the simulation result is the 3D modeling data itself of the human body wearing clothing, the display device 14 may change the display of the 3D model according to the operation received by the receiving device 13 . For example, according to the user's button operation, the viewpoint of the 3D model can be changed immediately or the posture of the 3D model can be changed. The receiving device 13 stores information about the received instructions in the storage device 17 .

在步驟S22中,在顯示裝置14顯示穿著服裝的人體的3D模型的同時,動作資訊獲得裝置16基於由接收裝置13接收的關於使用者的動作的指令獲得表示使用者的動作的動作資訊。在此示例中,動作資訊獲得裝置16從儲存裝置17獲得動作資訊。如上所述,動作資訊包括操作使用者終端10的使用者的動作資訊及由顯示裝置14顯示的使用者(人體)在虛擬空間中的動作資訊中的至少一者。當接受裝置13獲得後者動作資訊時,顯示裝置14根據所獲得的動作資訊使正在顯示的3D模型移動。In step S22 , while the display device 14 displays the 3D model of the human body wearing clothing, the motion information obtaining device 16 obtains motion information representing the user's motion based on the instruction regarding the user's motion received by the receiving device 13 . In this example, the action information obtaining device 16 obtains action information from the storage device 17 . As described above, the motion information includes at least one of motion information of the user operating the user terminal 10 and motion information of the user (human body) in the virtual space displayed by the display device 14 . When the receiving device 13 obtains the latter motion information, the display device 14 moves the 3D model being displayed according to the obtained motion information.

接下來,目標資訊獲得裝置12獲得由3D模型獲得裝置11獲得的(步驟S16)關於3D模型的目標資訊(步驟S24)。在一個實施例中,關於3D模型的目標資訊與3D模型一起從伺服器20獲得並儲存在儲存裝置17中。目標資訊獲得裝置12從儲存裝置17獲得目標資訊。Next, the target information obtaining device 12 obtains the target information about the 3D model obtained by the 3D model obtaining device 11 (step S16 ) (step S24 ). In one embodiment, object information about the 3D model is obtained from the server 20 and stored in the storage device 17 together with the 3D model. The target information obtaining device 12 obtains the target information from the storage device 17 .

在步驟S26中,反饋裝置15將反饋資訊發送到伺服器20。反饋資訊包括在步驟S24中獲得的目標資訊、在步驟S22中獲得的動作資訊及指示當前時間的時間戳。步驟S26中的處理由預定事件觸發。此事件例如是使正在顯示的3D模型的顯示停止的時間,且具體來說例如是將服裝更換成其他服裝的指令、終止虛擬試衣的指令或採購服裝的指令。In step S26 , the feedback device 15 sends feedback information to the server 20 . The feedback information includes the target information obtained in step S24, the action information obtained in step S22, and a timestamp indicating the current time. The processing in step S26 is triggered by a predetermined event. This event is, for example, a time to stop the display of the 3D model being displayed, and specifically, it is an instruction to change clothing to other clothing, an instruction to terminate a virtual fitting, or an instruction to purchase clothing.

在伺服器20中,分析裝置22接收反饋資訊並將所接收的反饋資訊儲存在反饋資訊DB 221中(步驟S28)。In the server 20 , the analysis device 22 receives the feedback information and stores the received feedback information in the feedback information DB 221 (step S28 ).

圖8是示出反饋資訊DB 221的示例性配置的圖。如圖8中所示,在反饋資訊DB 221中,目標資訊221c及動作資訊221d與一組使用者ID 221a及服裝ID 221b相關聯。FIG. 8 is a diagram showing an exemplary configuration of the feedback information DB 221. As shown in FIG. 8, in the feedback information DB 221, the target information 221c and the action information 221d are associated with a set of user ID 221a and clothing ID 221b.

此處,使用者ID 221a是作為反饋資訊的提供者的使用者的識別資訊並且是在步驟S2中由3D模型獲得裝置11發送的使用者ID。服裝ID 221b是穿著在步驟S16中由3D模型獲得裝置11獲得的服裝的使用者的3D模型中的服裝的ID。Here, the user ID 221a is the identification information of the user who is the provider of the feedback information and is the user ID sent by the 3D model obtaining device 11 in step S2. The clothing ID 221b is the ID of the clothing in the 3D model of the user wearing the clothing obtained by the 3D model obtaining device 11 in step S16.

目標資訊221c是由目標資訊獲得裝置12從穿著服裝的使用者的3D模型獲得的資訊。目標資訊包括例如3D模型中的服裝與人體之間的尺寸差221c1(在預定位置處)、壓力圖中的典型值(例如,施加到特定部分的壓力)221c2、服裝的材料221c3及指示顯示3D模型的背景的資訊221c4,所述典型值221c2指示當人體穿著服裝時施加到人體的每一部位的壓力分佈。The target information 221c is information obtained by the target information obtaining device 12 from the 3D model of the user wearing the clothing. The target information includes, for example, the size difference 221c1 between the garment and the human body in the 3D model (at a predetermined position), typical values in the pressure map (eg, pressure applied to a specific part) 221c2, the material of the garment 221c3, and the indication display 3D The model background information 221c4, the typical value 221c2 indicates the pressure distribution applied to each part of the human body when the human body wears the garment.

動作資訊221d是指示在穿著服裝的使用者的3D模型顯示在顯示器上時由接收裝置13接收的關於使用者的動作的指令的資訊。動作資訊包括當在虛擬空間中顯示3D模型時用於在虛擬空間中查看3D模型212c的視點221d1、所顯示的3D模型的移動221d2、3D模型的查看時間(即,顯示時間)221d3以及指示使用者是否已購買所顯示服裝的購買動作221d4。The action information 221d is information indicating an instruction regarding the user's action received by the receiving device 13 when the 3D model of the user wearing clothing is displayed on the display. The action information includes a viewpoint 221d1 for viewing the 3D model 212c in the virtual space when the 3D model is displayed in the virtual space, movement 221d2 of the displayed 3D model, viewing time (ie, display time) 221d3 of the 3D model, and instruction usage Whether the person has purchased the displayed clothing purchase action 221d4.

接下來,在伺服器20中,分析裝置22對反饋資訊DB 221進行分析(步驟S30)。分析工具22使用反饋資訊DB 221執行兩種主要類型的分析。(a)對具體個人的分析。(b)對不針對特定個人的使用者群體的分析。在前一種分析中,分析裝置22對記錄在反饋資訊DB 221中的來自使用者的反饋資訊進行分析,以確定各個使用者關於服裝的偏好。然後,分析裝置22向3D模型提供裝置21提供指示分析結果的資訊。3D模型提供裝置21使用從分析裝置22提供的資訊執行過濾,使得在提取服裝的3D模型時提取適合於使用者品味的服裝。例如,當對與特定使用者對應的多條反饋資訊進行分析並且通過分析發現使用者傾向于購買合身寬鬆的襯衫(例如,胸部、軀幹及兩臂的尺寸差221c1是大於參考值的正值的服裝)時,3D模型提供裝置21可執行增大合身寬鬆的服裝的優先級並提取對服裝的處理。Next, in the server 20 , the analysis device 22 analyzes the feedback information DB 221 (step S30 ). The analysis tool 22 uses the feedback information DB 221 to perform two main types of analysis. (a) Analysis of specific individuals. (b) Analysis of user groups that are not targeted at specific individuals. In the former analysis, the analysis device 22 analyzes the feedback information from the users recorded in the feedback information DB 221 to determine the clothing preferences of each user. Then, the analysis device 22 provides information indicating the analysis result to the 3D model providing device 21 . The 3D model providing device 21 performs filtering using the information provided from the analyzing device 22 so that clothing suitable for the user's taste is extracted when extracting the 3D model of the clothing. For example, when multiple pieces of feedback information corresponding to a specific user are analyzed and it is found through the analysis that the user tends to buy loose-fitting shirts (for example, the size difference 221c1 of the chest, torso, and arms is a positive value greater than the reference value clothing), the 3D model providing device 21 may perform a process of increasing the priority of clothing that fits loosely and extracting the clothing.

在後一種分析中,分析裝置22對記錄在反饋資訊DB 221中的來自使用者群體的反饋資訊進行分析,以確定使用者群體對服裝的偏好。例如,基於諸如年齡、性別、居住地、身高、體重及購買歷史等使用者屬性來設定使用者群體。可選地,所有使用者可被視為單個使用者群體。例如,如果身高高於參考值的男性使用者傾向於購買緊身褲(例如,腰圍、臀圍及大腿尺寸221c1均是小於參考值的正值的服裝),則3D模型提供處理器21可通過增大緊身褲的優先級來提取服裝。In the latter analysis, the analysis device 22 analyzes the feedback information from the user group recorded in the feedback information DB 221 to determine the user group's preference for clothing. For example, user groups are set based on user attributes such as age, gender, place of residence, height, weight, and purchase history. Alternatively, all users can be treated as a single user group. For example, if a male user with a height higher than the reference value tends to purchase tight pants (for example, the waist, hip and thigh sizes 221c1 are all garments with positive values smaller than the reference value), the 3D model providing processor 21 can increase the Big tights are the priority to extract clothing.

如上所述,根據本實施例,由於包括目標資訊和動作資訊的反饋資訊被反饋回到與3D模型提供裝置21對應的分析裝置22,因此3D模型提供裝置21可提供穿著適合於使用者偏好的服裝的軀體的3D模型。因此,當存在許多服裝要進行虛擬試衣時,使用者從所述服裝選擇適合他/她的偏好的服裝變得容易。As described above, according to this embodiment, since the feedback information including target information and action information is fed back to the analysis device 22 corresponding to the 3D model providing device 21, the 3D model providing device 21 can provide clothing suitable for the user's preference. 3D model of the clothing body. Therefore, when there are many garments to be virtually tried on, it becomes easy for the user to select a garment that suits his/her preference from the garments.

3、修改示例3. Modify the example

本發明不限於上述實施例並且可進行各種修改。將在以下描述變化。以下修改示例中描述的物項的部件可結合一些其他物項來實施。The present invention is not limited to the above-described embodiment and various modifications can be made. Changes will be described below. Components of the items described in the following modified examples may be implemented in combination with some other items.

(1)從使用者終端10發送到伺服器20的反饋資訊可包括趨勢資訊。趨勢資訊可包括關於時尚的資訊(例如,今年的紅色流行)及關於社會狀況的趨勢資訊(例如,SDG、環境問題等。在這種情況下,當使用者操作使用者終端10來訪問互聯網網站時,可從訪問歷史生成趨勢資訊並將所述趨勢資訊包括在反饋資訊中。(1) The feedback information sent from the user terminal 10 to the server 20 may include trend information. Trend information may include information about fashion (for example, red is popular this year) and trend information about social conditions (for example, SDG, environmental issues, etc.). In this case, when the user operates the user terminal 10 to access the Internet website When , trend information can be generated from the access history and included in the feedback information.

(2)在以上實施例中,對作為軀體的人體執行虛擬試衣,但虛擬試衣可對除人體之外的軀體(例如作為寵物的動物)執行。在以上實施例中,對使用者終端10的使用者他/她自己的3D模型執行虛擬試衣,但是可使用除所述使用者之外的另一個人的3D模型來執行虛擬試衣。例如,可預期使用者使另一個人進行服裝的虛擬試衣並將使用者喜歡的服裝呈現給所述另一個人。(2) In the above embodiment, virtual fitting is performed on a human body as a body, but virtual fitting may be performed on a body other than the human body (for example, an animal as a pet). In the above embodiment, the virtual fitting is performed on the user's own 3D model of the user terminal 10 , but the virtual fitting may be performed using a 3D model of another person other than the user. For example, a user may be expected to cause another person to virtually try on clothing and present the user's preferred clothing to the other person.

(3)動作資訊中所包括的關於購買行動的資訊不限於實施例中例示的資訊。與購買動作相關的資訊可為例如指示是否已購買服裝的3D建模資料(而不是實際資料)的資訊。購買動作還可包括租賃或免費下載以及購買的歷史記錄。對於3D建模資料,應用程式比真實服裝更容易識別。例如,還容易記錄遊戲標題或應用程式名稱的歷史,其中使用服裝的應用程式3D建模資料。可選地,如果使用者在購買3D建模資料之後購買實際服裝,則可提供諸如對實際服裝的價格打折的服務。(3) The information about the purchase action included in the action information is not limited to the information illustrated in the embodiment. The information related to the purchase action may be information such as 3D modeling data (rather than actual data) indicating whether the clothing has been purchased. Purchase actions can also include rentals or free downloads as well as purchase history. For 3D modeling data, apps are easier to identify than real clothing. For example, it is also easy to record the history of game titles or application names, where 3D modeling data of clothing applications are used. Alternatively, if the user purchases actual clothing after purchasing the 3D modeling data, a service such as a price discount on the actual clothing may be provided.

關於購買動作的資訊可包括“使用者未購買服裝的原因”,特別是在使用者進行虛擬試衣後未購買服裝的情況下。在實際商店中對實際服裝進行試衣時,通常難以記錄並且儲存顧客未購買試穿服裝的原因。然而,虛擬試衣系統1可容易地獲取目標資訊(例如服裝與使用者人體之間的尺寸差異)並且可通過執行調查問卷來記錄原因,以便在虛擬試衣系統中記錄未達成購買的原因。另外,虛擬試衣系統1還可為每件服裝記錄試穿所述服裝的使用者之中實際購買的使用者的百分比。可通過使用關於購買動作的資訊將服裝分類為試衣之後容易購買的服裝與不容易購買的服裝。The information about the purchase action may include "the reason why the user did not purchase the clothing", especially if the user did not purchase the clothing after virtual fitting. When fitting actual garments in an actual store, it is often difficult to record and store the reasons why a customer did not purchase the trial garment. However, the virtual fitting system 1 can easily obtain the target information (such as the size difference between the garment and the user's body) and can record the reasons by executing a questionnaire so that the reasons for not achieving the purchase are recorded in the virtual fitting system. In addition, the virtual fitting system 1 can also record, for each piece of clothing, the percentage of users who actually purchased the clothing among the users who tried on the clothing. Clothes can be classified into those that are easy to buy after trying them on and those that are not easy to buy by using information about purchasing actions.

(4)資訊處理系統1的硬體配置不是虛擬裝配。只要能夠實現所需的功能,虛擬試衣系統1即可具有硬體配置。例如,多個物理上協作的設備可用作伺服器20。伺服器20可為物理伺服器或虛擬伺服器(包括所謂的雲)。另外,功能元件與硬體之間的對應關係不限於實施例中所示的關係。例如,在實施例中描述為使用者終端10的實施方案的至少一些功能可為伺服器20的實施方案。(4) The hardware configuration of the information processing system 1 is not a virtual assembly. As long as the required functions can be achieved, the virtual fitting system 1 can have a hardware configuration. For example, multiple physically cooperating devices may serve as server 20. Server 20 may be a physical server or a virtual server (including so-called cloud). In addition, the corresponding relationship between functional elements and hardware is not limited to the relationship shown in the embodiment. For example, at least some functions described in the embodiments as implementations of the user terminal 10 may be implementations of the server 20 .

(5)由CPU 101執行的應用程式可通過經由網路(諸如互聯網)下載來提供,或者可以記錄在電腦可讀非臨時記錄介質(諸如高密度唯讀光碟(DVD-ROM))上的狀態來提供。(5) The application program executed by the CPU 101 can be provided by downloading through a network (such as the Internet), or can be recorded on a computer-readable non-transitory recording medium (such as a high-density read-only disc (DVD-ROM)). to provide.

1:虛擬試衣系統 10:使用者終端 11:3D模型獲得裝置 12:目標資訊獲得裝置 13:接收裝置 14:顯示裝置 15:反饋裝置 16:動作資訊獲得裝置 17:儲存裝置 19:控制裝置 20:伺服器 21:3D模型提供裝置 22:分析裝置 23:儲存裝置 29:控制裝置 91:區域 92:UI對象 100:使用者終端 101:CPU 102:儲存器 103:儲存器件 104:通訊設備 105:輸入設備 106:輸出設備 200:伺服器 211:服裝模型DB 211a:服裝ID 211b:品牌 211c:類型 211d:尺寸 211e:價格 211f:3D模型 212:使用者模型DB 212a:使用者ID 212b:屬性 212b1:姓名 212b2:性別 212b3:年齡 212c:3D模型 212d:購買歷史 213:反饋資訊DB 221:反饋資訊DB 221a:使用者ID 221b:服裝ID 221c:目標資訊 221c1:尺寸差 221c2:典型值 221c3:材料 221c4:背景的資訊 221d:動作資訊 221d1:視點 221d2:移動 221d3:查看時間 221d4:購買動作 300:網路 B:軟按鈕 UD:圖像 S2~S30:流程 1: Virtual fitting system 10:User terminal 11: 3D model acquisition device 12: Target information acquisition device 13: Receiving device 14:Display device 15:Feedback device 16: Action information acquisition device 17:Storage device 19:Control device 20:Server 21: 3D model provision device 22:Analysis device 23:Storage device 29:Control device 91:Area 92:UI object 100:User terminal 101:CPU 102:Storage 103:Storage device 104:Communication equipment 105:Input device 106:Output device 200:server 211: Clothing model DB 211a: Clothing ID 211b: Brand 211c: Type 211d: Dimensions 211e:Price 211f: 3D model 212:User model DB 212a:User ID 212b:Attribute 212b1: Name 212b2: Gender 212b3:Age 212c: 3D models 212d: Purchase history 213: Feedback information DB 221: Feedback information DB 221a:User ID 221b: Clothing ID 221c:Target information 221c1: Size difference 221c2: typical value 221c3:Materials 221c4: Background information 221d: Action information 221d1:Viewpoint 221d2:Move 221d3: Check time 221d4: Purchase action 300:Internet B:soft button UD:image S2~S30: Process

圖1是示出虛擬試衣系統1的功能配置的圖。 圖2是示出虛擬試衣系統1的功能配置的方塊圖。 圖3是示出使用者終端10的硬體配置的方塊圖。 圖4是示出虛擬試衣系統1的操作的時序圖。 圖5是示出服裝模型DB 211的配置的圖。 圖6是示出使用者模型DB 212的配置的圖。 圖7是示出虛擬試衣螢幕的圖。 圖8是示出反饋資訊DB 221的配置的圖。 FIG. 1 is a diagram showing the functional configuration of the virtual fitting system 1 . FIG. 2 is a block diagram showing the functional configuration of the virtual fitting system 1. FIG. 3 is a block diagram showing the hardware configuration of the user terminal 10 . FIG. 4 is a sequence diagram showing the operation of the virtual fitting system 1 . FIG. 5 is a diagram showing the configuration of the clothing model DB 211. FIG. 6 is a diagram showing the configuration of the user model DB 212. FIG. 7 is a diagram showing a virtual fitting screen. FIG. 8 is a diagram showing the configuration of the feedback information DB 221.

10:使用者終端 10:User terminal

11:3D模型獲得裝置 11: 3D model acquisition device

12:目標資訊獲得裝置 12: Target information acquisition device

13:接收裝置 13: Receiving device

14:顯示裝置 14:Display device

15:反饋裝置 15:Feedback device

16:動作資訊獲得裝置 16: Action information acquisition device

17:儲存裝置 17:Storage device

19:控制裝置 19:Control device

20:伺服器 20:Server

21:3D模型提供裝置 21: 3D model provision device

22:分析裝置 22:Analysis device

23:儲存裝置 23:Storage device

29:控制裝置 29:Control device

211:服裝模型DB 211: Clothing model DB

212:使用者模型DB 212:User model DB

213:反饋資訊DB 213: Feedback information DB

Claims (17)

一種資訊處理設備,包括:3D模型獲得裝置,所述3D模型獲得裝置從3D模型提供裝置獲得穿著服裝的軀體的3D模型;目標資訊獲得裝置,所述目標資訊獲得裝置獲得關於服裝及所述軀體中的至少一者的目標資訊;顯示裝置,所述顯示裝置在虛擬空間中顯示所述3D模型;接收裝置,所述接收裝置接收指示使用者在所述虛擬空間中的動作的指令的輸入;以及反饋裝置,所述反饋裝置將反饋資訊反饋回到與所述3D模型提供裝置對應的目的地,所述反饋資訊包括目標資訊和動作資訊,所述動作資訊在所述顯示裝置顯示3D模型時,根據通過所述接收裝置輸入的指令,指示所述使用者的動作。 An information processing device, including: a 3D model obtaining device that obtains a 3D model of a body wearing clothing from a 3D model providing device; a target information obtaining device that obtains information about clothing and the body Target information of at least one of the above; a display device, the display device displays the 3D model in the virtual space; the receiving device, the receiving device receives input of instructions indicating the user's actions in the virtual space; And a feedback device, the feedback device feeds back feedback information to a destination corresponding to the 3D model providing device, the feedback information includes target information and action information, and the action information is used when the display device displays the 3D model. , instructing the user's actions according to instructions input through the receiving device. 如請求項1所述之資訊處理設備,其中,所述動作資訊包括關於在所述虛擬空間中顯示3D模型時的視點位置的資訊。 The information processing device of claim 1, wherein the action information includes information on a viewpoint position when displaying a 3D model in the virtual space. 如請求項1所述之資訊處理設備,其中,所述動作資訊包括關於在穿著所述服裝的狀態下穿著所述服裝的所述軀體的運動的資訊。 The information processing device according to claim 1, wherein the motion information includes information on the movement of the body wearing the garment while wearing the garment. 如請求項1所述之資訊處理設備,其中,所述運動資訊包括關於從多個預定義的運動中選擇的運動的資訊。 The information processing device of claim 1, wherein the motion information includes information about a motion selected from a plurality of predefined motions. 如請求項1所述之資訊處理設備,其中,所述動作資訊包括所述軀體在預定時間段內已穿著所述服裝的次數。 The information processing device of claim 1, wherein the action information includes the number of times the body has worn the clothing within a predetermined time period. 如請求項1所述之資訊處理設備,其中,所述動作資訊包括關於所述3D模型被查看的時間長度的資訊。 The information processing device of claim 1, wherein the action information includes information about the length of time the 3D model is viewed. 如請求項1所述之資訊處理設備,其中,所述動作資訊包括關於針對所述服裝輸入的使用者偏好的資訊。 The information processing device of claim 1, wherein the action information includes information about user preferences input for the clothing. 如請求項1所述之資訊處理設備,其中,所述動作資訊包括關於對所述服裝的購買動作的資訊。 The information processing device according to claim 1, wherein the action information includes information about a purchasing action for the clothing. 如請求項1所述之資訊處理設備,其中,所述目標資訊包括關於所述軀體與所述服裝之間的形狀或尺寸的差異的資訊。 The information processing device of claim 1, wherein the target information includes information on a difference in shape or size between the body and the clothing. 如請求項1所述之資訊處理設備,其中,所述目標資訊包括關於當所述軀體穿著所述服裝時施加在所述軀體上的壓力或者所述服裝中產生的張力的資訊。 The information processing device according to claim 1, wherein the target information includes information about the pressure exerted on the body when the body wears the garment or the tension generated in the garment. 如請求項1所述之資訊處理設備,其中,所述目標資訊包括關於服裝材料的資訊。 The information processing device of claim 1, wherein the target information includes information about clothing materials. 如請求項1所述之資訊處理設備,其中,所述目標資訊包括關於用於在所述虛擬空間中顯示3D模型的背景的資訊。 The information processing device of claim 1, wherein the target information includes information about a background used to display a 3D model in the virtual space. 如請求項1所述之資訊處理設備,其中,所述反饋資訊包括在獲得所述動作資訊時的公眾趨勢的趨勢資訊。 The information processing device of claim 1, wherein the feedback information includes trend information of public trends when the action information is obtained. 如請求項1所述之資訊處理設備,其中,所述3D模型獲得裝置獲得穿著基於以往獲得的所述反饋資訊選擇的服裝的3D模型。 The information processing device of claim 1, wherein the 3D model obtaining device obtains a 3D model wearing clothing selected based on the feedback information obtained in the past. 一種資訊處理系統,包括:伺服器;以及資訊處理設備;其中,所述伺服器包括:3D模型提供裝置,所述3D模型提供裝置提供穿著服裝的軀體的3D模型; 所述資訊處理設備包括:3D模型獲得裝置,所述3D模型獲得裝置從3D模型提供裝置獲得穿著所述服裝的所述軀體的3D模型;目標資訊獲得裝置,所述目標資訊獲得裝置獲得關於服裝及所述軀體中的至少一者的目標資訊,顯示裝置,所述顯示裝置在虛擬空間中顯示所述3D模型;接收裝置,所述接收裝置接收指示使用者在所述虛擬空間中的動作的指令的輸入;以及反饋裝置,所述反饋裝置將反饋資訊反饋回到與3D模型提供裝置對應的目的地,所述反饋資訊包括目標資訊和動作資訊,所述動作資訊在所述顯示裝置顯示3D模型時,根據通過所述接收裝置輸入的指令,指示所述使用者的動作。 An information processing system, including: a server; and information processing equipment; wherein the server includes: a 3D model providing device, the 3D model providing device provides a 3D model of a body wearing clothing; The information processing equipment includes: a 3D model obtaining device, which obtains a 3D model of the body wearing the clothing from a 3D model providing device; and a target information obtaining device, which obtains information about the clothing. and target information of at least one of the bodies, a display device, the display device displays the 3D model in a virtual space; a receiving device, the receiving device receives information indicating the user's actions in the virtual space Input of instructions; and a feedback device that feeds back feedback information to a destination corresponding to the 3D model providing device. The feedback information includes target information and action information, and the action information displays 3D information on the display device. When modeling, the user's actions are instructed according to instructions input through the receiving device. 一種致使電腦執行處理的程式,所述處理包括:從3D模型提供裝置獲得穿著服裝的軀體的3D模型;獲得關於所述服裝及所述軀體中的至少一者的目標資訊;在虛擬空間中顯示所述3D模型;通過接收裝置接收指示使用者在所述虛擬空間中的動作的指令的輸入;以及將反饋資訊反饋回到與3D模型提供裝置對應的目的地,所述反饋資訊包括所述目標資訊和動作資訊,所述動作資訊指示在顯示所述3D模型時,根據通過所述接收裝置輸入的指令,指示所述使用者的動作。 A program that causes a computer to perform processing, the processing including: obtaining a 3D model of a body wearing clothing from a 3D model providing device; obtaining target information on at least one of the clothing and the body; displaying it in a virtual space The 3D model; receiving input of instructions indicating the user's actions in the virtual space through a receiving device; and feeding feedback information back to a destination corresponding to the 3D model providing device, the feedback information including the target Information and action information, the action information indicates the action of the user according to the instructions input through the receiving device when the 3D model is displayed. 一種資訊處理方法,包括:3D模型獲得裝置從3D模型提供裝置獲得穿著服裝的軀體的3D模型;目標資訊獲得裝置獲得關於所述服裝及所述軀體中的至少一者的目標資訊;顯示裝置在虛擬空間中顯示所述3D模型;通過接收裝置接收指示使用者在所述虛擬空間中的動作的指令的輸入;以及 反饋裝置將反饋資訊反饋回到與所述3D模型提供裝置對應的目的地,所述反饋資訊包括所述目標資訊和動作資訊,所述動作資訊指示在顯示3D模型時,根據通過所述接收裝置輸入的指令,指示所述使用者的動作。 An information processing method, including: a 3D model obtaining device obtains a 3D model of a body wearing clothing from a 3D model providing device; a target information obtaining device obtains target information about at least one of the clothing and the body; a display device Displaying the 3D model in a virtual space; receiving input of instructions instructing a user's actions in the virtual space through a receiving device; and The feedback device feeds back feedback information to a destination corresponding to the 3D model providing device. The feedback information includes the target information and action information. The action information indicates that when the 3D model is displayed, the feedback information is passed through the receiving device. The input command instructs the user to take action.
TW111144460A 2021-11-26 2022-11-21 Information processing equipment, information processing method, information processing system, and program TWI822476B (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
PCT/JP2021/043402 WO2022185631A1 (en) 2021-11-26 2021-11-26 Information processing device, information processing method, information processing system, and program
WOPCT/JP2021/043402 2021-11-26

Publications (2)

Publication Number Publication Date
TW202322058A TW202322058A (en) 2023-06-01
TWI822476B true TWI822476B (en) 2023-11-11

Family

ID=81289284

Family Applications (1)

Application Number Title Priority Date Filing Date
TW111144460A TWI822476B (en) 2021-11-26 2022-11-21 Information processing equipment, information processing method, information processing system, and program

Country Status (4)

Country Link
JP (2) JP7055526B1 (en)
CN (1) CN114902266A (en)
TW (1) TWI822476B (en)
WO (1) WO2022185631A1 (en)

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105913486A (en) * 2016-04-08 2016-08-31 东华大学 Digital mixing human body rapid modeling method applied to apparel industries
WO2020203656A1 (en) * 2019-04-05 2020-10-08 ソニー株式会社 Information processing device, information processing method, and program
WO2021014993A1 (en) * 2019-07-25 2021-01-28 ソニー株式会社 Information processing device, information processing method, and program

Family Cites Families (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7149665B2 (en) * 2000-04-03 2006-12-12 Browzwear International Ltd System and method for simulation of virtual wear articles on virtual models
KR20150031706A (en) * 2013-09-16 2015-03-25 이윤재 Welding quality control system
JP5605885B1 (en) * 2014-02-27 2014-10-15 木下 泰男 Virtual try-on system and virtual try-on program
CN106651498A (en) * 2016-09-29 2017-05-10 宇龙计算机通信科技(深圳)有限公司 Information processing method and device
CN106502399B (en) * 2016-10-31 2019-08-23 江西服装学院 Virtual fit method, apparatus and system and three-dimensional fabric Materials Library method for building up and device
CN107633440A (en) * 2017-08-11 2018-01-26 捷开通讯(深圳)有限公司 The method of virtual fitting, mobile terminal and storage device for virtual fitting
CN109003168A (en) * 2018-08-16 2018-12-14 深圳Tcl数字技术有限公司 Virtual fit method, smart television and computer readable storage medium
KR20200023970A (en) * 2018-08-27 2020-03-06 전호윤 Virtual fitting support system
CN110021057B (en) * 2019-02-22 2023-03-14 维沃移动通信有限公司 Information display method and terminal
CN110148040A (en) * 2019-05-22 2019-08-20 珠海随变科技有限公司 A kind of virtual fit method, device, equipment and storage medium
CN112116430A (en) * 2020-09-28 2020-12-22 西安万像电子科技有限公司 Virtual wearing system and control method thereof, virtual fitting system and virtual wearing glasses
CN113129450B (en) * 2021-04-21 2024-04-05 北京百度网讯科技有限公司 Virtual fitting method, device, electronic equipment and medium

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105913486A (en) * 2016-04-08 2016-08-31 东华大学 Digital mixing human body rapid modeling method applied to apparel industries
WO2020203656A1 (en) * 2019-04-05 2020-10-08 ソニー株式会社 Information processing device, information processing method, and program
WO2021014993A1 (en) * 2019-07-25 2021-01-28 ソニー株式会社 Information processing device, information processing method, and program

Also Published As

Publication number Publication date
JP7055526B1 (en) 2022-04-18
WO2022185631A1 (en) 2022-09-09
JP2023079142A (en) 2023-06-07
CN114902266A (en) 2022-08-12
TW202322058A (en) 2023-06-01
JPWO2022185631A1 (en) 2022-09-09

Similar Documents

Publication Publication Date Title
KR102296906B1 (en) Virtual character generation from image or video data
US9842357B2 (en) Methods, systems, and products for personalized haptic emulations
US12017142B2 (en) System and method for real-time calibration of virtual apparel using stateful neural network inferences and interactive body measurements
US8818883B2 (en) Personalized shopping avatar
JP6242768B2 (en) Virtual try-on device, virtual try-on method, and program
JP6320237B2 (en) Virtual try-on device, virtual try-on method, and program
JP6338966B2 (en) Virtual try-on device, virtual try-on system, virtual try-on method, and program
KR20160145732A (en) Fashion preference analysis
CN105956912A (en) Method for realizing network fitting
JP2016038811A (en) Virtual try-on apparatus, virtual try-on method and program
JP2018106736A (en) Virtual try-on apparatus, virtual try-on method and program
CN106940862B (en) Network real-scene shopping and fitting customization system
KR102381566B1 (en) Simulation apparatus and method for fashion styling
TWI822476B (en) Information processing equipment, information processing method, information processing system, and program
JP7039094B1 (en) Information processing equipment, information processing methods, and programs
WO2020079235A1 (en) Method and apparatus for accessing clothing
JP2018113060A (en) Virtual try-on apparatus, virtual try-on system, virtual try-on method and program
WO2022269741A1 (en) Information processing device, 3d system, and information processing method
WO2022137307A1 (en) Virtual fitting method, virtual fitting system, and program
NL2022937B1 (en) Method and Apparatus for Accessing Clothing
JP2019112732A (en) Digital fitting support device, digital apparel support device and digital apparel support method
KR101277553B1 (en) Method for providing fashion coordination image in online shopping mall using avatar and system therefor
KR20230120700A (en) Method for providing virtual fitting using 3d avatar and interior
Clement et al. GENERATING DYNAMIC EMOTIVE ANIMATIONS FOR AUGMENTED REALITY
KR20040000087A (en) The method virtual store account avata use of the internet