RU2768558C1 - Clothes registration device and clothes recommendation device, as well as online system containing thereof - Google Patents

Abstract

FIELD: physics.

SUBSTANCE: present invention relates to an online system and a method of controlling thereof, wherein the online system comprises apparatuses for clothes, which can receive physical information of a user, notify of a change in physical information, register information on clothes available with user, collect user’s schedule, weather, preferences, fashion in this area in which user is located, and information on sold clothes and recommend individual clothes to user.

EFFECT: creation of household device, which can analyze both clothes belonging to user, and clothes to be bought, and recommend clothes to user on the basis of analysis result and online system including thereof.

22 cl, 22 dwg

Description

The technical field to which the invention belongs

[1] The present disclosure relates to a home appliance capable of capturing images of a user's body and a user's stored clothing, and recommending appropriate clothing for a user according to a schedule or weather, etc., and recognizing the condition of the clothing worn by the user, and determining whether or not directing the appropriate clothing treatment mode, and to the online system including the home appliance.

Background of the invention

[2] Recently, when cameras are set with the function of depth sensor, etc., the camera accurately acquires information about the user's body in 3D mode. With the development of AR (Augmented Reality) technology, only the desired part of the user's body can be virtually displayed and identified. Accordingly, the virtual fitting system is activated, whereby the user virtually wears and identifies the garment without actually wearing it each time the garment is purchased or selected.

[3] Specifically, referring to Korean Patent Application Publication No. 10-2014-0077820 (prior art 1), a well-known virtual fitting system obtains detailed information such as the user's height, weight, size, and the length of each joint of the user by scanning the external view of the user using the depth sensor, and creates and saves a 3D model corresponding to the user. In addition, referring to Korean Patent Application Publication No. 10-2016-0088112 (prior art 2), a known virtual fitting system can match (display) clothes provided by a seller with a 3D model of a user to provide a direct and visual identification of the appearance by the user. of a user wearing clothing based on their image.

[4] Figure 1 shows an embodiment of a known virtual fitting system.

[5] As shown in FIG. 1(a), the user 1 can stand in front of the virtual fitting device 2 where a depth sensor camera is installed. In this regard, the virtual fitting device 2 can display the image of the user 1 taken by the camera as it is, in a mirror way. To obtain accurate information about the body of the user 1, the guide line 3 can be marked on the virtual fitting device 2 to ensure that the user is in the correct position or takes a particular posture.

[6] As shown in Fig. 1(b), when the user assumes a position or posture directed by the guide line 3, the virtual fitting device 2 transmits and displays the user's selected clothing 5 on the appearance of the user 4. This allows the user to determine whether it is suitable for him. clothes 5 without putting clothes 5 on directly.

[7] In one example, referring to Korean Patent Application Publication No. 10-2017-0115332 (prior art 3), the buying system allows the user to directly buy clothes while they are being virtually tried on. Thus, the user may not go to the place where the clothes 5 on which the virtual fitting is performed are actually located to buy the clothes 5.

[8] However, in the prior art virtual fitting system, clothing information including the size, shape, and material of the clothing to be displayed needs to be stored beforehand in order to perform the virtual fitting that displays the actual clothing onto the user's image. Therefore, this virtual fitting system has a limitation in that virtual fitting can only be performed on a specific garment provided by a vendor who knows information about the garment in advance.

[9] Thus, the user cannot perform a virtual fitting of clothes, information about which is not provided by the seller.

[10] In addition, typically, a lot of clothes purchased from a number of retailers who do not provide information about clothes for virtual fitting are stored at a particular user's home. Therefore, there is a limitation that a particular user cannot perform a virtual fitting of the clothes he has bought or the clothes he has stored at all. Therefore, even when a virtual fitting system has been developed, it cannot be generally and actually applied to the user.

[11] When there are many clothes, the user may not know which clothes are suitable for him. Therefore, the user has to try on a lot of clothes or perform virtual fitting several times. In addition, even when a plurality of clothes are practically tried on, the user cannot select clothes that are optimal for the user due to lack of fashion knowledge, brand knowledge, or fashion sense.

[12] To solve this problem, a recommendation system has emerged that can recommend appropriate clothing according to the user's body information, purchasing power, and preferences.

[13] Referring to Korean Patent Application Publication No. 10-2017-0006604 (prior art 4), a well-known virtual fitting system recognizes the user's body with a depth sensor, etc., and recommends clothes suitable for the user's body.

[14] In addition, referring to Korean Patent Application Publication No. 10-2014-0006294 (prior art 5), a well-known virtual fitting system recommends a suitable garment or brand for a user considering not only the user's body information but also the user's stored clothing. , preferences and purchase history. As a result, even when the user lacks knowledge or information about clothing suitable for use, clothing suitable for the user's condition can be selected.

[15] However, the prior art virtual try-on system has the limitation that the system can only recommend clothes when information about the clothes to be recommended is previously identified and previously stored. Therefore, when a merchant who manufactures user-owned clothing does not provide clothing information, the prior art virtual fitting system has a limitation in that the system cannot properly recommend suitable clothing among the user-owned clothing to the user.

[16] In addition, even when a home appliance can perform 3D modeling by scanning a user, the prior art virtual fitting system has a limitation in that the system cannot use the home appliance to display a change in the user's body.

[17] In addition, since the prior art virtual fitting system can only be used at a specific location where a vendor providing the virtual system is located, the prior art virtual fitting system cannot be used to continuously observe or recognize a change in the body of a specific user. Therefore, there is a limitation in that the prior art virtual fitting system can provide an individual virtual fitting or recommend clothing to a particular user.

[18] In addition, although the prior art virtual fitting system recommends clothes to the user, the user cannot identify or check if the clothes really fit. For example, it is not possible for the user to determine whether the recommended clothing is suitable for a background or situation completely different from the location where the virtual fitting is currently taking place. In addition, the user cannot determine whether the recommended clothing is suitable for another person who usually accompanies the user but is not present during the virtual fitting.

[19] As a result, there is a problem that the user-specific virtual fitting technology cannot be used because there is no home appliance to which the virtual fitting system is applied.

[20] In addition, a plurality of household appliances may be located in the home for washing or refreshing clothes. Therefore, the user may not be able to accurately determine which home appliance processes the clothes worn by the user.

[21] For example, there is a problem that even if a particular garment is to be washed, the user cannot properly treat the garment by loading it into a home appliance that performs a refresh.

[22] In addition, when a home appliance that freshens clothes provides a plurality of modes or options, the clothes may not be thoroughly refreshed because the user does not know which mode or option should be performed according to the condition of the clothes.

[23] In addition, even if a particular garment is to be washed, and when the user realizes that the garment is incorrectly loaded into the garment treating apparatus that performs refreshing, the user must re-enter the mode or option of the washing machine that performs the washing. It is not comfortable.

[24] As a result, generally, even if a plurality of home appliances communicate with each other or are controlled via a specific server, there is a limitation that a plurality of home appliances cannot work together with each other.

Disclosure

Technical goal

[25] The purpose of the present disclosure is to provide a consumer device that can store information about clothing owned by the user.

[26] The purpose of the present disclosure is to provide a consumer device capable of processing clothing information based on an image of clothing owned by a user.

[27] The purpose of the present disclosure is to provide a consumer device that can obtain clothing information based on an image of clothing worn by a user.

[28] The purpose of the present disclosure is to provide a home appliance that can recommend appropriate clothing to a user based on weather, schedule, body information, fashion, preference, and stored clothing list.

[29] The purpose of the present disclosure is to provide a home appliance that can analyze both clothes owned by a user and clothes to be purchased, and recommend clothes to a user based on the result of the analysis, and an online system including it.

[30] The purpose of the present disclosure is to provide a home appliance that can recommend clothing other than clothing owned by the user and can enable the user to purchase the recommended clothing.

[31] The purpose of the present disclosure is to provide a consumer device that can compare recommended clothes with other clothes, compare recommended clothes with information about another person, or change the background and compare recommended clothes with a changed background, and an online system including it.

[32] The purpose of the present disclosure is to provide a consumer device that can repeatedly imitate a particular user and detect a change in their body.

[33] The purpose of the present disclosure is to provide a consumer device that can distinguish between wearable clothing and non-wearable clothing from each other based on the change in the body of a particular user.

Technical solution

[34] The online system according to the present disclosure includes a garment processing apparatus that can dry garments with hot air or steam. The clothes treatment apparatus can dry clothes by supplying heated air and moisture to the chamber. In the chamber, the support rod on which the hanger holding the clothes is installed can vibrate to remove wrinkles from the clothes and help deodorize the clothes. The garment treatment apparatus may have a separate water supply reservoir for supplying steam, and may include a collection reservoir that collects moisture condensed during the drying process of the area in which the garment is located.

[35] The online system according to the present disclosure may further include a server and an external terminal capable of providing information in communication with the garment processing device. The garment processing device may be configured to output a daily schedule using a speaker and a screen as an output. The garment processing device may recommend items, such as clothing or accessories, that are appropriate for a given weather using an inference tool. For example, the clothes handler may send words or voices such as "Get an umbrella ready because it may rain tomorrow" using the output means.

[36] In addition, the clothing processing apparatus may search for a clothing or accessory seller according to a user's request. In addition, the clothing processing device may display clothing or accessories provided by the wanted seller.

[37] The user can order selected clothing or accessories through the clothing processing device. The garment processing device may include a virtual try-on (VR) service to assist the user in ordering clothing or accessories.

[38] The garment processing device may be connected to an external terminal or the Internet via a communication module or an access point (AP). The garment processing device may identify the user's schedule stored in the external terminal or server, or may identify the schedule registered in the Internet account set by the user.

[39] In addition, the garment processing apparatus can obtain weather information from the Internet. The schedule or weather information can be directly input by the user through the input means of the garment processing apparatus. The input means may include a voice recognition microphone, a touch pad, and a control panel located on the front surface of the door. For example, the clothing processing device can prepare N types of images (style images, coordination images) or voice information based on the user's schedule and the day's weather. When creating an image, the device may combine the wearer's clothing registered in the database (DB) to create one or more images. The clothing combination image may be an image consisting of only a clothing combination, or may be an image in which the clothing is displayed using the user's image as a background.

[40] The garment processing device of the present disclosure may recommend garments based on registered garments. The clothing processing apparatus may output an image to the output means based on the clothing registered in the DB, the schedule, and the weather. The output means may include a loudspeaker and a display panel located on the front surface of the door.

[41] For example, the user may say "what to wear to tomorrow's meeting" to the garment processing device. In response to this, the renderer may display a recommendation image along with a response indicating "I recommend 3 styles for appointment scheduling" on the front of the door. In addition, the garment processing device can display words such as "Please select the style you want" using an output means, and thus allow the user to input a control command. The user can select the desired image by voice or touch.

[42] When the user selects the desired image, the renderer may output "I'm starting a virtual fitting of the first style." The output means may move the corresponding image according to the posture of the user.

[43] The garment processing device can purchase clothes. The image generated by the clothing processing device may include images provided by manufacturers/sellers of clothing and accessories in addition to clothing owned by the user. The clothing processing device may ask if the user wishes to purchase clothing or accessories that are not in the created image or the image selected by the user. When the clothing processing device confirms the user's intent to purchase the clothing or accessories, the clothing processing device may send an online order form to the seller of the respective clothing or accessories.

[44] For example, the user may issue the intent "I will wear this style." In response to this, the output agent may output: "I recommend purchasing a tie that matches the selected style." The image of the purchased tie can be displayed on the output tool. The user can select the desired item from the displayed image.

[45] In one example, the virtual fitting may simultaneously display a user image and an image of clothing/accessories on a display device. Clothing or accessories can be displayed or combined with the user's image using the input means (touch pad, voice recognition unit and motion recognition unit). In addition, the user can modify and select images.

[46] The online system can be used as follows. The user wakes up in the morning and determines the trip schedule and departure time using an external terminal device. The user can display on the garment processing device: “What should I wear when I travel for business?” In response, the clothes processing device can output “I am preparing coordination according to the schedule and weather information from August 31 to September 1 in Berlin”, and then I can start analyzing the clothes. After analysis, the garment processing device can display the coordination for each day of the week (weather icon). A user currently wearing midsummer clothing can then output “that looks too hot!”. The clothes processor then says, “The current Berlin temperature is like early autumn in Korea, and it can be chilly, so be sure to bring a cardigan with you when you travel.”

[47] The user can select the "additional recommendation function" on the day having the most important schedule by touching the input means. The garment processor may say, "I'll start fitting from now on." Thus, the user can assume a posture with respect to the garment processing device. The user can visually identify the state of the garment to be worn indicated by the garment processing device even if the user is currently wearing underwear. The user can select the recommended clothing and can determine that he does not have the tie recommended along with the recommended clothing using the inference tool. Thus, the user makes a purchase request by saying, "Please buy this tie." When the garment processing device receives a purchase request, the device may request additional information by saying "Please enter a shipping address?". As a delivery address, the user can specify the name of the hotel where he stayed during a business trip.

[48] In one example, the online system in accordance with the present disclosure may automatically determine the state of clothing and may provide a mode or option appropriate for that state. For example, the user may load a coat into the garment processor and press a grooming button. The garment processing device may automatically select a mode or option based on the results of the garment being analyzed by a chemical sensor or camera. The device can recommend the selected mode using the output tool.

[49] An online system in accordance with the present disclosure may perform a virtual fitting. The virtual fitting may include matching other clothing to the specific clothing the user is currently wearing. The garment processing device forms an image of the user with the help of a camera. The display device may display an image of the user. The user can indicate the clothes they are wearing with a hand movement or voice. The garment processing apparatus can calculate garments suitable for said garments. In addition to the specified clothing, other clothing may be removed from the image. The output means may output a new image obtained by combining the user's stored clothing with an image in which the user is wearing the particular clothing. A plurality of images can be displayed according to a user's request. The output means can display a plurality of images sequentially.

[50] A list of clothes or accessories owned by the user may be stored in the clothes processing device, etc. The clothing processing device may instruct the user to enter clothing information or obtain an image stored in the user's external terminal, and separate the clothing image from it and store the clothing image therein.

[51] The garment processing device can detect a change in the shape of the user's body, and can notify the user of the change in the shape of the body. Upon detecting a change in body shape, the clothing processing device may select clothing that the user cannot wear and display the selected clothing on the display device.

[52] In one example, the online system in accordance with the present disclosure may provide various virtual fitting services. For example, different virtual fittings may be provided depending on where the user stands in front of the garment processing device.

[53] For example, when the user is standing in an area that occupies 50% or more of the display area provided by the display device, an image of clothing based on the schedule and weather may be recommended by the device. The clothing processing device may receive a command to change the recommended image, and may change the recommended image using the clothes stored in the DB or purchase the target clothes.

[54] In addition, when the user is standing in an area that occupies an area smaller than 50% of the display area provided by the display device, a plurality of recommended images created on that day can be displayed on the display device at the same time. That is, it can display two or more recommended images at the same time. Alternatively, the featured images may be sequentially displayed according to the user's comparison command.

[55] When the clothing processing device recognizes both a specific user and another user, the device can recommend appropriate clothing for each specific user and other user. According to the user's choice, the clothing processing device may independently recommend clothing for each particular user and other user, or may recommend mutually related clothing, such as the same clothing for a particular user and another user.

[56] In addition, in the virtual fitting pattern provided by the online system according to the present disclosure, when the user rotates the body, the clothes can be seen from different angles. In addition, when the user only rotates the accessory, the user can only view the accessory from different angles. The garment processing device can determine whether the user is turning the body or only the accessory with the motion camera.

[57] The garment processing device according to the present disclosure can capture a 3D profile of a user with a camera. In addition, the garment processor according to the present disclosure can access the server and match the measured garment size based on each brand with the 3D profile. Thus, the device can recommend a suitable brand to the user. In addition, the clothing processing apparatus according to the present disclosure can recommend clothing suitable for a 3D profile among currently stored clothing.

technical effect

[58] The present disclosure may implement a home appliance that can store information about clothing owned by a user.

[59] The present disclosure may implement a consumer device that processes clothing information based on an image of clothing owned by a user.

[60] The present disclosure may implement a consumer device that can obtain clothing information based on an image of clothing worn by a user.

[61] The present disclosure may implement a home appliance that can recommend appropriate clothing to a user based on weather, schedule, body information, fashion, preferences, and a list of stored clothing.

[62] The present disclosure may implement a home appliance that can analyze both clothing owned by a user and clothing to be purchased and recommend clothing to a user based on the result of the analysis, and an online system including the same.

[63] The present disclosure may implement a home appliance that may recommend clothing other than clothing owned by the user and may enable the user to purchase the recommended clothing.

[64] The present disclosure may implement a home appliance that can compare recommended clothing with other clothing, compare recommended clothing with information about another person, or change the background and compare recommended clothing with the changed background, and an online system including it.

[65] The present disclosure may implement a home appliance that can repeatedly imitate a particular user and detect a change in their body.

[66] The present disclosure may implement a home appliance that can distinguish wearable clothing and non-wearable clothing from each other based on a particular user's body change.

Brief description of the drawings

[67] Figure 1 is a view of a known system that recommends clothes.

[68] Figure 2 is a structure of an online system in accordance with the present disclosure.

[69] FIG. 3 is a configuration of an online system according to the present disclosure.

[70] FIG. 4 is a construction of a fitting unit that can register and recommend clothes in an online system in accordance with the present disclosure.

[71] FIG. 5 is a view of a garment processing apparatus as one of the home appliances in the online system according to the present disclosure.

[72] FIG. 6 shows a function of a virtual output interface of a clothing processing apparatus of an online system according to the present disclosure.

[73] FIG. 7 shows a process for collecting and registering user body information in an online system according to the present disclosure.

[74] FIG. 8 shows a process for registering a user's stored clothing in an online system according to the present disclosure.

[75] FIG. 9 shows one embodiment in which the process of FIG. 8 is performed.

[76] FIG. 10 shows the result of executing the process of FIG. 9 many times.

[77] FIG. 11 shows the principle that an online system according to the present disclosure can recommend clothes.

[78] FIG. 12 shows a clothing recommendation process in an online system according to the present disclosure.

[79] FIG. 13 shows a control method by which an online system according to the present disclosure recommends clothes.

[80] FIG. 14 shows one embodiment in which an online system according to the present disclosure recommends clothing.

[81] FIG. 15 shows another embodiment in which an online system according to the present disclosure recommends clothing.

[82] FIG. 16 shows another embodiment in which an online system according to the present disclosure recommends clothing.

[83] FIG. 17 shows an additional embodiment in which an online system according to the present disclosure recommends clothing.

[84] FIG. 18 shows another embodiment in which an online system according to the present disclosure recommends clothing.

[85] FIG. 19 shows another embodiment in which an online system according to the present disclosure recommends clothing.

[86] FIG. 20 shows a control method by which an online system according to the present disclosure scans information about a user's body and uses the information.

[87] FIG. 21 shows one embodiment in which the process of FIG. 20 is performed.

[88] FIG. 22 shows another embodiment in which the process of FIG. 20 is performed.

Detailed description

[89] Below, the embodiments disclosed herein will be described in detail with reference to the accompanying drawings. Here, the same or similar reference numerals refer to the same or similar elements in different embodiments. Their descriptions are replaced by their first descriptions. As used herein, the singular forms are also intended to include the plural forms, unless the context clearly indicates otherwise. In addition, when describing the embodiments disclosed herein, when it is determined that the detailed descriptions of the corresponding known element may obscure the essence of the embodiments disclosed herein, their detailed descriptions may be omitted. In addition, it should be noted that the accompanying drawings are provided for easy understanding of the embodiments disclosed herein and should not be construed as limiting the technical nature disclosed herein with respect to the accompanying drawings.

[90] Figure 2 shows an online system in accordance with one embodiment of the present disclosure.

[91] Many household devices that can be controlled by a particular user can be located indoors, for example, in a house. In addition, a plurality of clothes A, which can be worn by a particular user, can be located or stored indoors, for example, in a house.

[92] The plurality of home appliances may include a clothing registration device configured to register clothing and a clothing recommender configured to recommend clothing. Each of the clothes detecting device and the clothes recommending device can be implemented as a home appliance.

[93] Incidentally, when the home appliance performs a clothing registration function, the home appliance may be referred to as a clothing registration device. When the home appliance performs a clothing recommendation function, it may be referred to as a clothing recommendation device.

[94] That is, the clothes registration device and the clothes recommendation device are defined in terms of functions. Thus, when a home appliance such as a washing machine, a refrigerator, a vacuum cleaner, or an external terminal device has a function for registering clothes, the device can be classified as a clothes registering device. When a home appliance such as a washing machine, a refrigerator, a vacuum cleaner, or an external terminal has a function for recommending clothes, the device may be referred to as a clothes recommender.

[95] In other words, when the clothes treatment device that refreshes clothes with hot air or steam registers clothes, the device can function as a clothes registration device. When the clothes treatment device that refreshes clothes with hot air or steam has a clothes recommending function, the device can function as a clothes recommending device.

[96] That is, when the clothes processing device has a clothes recommending function and a clothes registering function, the device can correspond to both the clothes detecting device and the clothes recommending device.

[97] The plurality of home appliances may include a washing machine 300 for washing and drying at least one of the plurality of clothes A using a detergent, etc., and a clothes treating device 100 for supplying hot air or a pair on at least one of the plurality of clothes A; and freshening up at least one of the plurality of clothes A.

[98] The set of clothes A may include at least one of one or more outerwear A1, such as coats or jumpers, one or more tops A2, such as a shirt or blouse, T-shirt, one or more bottoms A3, such as trousers or skirts, and an A4 accessory, such as a bag or sunglasses, precious metal or a scarf. Clothing such as a one-piece dress that cannot be classified as tops or bottoms may be collectively referred to as outerwear.

[99] The clothing treatment device 100 may include a refresh-related input interface 150 that receives commands for performing arbitrary modes or options that can refresh at least one of the clothes A, and a refresh-related output interface 140, which can return the state of a mode or option. In addition, the washing machine 300 may include a wash-related input interface 350 that receives a command to execute an arbitrary mode or option that can wash at least one of the clothes A, and a wash-related output interface 340 that can return the state of the mode or option. Accordingly, the user can input the target garment A into the garment treating apparatus 100 or the washing machine 300, and then directly enter a command to individually control and operate the garment treating apparatus 100 or the washing machine 300.

[100] In one example, the user may want to remotely control the washing machine 300 and the clothes treating device 100, or operate the washing machine 300 and the clothes treating device 100 together with each other. In addition, the user may want to actively learn about or use the various functions of the washing machine 300 and the clothes treating apparatus 100.

[101] To this end, the online system according to one embodiment of the present disclosure may include a server 600 through which a user can remotely control or pair the washing machine 300 and the garment treating apparatus 100.

[102] The server 600 may provide external information including regional information or weather information required for the washing machine 300 and the garment treating apparatus 100, and may provide various programs and update them. The server 600 may be provided by a company that manufactures and sells the garment processor 100 and the washing machine 300. Accordingly, the garment processor 100 and the washing machine 300 may be connected to the server 600 to execute a command transmitted from the server 600 or to use information or algorithms received from the server 600.

[103] In one example, the clothes processor 100 or the washing machine 300 may be directly connected to the server 600 to communicate with each other, or may be configured to connect to the access point (AP) 500 to communicate with the server 600.

[104] Therefore, the server 600 can register a unique device ID of each of the clothes processor 100 and the washing machine 300 through the AP 500, or store port information or IP information about the AP 500 in conjunction with the clothes processor 100 and the washing machine 300.

[105] In one example, a user using the clothes processor 100 or the washing machine 300 may remotely receive a service request to control the clothes processor 100 and the washing machine 300, or may request specific functions from the server 600.

[106] Therefore, the online system according to one embodiment of the present disclosure may include an external terminal 400 allowing a user to directly access the server 600 to control the garment processing apparatus 100 and the washing machine 300, or to request various services provided by the server 600. External terminal 400 may refer to a device, such as a mobile phone, smartphone, laptop, and computer, that is separate from a home device or server, and may include devices having a communication module for communicating with an external element.

[107] An application program may be installed on the external terminal 400 that may allow the external terminal 400 to connect to the server 600. Accordingly, the external terminal 400 may directly communicate with the server 600, and the server 600 may communicate with the garment processing device 100 and washing machine 300.

[108] As a result, the user can request a remote service through the external terminal 400 and easily obtain information such as the execution and completion of the service. In addition, the clothes treating apparatus 100 and the washing machine 300 can be controlled by the external terminal 400 without being directly connected to the external terminal 400.

[109] In one example, the garment treating apparatus 100 typically has a vertical dimension greater than the vertical dimension of the washing machine 300. That is, the garment treating apparatus 100 generally has a vertical dimension greater than the horizontal dimension to accommodate unfolded clothes. For example, the garment processing device 100 may be taller than the wearer. In addition, due to the type of the garment treating apparatus 100, the garment treating apparatus 100 may be located where the garment A is stored. Therefore, when the garment treating apparatus 100 can function as a mirror, the user may not move to the actual mirror when putting on the garment A.

[110] To this end, the garment processing apparatus 100 may further include a fitting unit 200 that displays a state in which a user puts on a garment on its open surface. The fitting unit 200 may be in the form of a panel that may reflect light and may be configured to reflect the user's body as it is. In addition, the fitting block 200 has a height greater than the width so that the entire body of the user can be reflected on it as much as possible. Therefore, the user can determine the state in which the user holds or wears the clothes A refreshed in the clothes treating device 100, or can determine the state in which the user holds or wears the clothes A stored near the clothes treating device 100.

[111] An example has been described in which the fitting unit 200 is disposed on the garment processing apparatus 100. However, this is only one option. In another example, the fitting unit 200 may be located on a home appliance such as a washing machine 300, refrigerator, or vacuum cleaner, or may be located on an external terminal 400.

12] In one example, the user may not know which clothes of the set of clothes A are suitable for the user, and may want to know how to match the set of clothes A to wear the combination on themselves.

[113] In addition, when the user's height increases or the user's weight increases, the user may not recognize which of the plurality of clothes is suitable or not suitable for him.

[114] In this situation, the user must repeatedly wear the plurality of clothes A to determine which of the plurality of clothes A is suitable or not suitable for the user. Even when he repeatedly wears a plurality of clothes A, the user may not be sure that the clothes he wears are suitable for him.

[115] To this end, the online system according to one embodiment of the present disclosure may provide a virtual fitting service by which a user can indirectly determine the state in which the user wears a plurality of clothes with the fitting unit 200, even if the user does not directly wear a plurality of clothes. clothes A. Specifically, the online system according to the present disclosure can display a state in which a plurality of clothes A has been transferred to an image or screen of a user displayed on the fitting unit 200 .

[116] In one example, the plurality of clothes may be the target purchase clothes that the user wants to buy, or may be clothes that the user directly stores. In other words, the user may want to know the clothing to be purchased, which suits the user or is needed by the user. The user may want to know which of the many clothes the user owns suits him.

[117] The online system according to one embodiment of the present disclosure is configured to apply the virtual fitting service not only to clothes to be purchased by the user, but also to clothes owned by the user, and can recognize and store the material, shape, size , volume and color of the set of clothes that the user has for their recommendation.

[118] In addition, the online system according to one embodiment of the present disclosure can recognize and store the height, weight, volume, arm and leg length, etc., of the user, and can judge the state in which the user looks good in clothes.

[119] Accordingly, the online system in accordance with one embodiment of the present disclosure may be configured to recommend a particular garment among the plurality of garments A to a user based on at least one of given weather conditions, user preferences, and style. In addition, the system may be configured to determine additional required clothing in addition to the plurality of clothing A and recommend that the user purchase it.

[120] Specifically, the online system according to one embodiment of the present disclosure may be configured to consider information about clothing owned by the user, information about clothing that the user can purchase, information about the user's body, the user's schedule, the user's preferences, current fashion clothing and weather information, etc., and then recommending or purchasing appropriate clothing based on the user's considerations using the fitting unit 200 . In this regard, the wearer itself may be recommended to the user as recommended by the online system in accordance with one embodiment of the present disclosure. Alternatively, the clothes may be displayed on the user's actual image, and thus a state equivalent to the state in which the user actually wears the clothes can be displayed and recommended.

[121] In one example, both the garment treating apparatus 100 and the washing machine 300 among household appliances can treat garments. Therefore, the user may not know exactly whether to freshen their clothes with the clothes treating device 100 or wash their clothes with the washing machine 300.

[122] Therefore, in the online system according to one embodiment of the present disclosure, the garment processing apparatus 100 can be configured to determine the wrinkle level or soiling level of the garment. When the level of soiling is high, the clothes treating device 100 may be configured to indicate to the user that the clothes are being washed by the washing machine 300. In addition, the clothes treating device 100 can directly transmit the soiling level or material of the clothes to the washing machine. 300 through the server 600 or AP 500, etc., to allow the washing machine 300 to determine the appropriate mode or option based on the level of soiling or material.

[123] In one example, the user may not be able to accurately recognize or be familiar with the mode or option provided by the garment processing device 100. Therefore, the online system according to one embodiment of the present disclosure can be configured such that the garment processing apparatus 100 can automatically determine the appropriate mode or option based on the analysis result of the wrinkle level or soil level of the garment.

[124] Figure 3 shows one embodiment of the structure of the online system in accordance with the present disclosure, providing the above-described functions.

[125] An on-line system external terminal 400 according to one embodiment of the present disclosure includes a terminal input interface 430 for inputting a command to operate the external terminal, a terminal display 440 that displays the state of the external terminal 400 and information received from the server 600, a long-range communication module 451 configured to communicate with a server 600 located at a remote location, a short-range communication module 452 configured to communicate with home appliances such as a clothes processor 100 or a washing machine 300 located next to it, a terminal controller 420 that controls the elements of an external terminal device, and a terminal storage device 410 that stores information received from a terminal input interface or a communication module.

[126] The short-range communication module may be configured to communicate with a communication device within a specific distance, for example, using radio frequency based on switching protocols such as WI-FI, Bluetooth, and ZigBee. The long range communication module may be configured to communicate with a communication device at a remote location via a base station or communication network using 3G, LTE, or 4G.

[127] The server 600 according to one embodiment of the present disclosure may include a communication device 610 configured to communicate with an external terminal device 400 or communicate with a home appliance such as a clothes processor 100 or a washing machine 300, or an AP. 300, a computing and processing device 620 that generates or analyzes various control signals, and a storage device 630 that stores information generated or received by an external terminal device, home appliance, or computing and processing device, or from an external terminal device, home appliance, or computing and processing device.

[128] In particular, the storage device 630 of the server 600 can store information AI about the stored clothes of the user, information BI about the user's body, information DI about the background where the user is or may be, information EI about another person, including information about the other person's body. , which accompanies the user, and information about the other person's clothing, as well as FI payment information, necessary for the user to make an online purchase. This information may be obtained from the user's external terminal 400 and the home appliance such as the garment processing apparatus 100 or the washing machine 300. Stored clothing information AI, user's body information BI, etc. may be collected using the external terminal device 400 or fitting unit 200 located in the home appliance. In addition, the memory 630 may store a recommendation algorithm providing a recommendation as to which clothing suits the wearer at a given time based on the above information.

[129] The recommendation algorithm may be implemented as an algorithm in which, when at least one of the user's body information, schedule, weather information, and AI clothing information selected by the user is inputted therein, suitable clothing for that issued immediately.

[130] The recommendation algorithm can be provided directly by the merchant who sells the home appliance. For example, big data, including clothes worn by people in the region where the user is located, in an age group similar to the user and in a similar profession, etc., and other clothing data provided by clothing sellers can be collected and stored in the storage device 630 of the server 600. The computing and processing device 620 of the server can calculate big data based on deep learning to generate a recommendation algorithm. The recommendation algorithm may be stored in the storage device 630 or transmitted to the external terminal device 400 or a home device, including the clothes processor 100 or the washing machine 300, via the communication device 610 . Its detailed description will be given below.

[131] The garment treatment apparatus 100 according to one embodiment of the present disclosure may include a refresh-related main memory 170 storing an arbitrary mode or option for refreshing clothes, a refresh-related main controller 180 for performing one mode or options from arbitrary modes or options, and a refresh-related communication module 260 configured to communicate with a home appliance such as a washing machine 300, a server 600, an external terminal 400, or an AP 500.

[132] The refreshing-related main controller 180 can be configured to prevent standby power consumption by turning off the power when the operation of the garment treating apparatus 100 is completed or stopped. However, the refresh-related main controller 180 may be configured to ensure that the refresh-related communication module 260 is maintained in which power is always supplied to the refresh-related communication module 260 such that the refresh-related communication module 260 maintains a switching state with the server 600. .

[133] The garment processing device 100 may include a refresh-related input interface 150 configured to input a command to execute one of arbitrary modes or options, and a refresh-related output interface 140 for outputting the status of the garment processing device or information, received from the refresh-related communications module 260 .

[134] For example, the refresh-related input interface 150 and the refresh-related output interface 140 may be located on the outer surface of the garment treatment device 100 to facilitate user access thereto. The refresh-related input interface 150 may include a refresh-related button 152 for entering a wash or power mode/option, a refresh-related microphone 151 for receiving audio signals such as voice commands, and a refresh-related camera 153 for receiving image signals. In addition, the refresh-related output interface 140 may include a washing-related screen or a refresh-related screen 142 for presenting information using an image, and a refresh-related speaker 141 for outputting a sound signal. In addition, the refresh-related exit interface 140 may be configured as a touch pad and configured to be used as the refresh-related entry interface.

[135] The refresh-related communication module 260 may include a refresh-related communication modem 261 configured to communicate with the server 600, the AP 300, the external terminal 400, and home appliances such as the washing machine 300 associated with the refresh. a communication controller 262 configured to control the refresh-related communication modem 261; and a refresh-related communication memory 263 that stores information received from the refresh-related communication modem 261 or information generated from the refresh-related communication controller 262. Associated with refresh, the communication module 260 may be configured to perform the function of a short-range communication module and a long-range communication module as in the external terminal device 400. The refresh-related communication module 260 may be configured to receive the recommendation algorithm provided by the server 600 and store algorithm in the refresh-related communication memory 263; and transmitting the recommendation algorithm to the fitting unit 200.

[136] The garment treatment apparatus 100 may further include a sensor 160 capable of recognizing or detecting a level of soiling or a wrinkling level of the garment A, and may further include a refreshing enhancer 190 that may remove or reduce the level of soiling or wrinkling of the garment. .

[137] For example, the sensor 160 may include a chemical sensor 161 that detects the level of air pollution inside the garment processing device 100, or an internal camera 162 that may display the garment or the area in which the garment is placed. The refresh-related main controller 180 may be configured to calculate a soil level or wrinkle level based on the state of the garment receiving area detected by sensor 160 and determine an appropriate mode or option among arbitrary modes or options based on the soil level or wrinkle level.

[138] In addition, the refresh-related main controller 180 may transmit soil level or wrinkle level information to the washing machine 300 via the refresh-related communication unit 260 when the soil level or wrinkle level is greater than or equal to the reference value. The refresh related communication module 260 may communicate soil level or wrinkle level information to server 600 or washing machine 300.

[139] In addition, the refresh-related main controller 180 may display a recommendation that clothes should be washed in the washing machine 300 on the refresh-related output interface 140.

[140] The washing machine 300 according to one embodiment of the present disclosure includes a washing-related main memory 380 storing an arbitrary mode or option to remove foreign matter from clothes, a washing-related main controller 370 executing one mode or option among the optional modes or options, and a wash-related communication module 360 configured to communicate with an external terminal 400 or AP 300, and a refresh-related communication module 260.

[141] The washing-related main controller 370 prevents standby power consumption by turning off the power when the operation of the washing machine 300 is completed or stopped. However, the main controller 370 associated with washing may be configured to maintain the state of the communication module 360 in which it is powered to maintain its communication state.

[142] The washing machine 300 may include a wash-related input interface 350 for receiving a command to execute an arbitrary mode or option, and a wash-related output interface 340 that outputs a state of the washing machine 300. A wash-related input interface 350 and a wash-related the output interface 340 may be similar to those of the garment processing device 100 .

[143] The laundry-related communication module 360 includes a laundry-related communication modem 361 configured to communicate with at least one of the server 600, the AP 500, the external terminal 400, and the garment processing device 100, associated with a wash communication controller 362 configured to control the wash related communication modem 361, and a wash related communication memory 363 that stores information received from the wash related communication modem 362. The wash-related communication module 360 may be configured to function as a short range communication module and a long range communication module as in the external terminal 400.

[144] As a result, the clothes treating device 100 and the washing machine 300 can be configured to communicate with each other via the refresh-related communication module 260 and the washing-related communication module 360, or with the external terminal 400 and the server 600 via the refresh-related a communication module 260; and a laundry-related communication module 360. In this way, the washing machine 300 can acquire and store information about the level of soiling or the level of wrinkling of the clothes in advance through the washing-related communication module 360. The warp-associated controller 370 can then determine the appropriate mode or option based on the level of soiling or the level of wrinkling. In another example, the server 600 may predetermine a mode or option suitable for the state of the garment and transmit it to the wash-related communication module 360.

[145] In one example, the online system according to one embodiment of the present disclosure may further include a fitting unit 200 that collects user body information BI, user stored clothing information AI, indoor background information DI, etc. ., and provides the user with a virtual fitting service.

[146] As described above, the fitting unit 200 may be located on the garment treatment apparatus 100 and may be configured to interact with the refresh-related communication module 260 or elements of the garment treatment apparatus 100.

[147] In one example, the refresh-related main storage 170 may store a list of suggestions that corresponds to the user's voice command and the button 153 of the refresh-related input interface 150. When the refresh-related input interface 150 receives a voice command through the refresh-related microphone 153 the input interface 150 may be configured to compare the voice command with the suggestion list and select the command based on the result of the comparison, and then send the selected command to the refresh-associated main controller 180 or communication module 260.

[148] When the refresh-related main controller 180 can directly receive and process the command, the refresh-related main controller 180 can control the elements of the garment treatment apparatus 100 according to the command. In addition, when the communication module 260 receives a command, the module 260 may send a command to the server 600 to request transmission of a command to control the elements of the garment processing device 100 from the server 600. The server 600 may be configured to cause the garment processing device 100 to execute the appropriate command. through the communication module 260.

[149] Below, the configuration and function of the fitting unit 200 according to one embodiment of the present disclosure will be described with reference to FIG.

[150] The fitting unit 200 may include an imaging unit 220 that generates an image of the user's body or clothing owned by the user, and a virtual output interface 210 that can display the user or clothing captured by the imaging unit 220.

[151] The imaging unit 220 may include at least one of a depth camera 221, which can display not only the shape of the user's body or the stored clothing A, but also its area and volume, of the position camera 222, which detects a position change of the user and clothing position, and a motion camera 223 that can detect changes in the user's motion or clothing. The depth camera 221, the position camera 222, and the motion camera 223 may be located separately, or may be integrated into one camera, or may be integral with the camera 153, which functions as the refresh-related input interface 150 of the device 100 for clothing processing. For example, the depth camera 221 may be implemented as a camera that calculates the depth value of each pixel in an image. This calculation cannot be done in a 2D camera. The depth camera 221 may include a plurality of depth cameras.

[152] As a result, the imaging unit 220 can be configured to calculate the pixel depth of a user or clothing displayed by two or more camera modules to obtain a 3D image.

[153] In one example, the imaging unit 220 may also perform a user identification function. For example, imaging unit 220 may be configured to identify a particular user and another user. The imaging unit 220 may be configured to recognize the iris of each of the plurality of users, or to detect one of the faces, body features, and shape thereof to identify the plurality of users.

[154] The fitting unit 200 may further include an extended computing unit 230 that extracts and recognizes the user's body information or clothing information from the image obtained by the imaging unit 220 .

[155] The extended computing unit 230 may include a contour evaluation unit 231 that extracts the appearance or contour of the user's body or clothing from the image recorded by the imaging unit 220, a clothing separating unit 232 that separates the clothing from the user's body, a measuring unit 233 volume, which calculates the volume of the user's body or the volume of clothes, and the clothes analysis unit 234, which recognizes the material, color, shape, and type of the extracted clothes. Thus, the advanced computing unit 230 can obtain AI clothing information, including the shape, color, material, brand, and volume of the clothing, and BI body information, including the user's height, volume, length of each joint, and skin color, from the image obtained by the unit 220 imaging.

[156] The imaging unit 220 can display not only the user or clothes, but also an interior area where the user is absent. Extended computing unit 230 may include a background recognition unit 235 that recognizes an area as the main background. The background discriminating unit 235 may be used when the contour judging unit 231 recognizes the outline or the clothing separating unit 232 separates the clothes from the user's body based on a comparison result between the background image and this recorded image. Accordingly, the extended computing unit 230 can obtain basic DI information about a background in which there is no user.

[157] In one example, the fitting unit 200 may include an extended storage device 240 in which an extended computing unit 230 stores information analyzed based on an image recorded by the imaging unit 220.

[158] The extended memory 240 may store all of the information extracted by the extended computing unit 230 from the image captured by the imaging unit 220. For example, the clothing information AI, the user's body information BI, and the background information DI, which are extracted and obtained by the extended memory 240 from the user's image and the plurality of clothing images displayed by the imaging unit 200, may be stored in a database. In another example, the background information DI may include other background information obtained from the refresh-related communication module 260 . The other background may include a background provided by the server 600 and a background provided by the external terminal 400.

[159] In addition, the extended storage device 240 may also store EI information about another person, including another user other than the user or a person who does not use the clothing processing device 100 other than the user according to the user's choice. The other person's information EI may include at least the other person's body information, the other person's preferred clothing information, and the clothing wearing information regarding the state in which the other person wears particular clothing. Information EI about the other person can be obtained by the enhanced computing unit 230 analyzing the image captured by the imaging unit 220 or the image obtained by the refresh-related communication module 260 .

[160] In addition, the extended storage device 240 can further store payment information FI used to purchase clothes that the user does not own. For example, the payment information FI may include merchant external sales information, user passbook information, user payment card information, user authentication information, and the like.

[161] The extended computing unit 230 may further include a comparison recognition unit 236 configured to compare information stored in the extended memory 240 with information currently displayed by the imaging unit 220 and recognize differences and similarities between them. For example, the comparison recognition unit 236 may detect a change in the user's body or a change in clothing worn by the user. The comparison recognition unit 236 can recognize the ratio of the user's body or face, and accurately recognize the specific user based on the comparison result between the previously captured image and the current captured image, and can recognize changes in the body of a specific user or clothing worn by a specific user.

[162] In one example, the comparison recognition unit 236 may compare and analyze AI's stored clothing information to understand the user's preferences. The user's preferences may include at least information about the type, style, size, color, material, brand, and fashion trend (eg, office look, see-through look) and the like of the user's preferred clothing.

[163] In other words, the type, style, size, material, and color of clothing that the user prefers among various types, materials, and colors of clothing may be stored as preferences in the extended storage device 240. The stored clothing information AI may be associated with preference levels. This preference information can be used to extract clothes suitable for the user from the AI's information about the stored clothes.

[164] In one example, the extended storage device 240 can store not only the stored clothing of a particular user, as depicted by the imaging unit 220, but also information CI about the target clothing of the purchase, which can be purchased by the user and obtained from the refresh-related module 260 connections. Purchasing target clothing information CI may include information about the material, shape, volume, etc., clothing brand, user's preferred brand, clothing suitable for user body information B, and clothing provided by the seller suitable for FI information. about the user's payment.

[165] The try-on unit 200 may include a recommender unit 250 that may apply to the recommendation algorithm at least one of the information stored in the extended memory 240, information obtained by the extended computing unit 230 analyzing the image currently captured by the unit. 220 visualization, and weather information, schedule information, fashion information, target clothing purchase information, etc. received through the refresh-related communication module 260, and can output clothing suitable for the user.

[166] The recommendation block 250 may be configured to directly execute a recommendation algorithm to recommend appropriate clothing to a user, or to obtain a result of execution of the recommendation algorithm from server 600 to recommend suitable clothing to a user.

[167] When the recommendation block 250 directly executes the recommendation algorithm, the recommendation block 250 may include a stored clothes matching block 251 that inputs current state information and AI information about the stored clothes into the recommendation algorithm to determine suitable clothes, the target clothes matching block 252 purchase, which inputs the current state information and information CI of the target clothing of the purchase into a recommendation algorithm for determining suitable clothing, and a matching level determination unit 253, which determines the matching level for each of the stored clothing matching unit 251 and the purchase target clothing matching unit 252.

[168] The recommendation block 250 may recommend to the user the appropriate clothes from the stored clothes A and the purchase target clothes CI through the stored clothes matching block 251 and the purchase target clothes matching block 252, respectively.

[169] The recommendation unit 250 may first calculate the matching level of the stored clothing information AI to recommend suitable clothing to the user. When the matching level is below a predetermined value, the recommender 250 may calculate a matching level of the purchase target clothing information CI to recommend suitable clothing to the user. As a result, the recommendation unit 250 can actively use the clothes A owned by the user, and thus can prevent unnecessary purchases.

[170] The matching level determination unit 253 may include a database that stores information about the matching level at which different types of clothing match each other. The database can be obtained from the server 600. The matching level determining unit 253 can create a database including information about the level of matching between various products, including the level at which the top and bottom of specific styles match each other, the level at which specific color types of clothing match each other, the level at which various accessories such as bags, scarves and sunglasses match the clothing of a particular style. Alternatively, the match rate may be a calculated value, as empirically learned when the database is subjected to a deep learning process on the server 600.

[171] Below, one embodiment for calculating a matching level will be described. One embodiment, which will be described below, can be applied to a database creation process and can be applied to a process in which a database is subjected to a deep learning process.

[172] Basically, the upper part corresponds to the lower part. Specifically, a shirt or blouse among the tops corresponds to a jacket or cardigan, and so on. The jacket can match the coat. In addition, various articles such as bags, shoes, and a scarf may correspond to the state in which the wearer wears both the upper and the lower. Accessories such as sunglasses, necklaces, and earrings may correspond to the state in which the wearer wears both the top and bottom.

[173] With regard to the product for the layered look, the skirt and the leggings as the bottom may match each other. However, long jeans and long cotton trousers as the bottom cannot match. The reason is that the wearer usually does not wear jeans and cotton trousers at the same time.

[174] In one example, even when the top and bottom may generally match each other, the level of matching between them may vary depending on the type, color, and material of the top and bottom. For example, jeans may not be paired with hanbok (Korean traditional clothing). In some cases, garments of specific colors don't go well together. In addition, the level of matching between accessories and different products and clothing in different materials and colors may vary depending on the color and material of the accessories and different products.

[175] Thus, the level of conformity refers to the information obtained by statistical calculation of the levels at which different products correspond to each other. For example, as described above, jeans and cotton trousers cannot be matched, and the user does not usually wear jeans and cotton trousers at the same time. Thus, the level of correspondence between them is 0.

[176] Whether both products match or not can be determined based on the number of combinations between them that can be found in the data. In conclusion, the higher the level of correspondence between two products, the greater the number of combinations between them that can be found in the data. When the level of correspondence between two products is lower, the number of combinations between them that can be found in the data may be less.

[177] Thus, the number of combinations between them that can be found in the data can be converted to the corresponding level between them. As a result, when the match level value is higher, a combination between the two is allowed. When the match level value is low, a combination between the two is invalid.

[178] The recommendation block 250 may calculate the match levels of the stored clothing and the purchase target clothing, respectively, based on the match level information stored in the match level determination block. When there is clothing having a matching level equal to or higher than the reference value among the stored clothing information AI, the recommender 250 may recommend the stored clothing while excluding the purchase target clothing. However, the recommender 250 may be configured to recommend clothing having a matching level equal to or higher than the reference level among the stored clothing information AI.

[179] For example, when jeans are retrieved as a recommended garment, the matching level between the recommended garment and cotton trousers belonging to the stored clothing or purchase target clothing is 0, thus preventing the occurrence of a case where jeans and cotton trousers match each other at the same time. .

[180] In one example, the match level determiner 253 may prioritize the clothing to be recommended based on the user's calculated preference. For example, when a plurality of clothes have similar matching levels, a particular garment may be selected and recommended from the plurality of clothes based on the user's preference. As a result, the user's preferences can be taken into account among the fashionable clothes, and the testimonials can be good.

[181] In addition, the match level determination unit 253 can be configured to calculate the match levels of clothing having a higher user preference and recommend specific clothing from it. As a result, preference may be considered to take precedence over fashion trend, so that the user's preferences may be considered first. In one example, recommender block 250 may include an additional recommender block 254 that is configured to recommend additional accessories and the like.

[182] The additional recommender block 254 can be configured to automatically determine an accessory that is requested separately from the user or whose compliance level is increased in the conformity level determiner 253 and recommend the accessory.

[183] In one example, fitting block 200 may further include a virtual output interface 210 that outputs clothing recommended by recommendation block 250 to the user.

[184] The virtual output interface 210 may include a display panel 211 that displays recommended clothing in video or image format, and a speaker 212 that may indicate that the clothing should be purchased by voice.

[185] The clothes may have a real-scale size with respect to the user's image, and may be displayed on the user's image, and may be displayed on the display panel 211. That is, the state in which the wearer is wearing the clothes may be displayed on the user's image. Thus, the user can determine if the clothing is suitable for him without even wearing the recommended clothing.

[186] Extended computing unit 250 may include a clothing combination unit 237 that combines clothing recommended by recommendation unit 250 with an image or video image of a user. The clothing combining unit 237 may combine the recommended clothing information with the user's image captured by the imaging unit 220 to display the state in which the clothing is worn on the user's body. The clothing combining unit 237 may consider the wearer's body ratio and the clothing ratio when combining the clothing and the body image with each other. The clothes combining unit 237 may be configured to display other parts of the clothes according to the movement of the user.

[187] In one example, extended computing unit 250 may include an additional combining unit 238 that further combines the combined image of the user's body and clothing obtained by clothing combining unit 237 with accessories recommended by additional recommendation unit 254.

[188] 3D clothing or accessory information already measured or calculated may be stored in stored clothing information AI and purchase target clothing information CI. Thus, the extended computing unit 230 can calculate the state in which the clothing or accessory is worn to the user's actual body size, and display this state on the virtual output interface 210.

[189] When the clothes the user is currently wearing is a bottom, the enhanced computing unit 230 may recommend information about the bottom owned by the user (jeans, blue skirt, three-quarter pants, knitted pants) based on the matching level in AI information about the stored clothes or CI information about the target clothes of the purchase. The extended computing unit 230 may then combine the recommended clothing with the user's image to create a virtual selection image, and may display the virtual selection image on the virtual output interface 210.

[190] As described above, in accordance with embodiments of the present disclosure, the user can directly determine with his own eyes how well the clothes he owns and the recommended clothes match each other.

[191] Below, the structure in which the fitting unit 200 is installed in the garment processing apparatus 100 will be described.

[192] FIG. 5 shows one embodiment of the garment processing device 100.

[193] As shown in FIG. 5(a), the garment treatment apparatus 100 according to one embodiment of the present disclosure includes a body 110 having a front opening, a door 111 that is pivotally positioned on the body 110 to open and closing the opening, an inner body 120 which is located in the body and which forms a garment accommodation area S in which the garment A is placed, a hot air or steam supply device 700 in communication with the inner body 120 to supply at least one of the hot air or steam into the garment S area S, and hanger supports 126 and 127 which are located on the inner case 120 and/or the door 111 for supporting hangers holding the garment A within the garment placement area S.

[194] The body 110 may be configured to form the appearance of the garment treatment device, and may have a vertical dimension larger than the horizontal dimension. As a result, the upper garment A1 shown as well as the lower portion A3 which extends vertically in the expanded form can be placed in the inner body 120. Thus, unnecessary wrinkles in the placed garment may not be generated.

[195] The housing 110 may be made of a metallic material. As long as the body can retain strength, it can be made from a polymeric material such as reinforced plastic.

[196] The inner case 120 may be made of a material that does not physically deform or chemically react with foreign matter emitted from the clothing A or hot air or steam supplied from the feeder. For example, the inner casing may be made from a range of styrene resins such as ABS and ASA. The inner case 120 may be configured to communicate with the hot air or steam supply device 700, so that hot air or steam is supplied from the hot air or steam supply device 700 to the garment placement area S, or the air is discharged into the hot air or steam supply device 700 or pair. To this end, the inner case 120 may have a plurality of through holes 121, 122, and 123 formed therein, communicating with the hot air or steam supply device 700.

[197] In one example, the hot air or steam supply device 700 may be located separately from the inner housing 120. The hot air or steam supply device 700 may be located under the inner housing 120 to uniformly supply heated air or steam with a relatively low density to the inner housing 120.

[198] In one example, the door 111 may be hinged to the housing 100 and may be configured to open and close the opening. The door 111 may be configured to close the front surface of the hot air or steam supply device 700 as well as the inner case 120. This not only prevents hot air or moisture supplied to the inner case 120 from leaking to the outside, but also prevents heat transfer, generated by the hot air or steam supply device 700 to the outside.

[199] Since the door 111 is configured to open and close the front opening of the inner body 120, the inner circumferential surface of the inner body 120 and the inner surface of the door 111 can form a garment placement area S.

[200] The hanger support may include a first hanger support 127 configured to support a hanger holding garment A inside the inner case 120 and a second hanger support 126 configured to support the hanger holding garment A on the inner surface of the door 111.

[201] Below, the description will be made on the assumption that the hanger holding the coat A1 is supported on the first hanger leg 127, and the hanger holding the lower part A3 is supported on the second hanger leg 128.

[202] The first hanger support 127 is rod-shaped inside the inner case 120, so that the hanger holding the coat A1 can be supported on it in the garment placement area S. The first hanger support 127 may be located on the upper surface of the inner case 210, or may be located on the upper part of the side surface of the inner case 210, so that the hanger holding the coat A1 in a fully extended state can be supported on it in the inner case 120. The first support 127 A hanger on which the hanger holding the unfolded garment A by its own weight is supported is mounted on the inner case 120 to uniformly expose the hot air or steam supplied from the hot air or steam supply device 700 to the coat A1.

[203] The second hanger support 126 may support the hanger holding the bottom A3 on the inner surface of the inner casing 120 or at a location adjacent to the door 111. As a result, the second hanger support 126 ensures that the bottom A3 is in close contact with the inside surface of the inner casing 120 or the door 111 to eliminate its wrinkling.

[204] In one example, the garment treatment apparatus 100 according to one embodiment of the present disclosure may further include a freshening enhancing means 190 that maximizes the refreshing effect of garment A.

[205] The freshening enhancing means 190 may include a vibration generator 191 connected to the first hanger leg 127 to vibrate the first hanger leg 127, and a pressing means 192 located under the second hanger leg 126 for pressing clothes.

[206] The vibration generator 191 may be configured as a module including a motor, a pulley, and a cam for reciprocating the first hanger support 127 in a longitudinal direction or along an arc path. Thus, hot air or steam can be evenly supplied to the surface of the coat A1 supported on the first hanger leg 127, and foreign matter adhering to the coat A1 can be removed from it.

[207] The pressing means 192 may be articulated with at least one of the inner case 120 or the door 111 to press the lower portion A3. The pressing means 192 can manually press the lower part A3. The pressing means 192 may have a hinge rotatably connected to the inner case 120 or the door 111, etc., for automatically pressing the lower part A3 by a motor. The door 111 or the inner case 120 may further include a pressed clothing support surface 112 for surface contact with the pressing means 192. Each of the pressing means 192 and the pressed clothing supporting surface 112 may be in the form of a plate. The pressed garment support surface 112 may apply pressure to the lower portion A3 in response to the pressing force of the pressing means 192.

[208] As shown in FIG. 5(b), the garment processing apparatus 100 may further include the aforementioned fitting unit 200. The door 111 is located on the front surface of the housing 110 so that the user can easily access the door. Therefore, the refresh-related input interface 150 and the refresh-related output interface 140 may be located on the open surface of the door 111. The virtual output interface 210 and the imaging unit 220 may further be located on the open surface of the door 111. In another example, the fitting unit 200 may be located on another element of the garment processing device 100.

[209] The virtual output interface 210 can be configured to occupy a larger portion of the open surface area of the door 111. Accordingly, the virtual output interface 210 achieves a mirror effect by displaying an image the same size as the user's actual size.

[210] For example, the display panel 221 may be located on most of the front surface of the door 111. The speaker 212 may be located on the open surface of the display panel 221 or the door 111.

[211] In addition, the imaging unit 220 can be located near the virtual output interface 210. As a result, the imaging unit 220 can recognize the user's uniform and the clothes the user is holding or wearing at a precise angle. Specifically, the depth camera 221 may be located at a level corresponding to the user's eye level. For example, the depth camera 221 may be located above the virtual output interface 210. As a result, the imaging unit 220 may depict the user at the user's eye level and display a mirror image of the user on the virtual output interface 210.

[212] The position camera 222 and the motion camera 223 may be located adjacent to the depth camera 221 so that the three cameras may constitute the module imaging unit 220 .

[213] The display panel 221 may also serve as the clothing screen 142 in FIG. In addition, the garment screen 142 may be located above one side of the display panel 221 or on one side of the display panel 221.

[214] In one example, speaker 212 may also serve as speaker 141 in FIG.

[215] The button 153 or the microphone 152 may be positioned over one side of the display panel 221 or on one side of the display panel 221 so as not to obscure the display panel 221. In one example, the imaging unit 220 may be in the form of a camera 153 that senses motion. user.

[216] FIG. 6 shows an embodiment of the display panel 221 of the garment treatment apparatus 100.

[217] As described above, the garment processing device 100 is configured to communicate with the server 600 and the external terminal 400 via the communication module 260. Accordingly, the garment processing device 100 may be configured to receive information about the user's schedule or weather, and location information of a particular clothing vendor from the server 600 or the external terminal 400.

[218] The refresh-related input interface 150 may be configured to receive a command requesting a user's schedule, weather information, and location information through a dedicated button 153 or a microphone 151. The command may include a voice command.

[219] When the command has been received, the refresh-related main controller 180 may query the communication module 260 to obtain the user's schedule, weather information, or location information from the server 600 or the external terminal 400.

[220] When the communication module 260 has received the requested information, the refresh-related main controller 180 may be configured to control the virtual output interface 210 to display the requested information such as user schedule, weather information, and location information.

[221] As a result, even when the user is away from the clothing processing device 100, the user can use a function or service provided by the clothing processing device 100 using a voice command. In addition, the user can query the required information and visually determine the requested information using the garment processing device 100 having a relatively wide display panel.

[222] Below, a specific embodiment will be described in which the online system according to one embodiment of the present disclosure obtains the user's body information, the stored clothing information, and the user's background information, and recommends individual clothing based on the acquired information.

[223] FIG. 7 shows an embodiment in which the online system clothing processing apparatus 100 according to one embodiment of the present disclosure acquires body information BI by image of the user's body.

[224] The online system according to one embodiment of the present disclosure must obtain accurate information about the user's body to provide the user with a virtual fitting [Augmented Reality (AR) fitting, Virtual Reality (VR) fitting]. The reason is that the more accurate the user's body information, the more accurate the virtual fitting.

[225] As shown in FIG. 7(a), the user may be positioned in front of the garment processing device 100 to provide body information. The user may be in a situation where he enters a command for entering body information into the refresh-related input interface 150.

[226] When the garment processing device 100 receives a command to input body information, the imaging unit 220 can display the user's body. The image captured by the imaging unit 220 may be transmitted to the extended computing unit 230 and may be displayed in real time on the virtual output interface 210.

[227] At the same time, the imaging unit 220 can recognize the identity of the depicted user. For example, one of the iris, face, and body information of a particular user, as depicted, can be recognized and stored in an extended storage device. Accordingly, information about the body of a specific user and information about the body of another user can be stored in a distinct manner therein. The body image 213 of the user obtained by the imaging unit 220 may be displayed on the virtual output interface 210. The body image 213 may be the image itself obtained by the imaging unit 220 or may be an image of a video image processed by the extended computing unit 230.

[228] The guide line 214 may be displayed on the virtual output interface 210.

[229] The guide line 214 may refer to a line that is displayed to guide the user's body so that BI information about the user's body can be accurately obtained. For example, the guide line 214 may be a line that guides the user to maintain a state in which the arms and legs are extended while the user is standing in front of the device 100.

[230] In addition, the guide line 214 may refer to a line for guiding a user to locate at a location where information about the user's body can be accurately measured. The user can adjust the distance from the user to the imaging unit 220 so that the user's body is exactly in the area defined by the guide line 214. This ensures that the imaging unit 220 acquires the image of the entire body of the user at an optimal distance and delivers the image to the extended computing unit 230.

[231] The guide line 214 may change frequently. As a result, the imaging unit 220 can display the movements of the user and at the same time the image of the entire body of the user, including the front, back, left and right parts. Since the imaging unit 220 includes a depth camera 221, the imaging unit 220 can accurately acquire an image of the user's volume or body structure.

[232] As shown in FIG. 7(b), the extended computing unit 230 can accurately recognize body parts of the user based on the image obtained by the imaging unit 220. For example, the contour estimator 231 can accurately extract the contour Y of the user's body from the image obtained by the imager 220 .

[233] In addition, the advanced computing unit 230 may analyze the movement of the user based on the detection result of the motion camera 221 of the imaging unit 220, so that the basic positions of the user's joints can be determined by the advanced computing unit 230. The extended computing unit 230 may store an algorithm, which aligns the major joints of the human body with the image captured by the imaging unit.

[234] For example, the contour estimator 231 can recognize the main joint from the user's Y contour. The contour evaluation unit 231 may locate the neck joint P1 based on the movement of the user's head and chest, and may locate the shoulder joint P2 based on the movement of the user's arm and chest. In addition, the contour evaluation unit 231 can obtain the position of each of the elbow joint P3 and the wrist joint P4 based on the movement of the arm, and may obtain the position of each of the hip joint P5, the knee joint P6 and the ankle joint P7 based on the movement of the legs.

[235] As shown in FIG. 7(c), advanced computing unit 230 may determine the length between the user's joints based on determined joint positions. For example, the volume measurement unit 232 may calculate and measure the length and volume of the user's body based on the contour and joint extracted by the contour evaluation unit 231 . That is, the volume measurement unit 232 can accurately recognize the length and volume of each of the user's head, neck, arms, legs, and waist.

[236] Using the volume measurement unit 232, body-specific BI information can be obtained by accurately determining the user's overall height, length between specific joints, and volume between specific joints. The body information BI may be stored in the extended storage 240. Thereafter, the comparison recognition unit 236 may use the body information BI to determine whether the body information BI has changed or to extract the stored clothing information AI when the wearer is wearing the clothing.

[237] In another example, the extended computing unit 230 may recognize the user's skin color or eye color, iris, face, beard, hairstyle, etc., from the image measured by the imaging unit 220, and include this in the body information BI .

[238] FIGS. 8-10 show an embodiment in which an online system according to one embodiment of the present disclosure retrieves and recognizes clothing information AI of a user.

[239] In order for the online system according to one embodiment of the present disclosure to recommend the user's stored clothing A through the fitting unit 200, specific information about the stored clothing A must be submitted and registered. When the stored clothing information A is not provided as a direct file to the merchant or user, the online system according to one embodiment of the present disclosure can directly obtain an image of the user's stored clothing A and extract and store the stored clothing information AI.

[240] An online system according to one embodiment of the present disclosure may perform a registration request GI operation to request a user to store clothing information A that the user has in the online system. In the registration request operation G1, the user may be instructed to store information about the clothes he has in the fitting unit 200 via the refresh-related input interface 150 of the clothes treatment device 100 .

[241] The garment processing apparatus 100 may be used to register garments, and thus may correspond to the garment registration apparatus.

[242] The command may be received when the user directly inputs the clothing registration request button 152 in the refresh-related input interface 150. Alternatively, the command may be received via the user's voice command from the microphone 151 of the refresh-related input interface 150.

[243] When executing the registration request operation G1, the online system according to one embodiment of the present disclosure may perform a directing operation G2 to direct the registration of the garment by the user. The guiding operation G2 may position the user in front of the imaging unit 220 in a state in which the clothing is worn or carried by the user. In the guiding operation G2, the guide line 214 or the guide words may be displayed on the virtual output interface 210 to guide the user to an optimal location where the imaging unit 220 acquires the garment image A for registering the garment.

[244] The online system according to one embodiment of the present disclosure may perform a determination operation G3 to check whether the imaging unit 220 can recognize the garment A worn or carried by the user.

[245] The determining operation G3 may check whether the approximate shape of the garment can be determined, instead of checking whether the size or volume of the garment can be accurately recognized. For example, the determination operation G3 may check whether the extended computing unit 230 can approximately determine the wearer or clothing by the imaging unit 220 .

[246] In addition, the determination operation G3 may determine who registers the clothes. That is, the determination operation G3 determines whether a particular user registers clothes, or whether a particular user and another user register clothes. As a result, the clothes to be registered and the person who wears the clothes can match with each other, and then the matching result can be stored in the storage device.

[247] The online system according to one embodiment of the present disclosure may perform a notification operation G3-1 indicating that clothing registration is not possible when the enhanced computing unit 230 cannot accurately determine the wearer or the clothing.

[248] When the enhanced computing unit 230 cannot accurately determine the user, the identity of the user cannot be determined. In addition, when the enhanced computing unit 230 cannot determine the clothes, the clothes cannot be accurately recognized.

[249] The notification operation G3-1 may display, on the display panel 211, words indicating a state in which clothes cannot be registered or words requiring the user's location to be changed so that the user's body is in the area defined by the guide line 214 In addition, the voice corresponding to the words can be output through the speaker 212. After the notification operation G3-1, the direction operation G2 may be repeated.

[250] Even in this case, when the user or clothing cannot be accurately determined, words requesting user registration may be displayed on the display panel 211. This may correspond to the execution of the control method in FIG.

[251] When the recognition determination operation G3 determines that the user or clothing can be accurately identified, the online system according to one embodiment of the present disclosure may perform an image generation and storage operation G4 of the user or clothing using the imaging unit 220 and transmitting the resulting image. images to an extended computing unit 230 or an extended storage device 240.

[252] When the image generation and storage operation G4 is completed, the online system according to one embodiment of the present disclosure may perform the clothing extraction operation G5, in which the enhanced computing unit 230 extracts clothing from the captured image to obtain clothing information AI.

[253] The clothing extraction operation G5 may include an contour extraction operation G51 in which the contour evaluation unit 231 extracts the outline of the wearer wearing the clothing or the wearer having the clothing from the image captured by the imaging unit 220, the volume measurement operation G52, in in which the volume measuring unit 233 determines the volume of the extracted contour based on the information output from the depth camera 221, the clothing separating operation G53 in which the clothing separating unit 232 extracts only the clothing by removing the image or contour corresponding to the body of the user from the contour of the user wearing the clothing, or a user circuit that has clothes; and a clothes analysis operation G54 in which the clothes analysis unit 234 analyzes the type, shape, color, material, brand, size, volume, etc. of the retrieved clothes to obtain clothing information AI.

[254] The clothes analysis unit 234 can analyze the condition of the clothes when using the separated clothes in the clothes classification program obtained by statistical analysis of big clothes data. In the apparel classification program, a plurality of apparel can be classified into different categories depending on the type, shape, material, color, and brand of the apparel. The clothing classification program can match specific clothing with a category to analyze the type, shape, material, shape, color, brand, etc., of the specific clothing.

[255] The clothing classification program may be provided from the server 600 and may be obtained or updated via the refresh-related communication module 260 and stored in the extended storage 240.

[256] When the clothes have been parsed in the clothes retrieval operation G5, a clothes storage operation G6 can be performed to store clothing information AI about the clothes in the extended storage device 240. The clothes storage operation G6 can store the clothes that the user wants to register in the database.

[257] In one example, the garment storage operation G6 may match the registered garment with the user who requested the garment registration and store the match result. This is for accurately identifying the person to wear the clothes and using the result of the identification as data for recommending suitable clothes.

[258] An online system according to one embodiment of the present disclosure may perform an additional request operation G7 to detect the receipt of a command to direct a user to register additional clothing to the online system according to one embodiment of the present disclosure. When the additional request operation G7 is performed, the direction operation G2 is performed so that the clothing information of the AI regarding the new clothing can be stored in the extended memory 240. If an active command is detected not to perform the additional request operation G7 or after a certain time has elapsed, registration of the clothing may be terminated. .

[259] As a result, the user can directly register clothing information regarding clothing information about which is not provided by the seller to the online system, thereby storing clothing information AI about stored clothing that the user has in the database. Therefore, the online system according to one embodiment of the present disclosure can recommend clothing suitable for the user based on the clothing information AI to the user.

[260] FIG. 9 shows an actual implementation of the control method of FIG.

[261] The garment processing apparatus 100 according to one embodiment of the present disclosure receives a command to register a garment from a user, and thus a registration request operation G1 can be performed.

[262] Thereafter, a guiding operation G2 can be performed in which the garment processing apparatus 100 according to one embodiment of the present disclosure displays the guiding words and the guiding lines on the virtual output interface 210. While the user is wearing clothing, the user may be in front of the imaging unit 220 .

[263] The recognition determination operation G3 checks whether the extended computing unit 230 provides accurate determination of the wearer and clothing using the imaging unit 220 . In this regard, the user can be compared with the user data stored in the storage device, and whether the user as shown is a specific user or another user can be determined based on the result of the comparison. When the user is identified as a specific user, an image forming and storing operation G4 can be performed on an image of a specific user wearing clothing by the imaging unit 220 .

[264] In the entire image W obtained by the imaging unit 220, there is a background D on which the user is positioned and an outline Y of the wearer wearing clothes.

[265] An edge extracting operation G51 may be performed in which the extended computing unit 230 extracts the Y contour of the clothed user from the entire image W. For example, the contour evaluator 231 may extract the Y contour of the clothed user from the entire image. W.

[266] Specifically, the contour estimator 231 can accurately recognize and extract the contour Y based on the comparison result between the background information DI previously stored in the extended memory 240 and the entire image W. For example, the contour estimator 231 can compare the user image with the background image itself and extract an image further contained in the background image based on the result of the comparison. In other words, the background information DI can usually be received by the garment processing apparatus and stored therein. Upon receipt of a command to store the background, the background information DI may be previously stored in the extended memory 240.

[267] When the contour extraction operation G51 is completed, a volume measurement operation G51 can be performed in which the volume measurement unit 233 calculates the volume of the Y contour. The volume measurement unit 233 may obtain volume information using the depth camera 221. If necessary, the display panel 211 can be used to allow the user to rotate or change his position to obtain 3D information.

[268] The clothes separating operation G53 may be performed in which the clothes separating unit 232 separates the clothes from the user's body based on the Y contour. . Alternatively, the clothing separating unit 232 may remove the body B from the contour Y based on the user's body information BI to separate the clothing A from the image.

[269] The clothing separating unit 232 can separate the clothing from the body by removing parts with colors other than the user's skin color. In addition, the clothes separating unit 232 can detect a separation line in the image of the separated clothes and separate the clothes along this line based on the type of clothes.

[270] A clothing analysis operation G54 may be performed in which the clothing analysis unit 234 analyzes and recognizes clothing types A.

[271] When the garment A consists of the upper portion A2 and the lower portion A3, the garment analysis unit 234 may separate the upper portion A2 and the lower portion A3 from the entire separated garment A.

[272] The volume measurement unit 233 can accurately calculate the size, area, and volume of the separated clothing A. When the size, area, and volume of the clothing are calculated by the volume measurement unit 233, the clothing analysis unit 234 can analyze the type, material, shape, and color of the separated clothing A.

[273] For example, the clothing analysis unit 234 may input the type, material, color, and shape of the clothing A into the clothing classification program to recognize that the clothing is composed of the upper part A1 and the lower part A2. Then, using the clothing classification program, the clothing analysis unit 234 can recognize that the top of A1 is a white sleeveless cotton T-shirt and the bottom of A2 is blue jeans.

[274] The clothing storage operation G6 may be performed in which the clothing analysis unit 234 stores clothing information AI corresponding to the types, materials, colors, shapes, sizes, and volumes of the upper part A1 and the lower part A2 along with their identification numbers in the extended storage device 240. In the clothes storage operation G6, the brand of the clothes can be recognized and stored. If the brand is not on the garment, it can be saved using user input.

[275] Unlike shown, the user can request registration of the clothes in the state where the user is not wearing but holding the clothes in his hands. In this case, after the imaging unit 220 displays the entire image of the user, the extended computing unit 230 can separate the user's body and clothing from each other in the entire image W, and then the clothing analysis unit 234 can analyze the type, material, shape, color, and brand of separated clothing. When a user picks up a plurality of clothes, the clothes separating unit 232 may separate each of the clothes from the user's body to remove each of the clothes from the user.

[276] FIG. 10 shows an embodiment in which the user repeatedly performs an additional request operation G7 or repeatedly performs a registration request operation G1 to obtain the stored clothing information AI of the stored clothing.

[277] In the registration request operation G1 or the additional request operation G7, the user may request registration of the clothes in the state in which the user is wearing different clothes among the plurality of tops A2 or bottoms A3 and coats A1. A variety of clothes can include A11 yellow and blue jacket, A12 black wool coat, A21 blue cotton sleeveless T-shirt, A22 sleeveless striped acrylic T-shirt, A23 sky blue cotton dress, A24 sleeveless red blouse, A25 yellow silk dress, men A26 green T-shirt, A27 yellow long-sleeved cotton T-shirt, A28 outer underwear, A212 sleeveless pink blouse, A31 jeans, A32 three-quarter black trousers, A33 beige cotton trousers, A34 blue tennis skirt, A35 black leggings and A36 yellow skirt for the cancan.

[278] The imaging unit 220 may repeatedly depict a user wearing clothes. The advanced computing unit 230 can extract a plurality of edges from an image.

[279] For example, in a state in which the user wears clothes 9 times, the user may request registration of the clothes in the online system according to one embodiment of the present disclosure. The imaging unit 220 may generate the entire image of the user W 9 times, and the contour estimator 231 may extract 9 contours Y1-Y9.

[280] The clothing separating unit 232 may separate and remove clothing from circuits Y1 to Y9. The garment compartment unit 232 may extract a plurality of coats A1, tops A2, and bottoms A3 from contours Y1-Y9.

[281] The clothing analysis unit 234 may analyze and identify a plurality of coats A1, tops A2, and bottoms A3, respectively. Therefore, the clothing analysis unit 234 can determine whether the same clothing has been depicted in a repeated manner.

[282] The clothing analysis unit 234 can recognize the size, shape, and volume of each of the plurality of clothing. In addition, the clothing analysis unit 234 can recognize and store the type of each of the plurality of clothes in the extended memory 240. In addition, the clothing analysis unit 234 can classify the blue jacket A11 and the black coat A12 into outerwear A1, and can store the classification result together with its unique identification numbers in extended storage 240.

[283] The clothing analysis unit 234 can classify A12 black fur coat, A21 blue cotton sleeveless T-shirt, A22 striped sleeveless acrylic T-shirt, A23 light blue cotton dress, A24 sleeveless red blouse, A25 yellow silk dress, A26 men's green T-shirt, A27 long-sleeved yellow cotton T-shirt, A28 top underwear, A212 sleeveless pink blouse into A2 top, and can store the classification result along with unique identification numbers in the extended memory 240.

[284] The clothing analysis unit 234 can classify jeans A31, black three-quarter trousers A32, beige cotton trousers A33, blue H-skirt A34, black trousers A35, and yellow cancan skirt A36 into the lower part A3, and may store the classification result together with unique identification numbers in extended storage 240.

[285] When the garment has a brand printed on its outer surface, the clothing analysis unit 234 may recognize and store the brand in the extended memory 240.

[286] Accordingly, the extended storage device 240 can store information AI about the stored clothing, including shapes, materials, sizes, volumes, brands, etc., a plurality of coats, tops, and bottoms in a database format.

[287] Figures 11 and 12 show one embodiment in which the online system in accordance with one embodiment of the present disclosure has or creates a recommendation program that can recommend clothing appropriate for the user to the user.

[288] The garment treating apparatus 100 shown in FIG. 11 may include a plurality of garment treating apparatuses 100 provided by a vendor or manufacturer. That is, user information data including each user's schedule, body information, weather information, weather and schedule-related clothing preferences of the user, and clothing material AI information can be collected in a plurality of devices 100 for garments 100 provided by the vendor or manufacturer and can then be transferred to the server 600.

[289] The garment processing apparatus 100 may be used for recommending garments, and thus may correspond to the garment recommending apparatus.

[290] The server 600 may also receive general information data related to clothing provided from the external organization 800. The general information may include information about clothing that the public uses openly, information about fashionable clothing in the fashion industry, and corresponding colors corresponding to shapes, appropriate materials, appropriate styles of clothing derived from culturally casual clothing information, and other clothing information that the user does not have.

[291] Server 600 may collect and accumulate data received from garment processing devices provided by manufacturers, retailers, or external organization 800 to create big data.

[292] The server 600 may parse the big data to create the recommender itself. Alternatively, the server 600 may create a recommender T through big data deep learning.

[293] The server 600 may perform machine learning (deep learning) with the learning formula K using big data to analyze the data sample. The learning formula K can be an algorithm that analyzes and classifies big data using deep machine learning. The learning formula K can be an algorithm that gets a sample of clothes worn in a specific region, at a specific time, on a specific day of the week, and in a specific state from big data.

[294] As a result, the learning formula K can be an algorithm by which a deep machine learns mixed big data without any criterion for detecting and predicting wear patterns based on various criteria such as a specific region, a specific time, a specific day. weeks, specific weather, specific population, specific schedule, specific climate, and specific income level.

[295] In addition, the learning formula K may be an algorithm that generates a recommendation formula or recommender program T that can predict the mode and option to be performed when the usage history is finally entered into it at least once. The recommender program T may be generated by the server 60 via a DNN (Deep Neural Network) as a learning formula K. The recommender program T can be an algorithm or calculation formula that analyzes large data and outputs an expected result value when a particular state is entered into it.

[296] The recommender T may be a deep learning algorithm (machine learning) based on at least one of the history of a specific user and any user and various clothing information provided from the area where the clothing processing device is located. , a server 600 that manages a plurality of clothing processing devices including a clothing processing device.

[297] In addition, the recommender program T may refer to an algorithm or formula for computing to recommend what clothes a particular user wears under what conditions later based on what clothes a particular user wears under certain conditions.

[298] In this regard, the recommendation may include the meaning of the recommendation of what to do and the prediction of what the user will do now, thus providing convenience.

[299] The learning formula K deep-learns big data to create recommender T, and then continuously applies input to recommender T to train (update or develop) recommender T.

[300] In addition, the learning formula K can use the data previously collected by the garment processing device 100 and the external entity 800 back in the learning formula K to generate a recommender program T to update the recommender program T with machine learning.

[301] The server 600 may transmit the recommendation program T to the clothing processing device 100, so that the recommendation program T can be previously stored in the main memory 170 of the clothing processing device 100. In this case, the online system recommendation unit 260 according to one embodiment of the present disclosure may be located in the garment processing apparatus 100 .

[302] In addition, the recommendation program T may be hosted on the server 600. Upon request, the garment processing device 100 may access the server 600 through the refresh-related communication module 260 and obtain the recommendation program T stored on the server 600. Alternatively, , the garment processing device 100 may directly obtain the recommended garments as a result of the recommendation program T. In this case, the online system recommendation unit 260 according to one embodiment of the present disclosure may be located on the server 600.

[303] FIG. 12 describes the principle that recommender 260 can recommend clothes through recommender program T.

[304] The storage device 630 of the server 600 may store information about the schedule, body, weather, clothing preference, and clothes worn by the user 1 used by the clothing processing device 100 provided by the manufacturer or seller, or provided by an external organization in a DB format.

[305] When registering M wearing clothes of user 1, the number of data may be M.

[306] In addition, the storage device 630 of the server 600 may store information about the schedule, body, weather, clothing preferences, and worn clothes of the user 2 used by the clothing processing device 100 provided by the manufacturer or seller, or provided by an external organization in DB format.

[307] When registering M wearing clothes of user 2, the number of data may be M.

[308] When the number of users is N, the server 600 can store M wear data of N users, and thus a total of N X M data.

[309] The server 600 may perform machine learning (deep learning) on the data using the learning formula K to analyze patterns and rules in the data. Accordingly, the server 600 can perform machine learning for a sufficient period of time and thus can generate a recommendation algorithm T that can recommend the clothes that a particular user P is currently expected to wear based on the clothes worn on the set users from the data.

[310] When at least one of a specific user's schedule, body, weather, and specific clothing of a specific user is entered into the recommendation algorithm T, the recommendation algorithm T may recommend the clothing that the specific user intends to wear or is expected to wear at present. time, or which is appropriate for a particular user.

[311] A particular garment may correspond to one of the garments. When the user selects the bottom A3 as a specific garment, and when the user wants to get a recommendation for the top A2 or the top A1, the bottom A3 may be input to the recommendation algorithm T.

[312] The recommendation algorithm T may be composed of a weight matrix and a bias vector.

[313] Thus, the online system in accordance with one embodiment of the present disclosure can recommend the optimal clothing at the present time to improve the comfort of the user.

[314] In another example, the recommendation algorithm T may be stored in the external terminal 400.

[315] FIGS. 13-19 show an embodiment in which an online system in accordance with one embodiment of the present disclosure recommends clothing.

[316] In FIG. 13 shows the manner in which an online system, in accordance with one embodiment of the present disclosure, recommends clothing.

[317] An online system according to one embodiment of the present disclosure may perform a recommendation request receive operation HI to receive a request command requesting a recommendation of clothing suitable for the user from the user. The request command may be received via the refresh-related input interface 150 of the garment treating device 100, or may be received via the terminal input interface 430 of the external terminal 400.

[318] When the recommendation request receiving operation H1 has been performed, the online system according to one embodiment of the present disclosure may perform a request state recognition operation H2 to identify the request state in which the user is currently requesting a recommendation. The request state recognition operation H2 may identify an input value input to the recommendation algorithm T. The input value may include schedule information and weather information that may be received via external terminal 400 or server 600.

[319] In addition, the input value may include BI information about the body of a given user, which may be obtained through the imaging unit 220 or extended memory 240. The BI body information may be used to identify a given user among a plurality of users.

[320] The input value may include the particular clothing currently worn by the particular user. Additional information such as information about the nature and background information of the place the user is to travel to and information about the companion may optionally be included in the input value.

[321] An online system in accordance with one embodiment of the present disclosure may input an input value to the recommendation block 250 and execute the recommendation algorithm T and obtain the corresponding clothing.

[322] The stored clothes matching block 251 may first input the stored clothes information AI into the recommendation algorithm T and output the recommended clothes Z1, and the matching level determining block 253 can calculate the matching level of the recommended clothes Z1. When the matching level is greater than or equal to the reference value, the recommended clothing Z1 may be passed to the extended computing unit 230.

[323] In one example, when the matching level of the recommended clothing Z1 is below the reference value, the purchase target clothing matching block 252 may input the purchase target clothing C into the recommendation algorithm T and output the recommended clothing Z2. Then, the matching level Z2 of the recommended clothing can be calculated by the matching level determination block 253 . When the matching level is greater than or equal to the reference value, the recommended clothing Z2 may be passed to the extended computing unit.

[324] When the advanced computing unit 230 obtains the recommended clothing, the clothing combining unit 237 of the advanced computing unit 230 can display the recommended clothing A on the body image B of the user and output the display result to the virtual output interface 210. Thus, the user can identify the state in which the clothes are actually worn by the wearer, via the virtual output interface 210.

[325] In one example, the optional recommendation block 254 may check if the compliance level is further increased when additional accessories, etc., are combined with recommended clothing Z1 and Z2.

[326] Accessory A4 can be included in either stored clothing A or target clothing C purchase. The additional recommender 254 may pass the accessory Z3, which has an increased match level with the recommended clothing, to the advanced computing unit 230. The additional combiner 238 may further combine the recommended accessory Z3 with the screen image.

[327] The online system according to one embodiment of the present disclosure may perform a determination correction operation H4 to display the combined image on the virtual output interface 210 and determine user satisfaction.

[328] In determination correction operation H4, upon receiving an indication that the user is satisfied with the recommended clothing Z1 and Z2 through the refresh-related input interface 150 or external terminal 400, the recommender 250 may recommend the recommended clothing in a similar manner next time.

[329] However, after receiving an indication that the user requests additional clothing or finally confirms the recommended clothing based on the result of the comparison through the refresh-related input interface 150 or external terminal 400, the recommender 250 may recommend the clothing such that the selection or user preference was considered in the following recommendation.

[330] When the recommended clothing Z2 is present in the purchase target clothing information C, the online system according to one embodiment of the present disclosure may perform a purchase verification operation H5 to determine whether the user wishes to purchase the recommended clothing Z2. The purchase verification operation H5 may include notifying that a purchase is needed and asking whether the purchase should be made through the virtual exit interface 210.

[331] The user may request to make a purchase through the refresh-related input interface 150 or the external terminal 400. The online system in accordance with one embodiment of the present disclosure may perform a payment operation H6 to track the seller of the recommended clothing Z2 and make the purchase based on the FI information. about payment.

[332] FIG. 14 shows one embodiment in which the clothing recommendation method is performed by the online system according to one embodiment of the present disclosure.

[333] The specific user I may issue a voice command to the garment processing device 100. The voice command could be “Recommend clothes for today”. The microphone 152 of the garment processing apparatus 100 can receive a voice command. The garment processing device 100 may receive the voice command and transmit the command to the refresh-related main controller 180 or the server 600 to interpret the voice command, thereby performing the recommendation request receiving operation H1.

[334] The garment processing device 100 may receive weather information, schedule information, etc., via the server 600 or the external terminal 400, and may perform a request state recognition operation H2 to identify a user requesting a recommendation.

[335] The garment processing apparatus 100 may perform a garment recommending operation H3 in which the recommender 250 recommends a recommended garment Z suitable for a particular user requesting a recommendation using a database containing stored garment A and purchase target garment C stored in an extended storage device 240.

[336] The garment processing device 100 may display the recommended garment Z on the virtual output interface 210 as it is. The garment processing device 100 may display a list of recommended garments Z on the virtual output interface 21. For example, the list may include the type, price, brand, and shape of the recommended top A2, bottom A3, and accessory A4.

[337] Recommended clothing Z can be displayed on the user's image. However, the extended computing unit 230 may combine the recommended clothing Z itself with the virtual user profile, or only output a photo or image of the recommended clothing Z to the virtual output interface 21.

[338] The garment processing apparatus 100 may perform a purchase verification operation H5 to notify that the scarf A4 is to be purchased when the scarf A4 is the purchase target garment C.

[339] Thus, the user can determine suitable clothes for a given condition without having to directly select suitable clothes or remember all the clothes he has, and can determine which clothes to purchase. In addition, the user can improve fashion perception or fashion knowledge by identifying suitable clothing combinations.

[340] Fig. 15 shows one embodiment of payment execution operation H6

[341] The garment processing device 100 may receive a voice command such as “Buy a scarf” as a request to purchase a garment that the user does not own, such as an A4 scarf. When the garment processing device 100 receives a voice command, the device interprets the voice command through the refresh-related main controller 180 or the server 600.

[342] The clothing processing apparatus 100 may receive a search result of a plurality of merchants selling a scarf through the server 600. The plurality of merchants may sell a scarf online or offline, and may upload scarf price information, etc., to their online website. . The information may be collected by the server 600, which in turn may provide the information to the garment processing device 100.

[343] The garment processing device 100 may display information collected by the merchant on the virtual output interface 210. If there are multiple merchants, the virtual output interface 210 may display a location map or an online site and the asking price information of the plurality of merchants. This allows the user to select a seller with good availability or a low price.

[344] The payment information F may be stored in the extended memory 240 of the garment processing device 100 . The server 600 may have access to an online sales site provided by the merchant. Therefore, the garment processing device 100 can purchase the scarf immediately upon receipt of the user's final purchase request, and the merchant can proceed to deliver it to the delivery address specified by the user. The delivery address may be stored in extended storage 240. Alternatively, the user may enter the delivery address through refresh-related input interface 150 or external terminal 400.

[345] FIG. 16 shows another embodiment in which the clothing recommendation method is performed by the online system according to one embodiment of the present disclosure.

[346] As shown in FIG. 16(a), in operation H1 of receiving a recommendation request, a specific user may send a request command requesting a clothing recommendation in a state in which the user is wearing at least some clothing. For example, in a state in which a user wears A37 beige viscose tennis skirt, A32 three-quarter black pants, and A27 underwear, a particular user can send a query command requesting a recommendation for a blouse corresponding to A37 tennis skirt.

[347] The request command may include a specific voice command, and may include a move command for the user to grip the tennis skirt A37. The motion command can be recognized by the motion recognition camera 222 of the imaging unit 220 .

[348] As shown in FIG. 16(b), the fitting unit 200 may perform a request state recognition operation H2 for an image of a specific user state with the imaging unit 220 . Based on the image obtained by the imaging unit 220, the extended computing unit 230 can recognize the body condition of the user B and the clothes of the user A.

[349] The imaging unit 220 may display the user's state and display it on the virtual output interface 210. The user's body image 213 and the clothes A28 and A37 worn by the user may be displayed on the virtual output interface 210.

[350] In one example, extended recognition unit 230 may consider that the user has specified “skirt A37”, and thus may display a three-quarter-length image without black trousers A32 on virtual output interface 210.

[351] Extended computing unit 230 may input viscose tennis skirt A37 as input to recommendation unit 250 in accordance with the considered query command, but may exclude black three-quarter trousers A32 and underwear A27 from the input value. Thus, even when a user is wearing non-recommended clothing, the online system according to one embodiment of the present disclosure excludes clothing that the user does not intend to wear and can only recommend suitable clothing for the specific clothing intended.

[352] As shown in FIG. 16(c), in the clothing recommendation operation H3, the recommendation unit 250 may input a specific user's schedule, weather information, preference, stored clothing information AI, body information BI, style, target information CI. purchase clothes and tennis skirt A37 to the recommendation program T and thus can recommend the pink blouse A212 as a suitable recommended clothing Z. The extended computing unit 230 can display the actual recommended clothing size Z on the user's body image 213. The resulting image can be displayed on the virtual output interface 210 as it is.

[353] Then, the user may request a recommendation of another garment or request a comparison, and thus the system may perform the determination correction operation H4.

[354] FIG. 17 shows another embodiment in which the clothing recommendation method is performed by the online system according to one embodiment of the present disclosure.

[355] As shown in FIG. 17(a), the recommendation request receiving operation H1 can be performed by the clothing processing apparatus 100 recognizing the user's voice command “Recommend clothes”. The garment processing apparatus 100 may perform the request state recognition operation H2 by image of a particular user with the imaging unit 220 .

[356] The extended computing unit 230 may perform the clothing recommendation operation H3 to calculate the clothing Z1 suitable for the user using the recommendation unit 250 and the extended memory 240, and display the state in which the user is fully wearing the recommended clothing Z1 on the actual image. 214 of the user and display the resulting image on the virtual output interface 210.

[357] Even when a specific user is in a state of wearing completely inappropriate clothing such as pajamas, the extended computing unit 230 may display the state in which the user is fully wearing the recommended clothing Z1 to the image of the user 213, and may display the resulting image on the virtual output interface 210 .

[358] As shown in FIG. 17(b), the system may perform the determination correction operation H4 while the user changes his location. For example, when the system has performed an operation H1 of receiving a recommendation request at a given location P1 of the user, the user may change that location to P2. P2 may be a position next to P1.

[359] For example, the area in front of the virtual output interface 210 and the corresponding area of the virtual output interface 210 may be divided into P1 and P2. When the user changes his location between P1 and P2, the extended computing unit may associate the change with an instruction to perform a determination correction operation.

[360] In addition, the position camera 222 can determine whether the changed position of the user is within a predetermined range. When the enhanced computing unit 230 recognizes that the user's location has changed such that the location is outside the predetermined range, the enhanced computing unit 230 may interpret the location change as a comparison command requesting that clothing other than the given recommended clothing Z1 should be recommended. In another example, the compare command may be a direct voice command, such as "Compare", from the user.

[361] Upon receipt of the comparison command, the recommendation block 250 may recommend a recommended clothing Z2 that is different from the recommended clothing Z1. The extended computing unit 230 may map other recommended clothing Z2 to the user's image and display the resulting image on the virtual output interface 210.

[362] In the determination correction operation H4, the extended computing unit 230 may simultaneously display the first recommended garment Z1 and the subsequent recommended garment Z2 on the virtual output interface 210.

[363] Accordingly, the user can select suitable clothes for themselves when comparing the recommended set of clothes. In addition, the user's choice may be considered as a preference input to recommendation block 250 and may influence the output value that will be recommended later.

[364] FIG. 18 shows another embodiment in which the clothing recommendation method is performed by the online system according to one embodiment of the present disclosure.

[365] FIG. 18(a) shows that recommendation request receiving operation H1 - clothing recommendation operation H3 is being performed.

[366] As shown in FIG. 18(b), in determination correction operation H4, a user may send a query to determine whether the recommended clothing matches another user E. When the online system according to one embodiment of the present disclosure receives the determination request , the system may display a combination of recommended clothing Z1 and another person E on the virtual output interface 210 based on the other person information EI stored in the extended storage 240.

[367] This allows the user to determine if the other person E matches the recommended clothing Z1. The other person information EI can be displayed by the image forming unit 220, and then can be registered in the extended storage device 250. General photos as other person information EI registered in the external terminal 400 or the server 600 can be transmitted to the extended storage device 250 and stored therein.

[368] As shown in FIG. 18(c), in an additional request receiving operation H1, a plurality of users may request clothing recommendations together. The extended computing unit 230 may query the recommender 250 to recommend the same clothes when the contours of multiple users are recognized from the image obtained by the imaging unit 220 . The recommendation block 250 may input information about the plurality of users into the recommendation algorithm T to output the same clothes Z1 and Z2.

[369] The extended computing unit 230 can display the same clothes Z1 and Z2 on images of multiple users, and display the transmitted image on the virtual output interface 210.

[370] Accordingly, the online system in accordance with one embodiment of the present disclosure may recommend clothing for multiple users at the same time, or may allow a particular user to recommend clothing suitable for another user.

[371] FIG. 19 shows another embodiment in which the clothing recommendation method is performed by the online system according to one embodiment of the present disclosure.

[372] An online system according to one embodiment of the present disclosure may simultaneously recommend a plurality of clothes and display all of them on the virtual output interface 210 in a clothes recommendation operation H3, and may allow the user to directly select one of the plurality of clothes in a determination correction operation H4.

[373] As shown in FIG. 19(a), the user may request a recommendation for accessory A4. An online system according to one embodiment of the present disclosure may recommend a plurality of scarves among the A4 accessories and display them on the display panel 211.

[374] The first scarf A41 with the highest matching level among the plurality of scarves can be displayed on the user image 213, and the transmitted image can be displayed on the virtual output interface 210. The second scarf A42 and the third scarf A43 with relatively lower matching levels can be displayed separately from the user image 213 on the display panel 211. In another example, a plurality of scarves may be displayed substantially on the display panel 211 without being displayed on the user image 213.

[375] The motion detection unit 223 of the imaging unit 220 may be configured to recognize the movement of the user's HP finger.

[376] As shown in Fig. 19(b), the user can move his HP finger in the air. The motion recognition unit 223 can recognize this motion. The extended computing unit 230 may move the plurality of scarves displayed on the virtual output interface 210 while moving.

[377] For example, the first scarf A41 transferred to the user image may be separated from the user image 213. The third scarf A43 can be transferred to the user image 213 .

[378] The user may repeat the above process to determine the desired scarf among the plurality of scarves.

[379] FIGS. 20-22 show another embodiment of the virtual fitting unit 200 of the online system in accordance with the present disclosure.

[380] As described above, the on-line system fitting unit 200 according to one embodiment of the present disclosure may store the user body information BI obtained by the imaging unit 220 in the extended computing unit 230 and the extended memory 240.

[381] In one example, the BI information about the user's body may change over time. For example, when the user is exercising or frequently overeating, body volume may increase. When the user is on a diet, body volume may decrease. The fitting unit 200 needs to update the body information BI when the user's body information BI is frequently displayed by the imaging unit 220 .

[382] Accordingly, the fitting unit 200 may provide a service for notifying a user of a change in body information BI. The fitting unit 200 may notify the user of a general change in body information BI with a 3D image. The modification of a specific body part can be directed to the user in 3D mode.

[383] In addition, the fitting unit 200 can quantify the change in the body information BI with the extended computing unit 230. The fitting unit 200 can compare the stored clothing information AI and the purchase target clothing information CI in the extended memory 240 with the BI information about body of the user, and can notify the user of what clothes the user can wear and what clothes the user cannot wear based on the body change.

[384] Accordingly, the user can intuitively observe changes in his body, as well as recognize changes in wearable and non-wearable clothing.

[385] An online system according to one embodiment of the present disclosure may perform a scan request receive operation I1 to receive a scan command requesting a scan of his body from a user.

[386] In operation I1 of receiving a scan request, the user may register his body information in the fitting unit 200, and may request that the body information be changed in the garment processing apparatus 100.

[387] The online system in accordance with one embodiment of the present disclosure may perform a scan direction operation I2 to display the requirements required to scan the user's body on the virtual output interface 210. The scan direction operation I2 may include displaying a guide line 214 on a display panel. 211 or issuing a guiding voice from loudspeaker 212.

[388] When the user's response is performed in accordance with the scan direction operation I2, the online system in accordance with one embodiment of the present disclosure may perform the imaging operation I3 to generate an image of the user's body with the imaging unit 220.

[389] In the imaging operation I3, the extended computing unit 230 may extract the contour of the user's body and calculate the volume of the user's body.

[390] An online system according to one embodiment of the present disclosure may perform a completion determination operation I4 to check whether the image contains sufficient body information. When an additional image is required, the scan direction operation I2 may be repeated.

[391] When the acquisition of the body information BI is completed, the online system according to one embodiment of the present disclosure may perform the operation I5 of presenting the scan result to display a 3D user profile image or a user body image on the virtual output interface 210.

[392] The online system according to one embodiment of the present disclosure can compare the present body information BI with the previous body information BI, and check the wearable and non-wearable clothing in the stored clothing information A based on the result of the comparison. This operation may be referred to as operation 16 of checking stored clothing.

[393] In operation I6 of checking the stored clothing, a list of clothes that may or may not be worn by the user in the stored clothing information AI may be displayed on the virtual output interface 210 or the external terminal 400. In addition, in operation I6 of checking the stored clothing, clothing that may or may not be worn by the user in the stored clothing information AI may be displayed on the virtual output interface 210.

[394] The online system according to one embodiment of the present disclosure can compare the current body information BI with the previous body information BI and check the wearable and non-wearable clothing in the purchase target clothing information CI. This operation may be referred to as operation 17 of checking other clothes.

[395] In operation I7 of checking other clothing, a list of wearable and non-wearable clothing in the purchase target clothing information CI may be displayed on the virtual output interface 210 or the external terminal 400.

[396] In addition, in operation 17 of checking other clothes that can be worn by the user and clothes that cannot be worn by the user, target clothing information CI can be displayed on the virtual output interface 210.

[397] The online system according to one embodiment of the present disclosure may perform a comparison operation 18 to compare the previous body information BI and the current body information BI with each other.

[398] In the comparison operation 18, the previous body image or user profile and the current body image or user profile can be displayed on the virtual output interface 210 so that the amount of change in the body image or user profile can be indicated numerically.

[399] FIG. 21 shows one embodiment in which the process described in FIG. 20 is performed.

[400] As shown in FIG. 21(a), the user can speak the voice command “Scan my body” or enter a command into the refresh-related input interface 150 while standing in front of the garment treatment apparatus 100 to perform the scan request receiving operation I1.

[401] In response, the garment processing device 100 may display the guide line 214 on the display panel 211, and may use the speaker 212 to guide the user's location or movement. This operation may be referred to as a scanning direction operation 12 . When the user assumes an appropriate posture or movement, the garment processing apparatus 100 may perform an imaging operation I3 to form an image of the user's body.

[402] For example, the front guide line 214a for forming an image of the front of the user may be displayed on the display panel 211. The guide words "Please look at the front and stand in alignment with the line" may be output from the speaker 212. The body may be displayed when the body the user is in the area formed in the guide line 214a at a specific percentage. The specific percentage may be higher than 70%, for example.

[403] The garment processing device 100 can display the front of the wearer with the imaging unit 220 .

[404] As shown in FIG. 21(b), the display panel 211 may display a side guide line 214b to form an image of the user's side thereon. The guide words "Please turn to your side and stand to align with the line" may be given out by the speaker 212. The garment processing apparatus 100 may display the side of the user with the imaging unit 220.

[405] In one example, advanced computing unit 230 may determine that an image of the back of the user is needed to complete information about the user's body.

[406] As shown in FIG. 21(c), the display panel 211 may display the rear guide line 214c to display the back of the user thereon. The guide words "Please turn back and stand to align with the line" may be given out by the speaker 212. The garment processing apparatus 100 may display the back of the user with the imaging unit 220.

[407] As shown in FIG. 21(d), the extended computing unit 230 may extract the contour of the user's body from each of the images via the contour evaluation unit 231. The volume measuring unit 232 can then calculate the actual contour volume.

[408] Enhanced computing unit 230 may obtain BI information about the user's body based on the calculated value. The body BI information can match the 3D profile.

[409] The enhanced computing unit 230 may output a user image as a user profile S to the virtual output interface 210 based on the body information BI.

[410] The user profile S can be rotated and output to the virtual output interface 210, and can be divided into a front user profile S2 and a side user profile S1.

[411] Thereafter, the extended computing unit 230 may use the comparison recognition unit 236 to simultaneously analyze the stored clothing information AI and purchase target clothing information CI, and may calculate a list of wearable and non-wearable clothing based on the analysis result.

[412] The virtual output interface 210 may display a list. The list may include a specific identification number and brand of clothing. For example, the virtual output interface 210 may indicate that the user's body volume has decreased by 10% such that the user can wear A31 and A22 but cannot wear A32 and A23. In addition, the virtual output interface 210 may indicate that brand Q clothing is smaller than other brand clothing that the wearer may be wearing.

[413] As shown in FIG. 22, the user can actively send a comparison command to the garment processing device 100 to request a comparison between current and previous body information. When the garment processing device 100 has received the comparison command, the previous user profile Sb based on the previous body information and the current user profile SA based on the current body information may be displayed on the virtual output interface 210. In addition, the virtual output interface 210 may also display the amount of body change. For example, when the user's body volume has been reduced by 10%, words may be output indicating that the body volume has been reduced by 10%.

[414] Thus, the user can intuitively observe the change in his body and can check characteristics such as exercise, overeating problems, and the importance of posture.

[415] The above-described control method can be applied even when a plurality of users use the online system. That is, the online system can distinguish and store body information of a plurality of users in the process of acquiring body information of users. In addition, when a specific user among the plurality of users requests one of clothing registration, recommendation, and body scan, the online system can recognize the specific user and can perform clothing registration, clothing recommendation, and body scan corresponding to the specific user.

[416] Thus, a plurality of users can use a single online system to obtain a service including clothing registration, clothing recommendation, and body scanning individually without confusion.

[417] The present disclosure may be modified and implemented in various forms, and thus, the scope of rights thereto is not limited to the above embodiment. Therefore, when a modified embodiment includes elements of a claim, the modified embodiment should be considered as falling within the scope of the present disclosure.

Claims (77)

1. A clothing registration device, comprising: a housing forming the appearance of the device; an imaging unit located in the body for imaging an external object; a computing unit configured to analyze the image captured by the imaging unit; a storage device for storing an image captured by the imaging unit or an analysis result from the computing unit; And an input interface for receiving a command to form an image and store clothes, moreover, when the input interface has received the command, the computing unit is configured to accurately determine the clothes in the captured image and extract information about the clothes from the precisely defined clothes, as well as store the information about the clothes in a memory device, wherein the storage device stores the background displayed by the imaging unit and information about the body of a specific user having clothes, and wherein the computing unit is configured to: comparing the combination image of the particular user and clothing with the background stored in the storage device, and extracting the appearance of the particular user based on the result of the comparison; And comparing the body information stored in the storage device with the appearance of a particular user, and extracting clothes based on the result of the comparison. 2. The device of claim 1, wherein the clothing information includes at least one of the shape, material, and color of the well-defined clothing. 3. The apparatus of claim 2, wherein the computing unit is configured to retrieve clothing information regarding clothing worn by a particular wearer and store the clothing information in a storage device. 4. The device according to claim 2, in which the computing unit is configured to: recognizing a dividing line from the removed garment or using a server to recognize the upper garment, upper portion, and lower portion, and separating the upper garment, upper portion, and lower portion from each other; And individually retrieving clothing information regarding at least one of the outer garment, the upper portion, or the lower portion; and storing the retrieved garment information in a storage device. 5. The apparatus of claim 2, wherein the computing unit is configured to retrieve clothing information regarding clothing held by a particular wearer and store the retrieved information in a memory device. 6. The apparatus of claim 1, wherein the input interface includes a button located on the body and a voice recognition unit configured to recognize a specific user's voice command. 7. The device according to claim 1, in which the device further comprises a display located on the housing for displaying an image captured by the imaging unit, or an image transmitted from the computing unit, where the display shows: a guide line for guiding a specific user such that the computing unit recognizes the clothing; And guide sign to guide a specific user to rotate through a range of 360 degrees. 8. A clothing recommendation device, comprising: a housing forming the appearance of the device; an input interface located in the body for receiving a recommendation command requesting a clothing recommendation; an imaging unit disposed on the body for displaying clothing and/or movement of a particular user; And a computing unit configured to analyze the clothing and/or movement of a particular user; a recommendation unit, configured to determine the clothes to be recommended based on the analysis result from the computing unit when the input interface received the recommendation command; And a display for displaying the clothes specified for recommendation by the recommendation unit on it, wherein the recommender block is configured to recommend specific clothing from a plurality of clothing including stored clothing owned by a specific user based on clothing and/or movement, and wherein the computing unit is configured to recognize clothing selected by the user in response to at least one of the recommendation or motion command. 9. The device of claim 8, wherein the device further comprises: a storage device for storing clothing information therein regarding the stored clothing and providing the clothing information to the recommendation unit; And a communication module, configured to transmit information about the purchase target clothing regarding the purchase target clothing that a specific user can buy in the recommendation block. 10. The apparatus of claim 9, wherein when the clothing recommended by the recommendation unit includes the purchase target clothing, the computing unit is configured to display information about the purchase target clothing on the display. 11. The device according to claim 10, wherein the storage device further stores payment information used to purchase a specific user of the target clothes of the purchase, wherein when the input interface has received a purchase command from a particular user, the communication module is configured to transmit the purchase command and payment information to the server or merchant of the purchase target clothing. 12. A clothing recommendation device, comprising: a housing forming the appearance of the device; an input interface located on the body for receiving a recommendation command requesting a clothing recommendation; a recommendation unit configured to determine clothes to be recommended among the plurality of clothes when the input interface has received the command; a display for displaying clothes determined to be recommended by the recommendation unit on it; And a motion recognition unit configured to recognize the motion of a specific user, moreover, the recommendation block is configured to recommend a plurality of clothes at the same time, moreover, the display is configured to display a plurality of clothes sequentially or simultaneously, wherein, when the motion recognition unit detects the movement of a specific user, the display is configured to display the changed clothing among the plurality of clothing recommended by the recommendation unit. 13. The apparatus of claim 12, wherein when the motion detection unit detects the movement of a particular user, the display is configured to change the position in which the particular garment is displayed among the plurality of garments. 14. A clothing recommendation device, comprising: a housing forming the appearance of the device; an input interface located on the body for receiving a recommendation command requesting a clothing recommendation; a recommendation unit configured to determine clothes to be recommended among the plurality of clothes when the input interface has received the command; an imaging unit located on the body and configured to image a specific user; a computing unit configured to render the clothing recommended by the recommendation unit onto an image of a particular user; And a display for displaying the rendered image thereon; moreover, the input interface is configured to receive a comparison command to instruct the computing unit to compare the rendered image with another image to obtain a comparison result, moreover, when the input interface has received the comparison command, the computing unit is configured to display the result of the comparison on the display. 15. The apparatus of claim 14, wherein the comparison command includes an additional command for recommending clothing other than the recommended clothing, or a specific motion for instructing the display to change the position or area in which the recommended clothing is displayed. 16. The apparatus of claim 15, wherein the computing unit is configured to render each of the first clothing first recommended by the recommendation unit and the second clothing further recommended by the recommendation unit onto an image of a specific user and display each of the first and second rendered images on a display . 17. The apparatus of claim 14, wherein the comparison command includes a command for requesting a comparison between a particular user's image and another user's image, moreover, the computing unit is configured to display both the rendered image of a specific user and the image of another user on the display. 18. The apparatus of claim 14, wherein the comparison command includes a request to change the background of the rendered image, moreover, the computing unit is configured to change the background displayed on the display. 19. Household device, containing: a housing forming the appearance of the device; an input interface located on the body for receiving a scanning command to measure the body shape of a specific user; an imaging unit located on the body and configured to display a specific user; a computing unit configured to calculate the body shape of a particular user based on the image captured by the imaging unit; a display configured to model and display the body shape of a particular user as calculated by the computing unit; And a storage device configured to store previous information about the shape of the body of a particular user, wherein the display is configured to model and display a particular user's body shape as computed by the computing unit and a previous body shape of the particular user, or to display a difference between the particular user's body shape as computed by the computing unit and their previous body shape. 20. The home appliance of claim 19, wherein the display displays a guide line to guide a particular user to turn or change their posture. 21. The home appliance of claim 19, wherein the storage device stores clothing information regarding stored clothing owned by a particular user, wherein the computing unit is configured to: determining the first clothes that the user can wear and the second clothes that the user cannot wear among the stored clothes, based on the difference; displaying the first and second clothes on the display. 22. The home appliance according to claim 19, wherein the device further comprises a communication module configured to transmit to the computing unit information about the purchase target clothing regarding the purchase target clothing that a particular user can wear, wherein the computing unit is configured to display the brand or type of the target clothing of purchase corresponding to the body type on the display.

Images