KR20140123228A - Apparatus and Method for providing three dimensional model which puts on clothes based on depth information - Google Patents

Abstract

According to an embodiment of the present invention, a method for providing a three-dimensional model which wears clothes based on depth information can quickly create an accurate three-dimensional model that resembles a user′s body by creating the three-dimensional model by using a plurality of standard body data and the user′s height and waist size. Accordingly, the user can quickly check an image in which the three-dimensional model wears clothes instead of the user, thereby improving user convenience. In addition, an interface of a display unit to induce user input and recommend a selection is configured to provide the user with convenient and more information, thereby improving operability and convenience of the user.

Description

TECHNICAL FIELD [0001] The present invention relates to an apparatus and a method for providing a three-dimensional garment wearing model based on depth information,

The embodiments of the present invention relate to a method and apparatus for providing a three-dimensional garment wearing model based on depth information, and more particularly, to a three-dimensional model of a wearer wearing a garment, And more particularly, to a method and apparatus for providing a three-dimensional garment wearing model for more accurate and quick generation.

With the development of technology, a technique of simulating a user's body to be displayed on a display device and displaying a user's avatar in real time has been developed in recent years. These technologies are mainly applied to general retailing such as department store or clothing store. When a consumer buys clothes offline, he or she can try to dress directly because it can not satisfy the expectation by looking. In this case, it can take a long time and inconvenience. In this case, the consumer can improve the convenience of the user by wearing clothes virtually through their avatars without wearing clothes. Such a technique is called a so-called magic mirror system, and has the function of allowing the user to wear his or her desired clothes virtually by appearing on the display device in a mirror-like manner.

However, this conventional technique takes a considerably long time to scan with a camera in order to create a consumer avatar. For example, an avatar can be created only when a consumer's body is photographed. The consumer's body must be photographed at multiple angles, and processing time for generating an avatar after taking a picture is considerably long. If this takes a long time, the need to use these techniques can be reduced because consumers are actually close to the time they wear their clothes. In addition, it is difficult for the prior art to generate an avatar of the exact size and the body of the consumer. For example, when a consumer wears a thick clothes, the camera generates an avatar by judging only the appearance of the user, so that it is impossible to know exactly what the user's body shape is. Therefore, the avatar body shape is completely different from the body shape of the consumer Lt; / RTI > In this case, avatars do not match consumers, which reduces the usefulness of these technologies.

Therefore, in order to solve the above-mentioned problems, an embodiment of the present invention generates accurate body shape of a user based on data on typical body shape of a general person, It is aimed to create a three-dimensional model of a fast user.

Dimensional model of such a user quickly and accurately, thereby improving the accuracy, convenience, and promptness of the magic mirror system.

Other objects and features of the present invention will be described in the following detailed description and claims.

According to an aspect of the present invention, there is provided a method of providing a three-dimensional garment wearing model based on depth information according to an embodiment of the present invention includes extracting depth information of a user's body through a depth camera, Measuring the length of each part of the body; Generating a three-dimensional body model of the user with reference to a plurality of standard body data stored in a database based on at least one of the measured key length and the waist circumference of the user; Recognizing the operation of the user so that the three-dimensional body model of the user moves corresponding to the movement of the user; Selecting a costume from the user and applying the selected costume to the user's three-dimensional body model; And displaying the three-dimensional body model of the user to which the selected costume is applied to move according to an operation of the user; Wherein the plurality of standard body data are classified and stored based on at least one of the lengths of the respective parts of the body in the database.

The method may further include receiving a user profile including sex and age before measuring the length of each part of the body.

In addition, the step of generating the three-dimensional body model of the user is characterized by selecting a plurality of standard body data for creating the three-dimensional body model of the user in the database with reference to the user profile.

In addition, the step of measuring the length of each part of the body may include: measuring a straight line length of each part of the user's body including a height, an arm length, a leg length and a width of each part; The circumference length of each part of the user's body including the waist circumference length, the chest circumference length, the thigh circumference length, the calf circumference length, and the arm circumference length is measured.

The step of measuring the length of each part of the body measures a straight line length of each part of the user's body from the depth information of the frontal standing image of the user, The circumference length of each part of the user's body is measured from the depth information of the user.

In addition, the step of generating the three-dimensional body model of the user may include: determining respective weights for each of the standard body data based on at least one of the key and the waist circumference of the user; Applying a weight corresponding to each of the standard body data; And generating the three-dimensional body model of the user by linearly summing the standard body data to which the weight is applied.

Further, the method may further include modifying the three-dimensional body model based on the length of each part of the user's body that is not used in generating the three-dimensional body model, after the step of generating the three-dimensional body model of the user .

The step of modifying the three-dimensional body model may include measuring a user's obesity rate through a ratio of the measured user's key to the waist circumference length; And modifying the thickness of each part of the body in the generated three-dimensional body model through the measured obesity rate.

In addition, the step of displaying the user's three-dimensional body model to which the selected costume is applied to move according to the motion of the user may include displaying the selected costume to move corresponding to the movement of the user's three- .

In addition, after displaying the user's three-dimensional body model, as the costume and other costumes applied on the three-dimensional body model are selected by the user, the selected other costume is applied to the three-dimensional body model The method comprising the steps of:

According to another aspect of the present invention, there is provided an apparatus for providing a three-dimensional dressing model based on depth information, comprising: a body measurement unit for extracting depth information of a user's body and measuring lengths of respective parts of the user's body; A database for storing a plurality of standard body data classified on the basis of at least one of lengths of respective parts of the body; A three-dimensional body modeling unit for providing the three-dimensional body model of the user with reference to the plurality of standard body data based on at least one of the measured lengths of the user's keys and the waist circumference; An operation recognizing unit recognizing an operation of the user so that the three-dimensional body model of the user moves corresponding to the movement of the user; An input unit for receiving clothes to be applied to the user's three-dimensional body model from the user; And a display unit for displaying the 3D body model to which the input costume is applied to operate according to the movement of the user. And a control unit.

In addition, the body measurement unit may include a straight line length of each part of the user's body including a key, an arm length, a leg length, and a width of each part; The circumference length of each part of the user's body including the waist circumference length, the chest circumference length, the thigh circumference length, the calf circumference length, and the arm circumference length is measured.

The body measurement unit may include a depth camera for photographing a body of the user and extracting depth information; A straight line length measuring unit for measuring a straight line length of each part of the user's body from the depth information of the front view of the user; And a circumferential length measuring unit for measuring a circumferential length of each part of the user's body from the depth information of the front and side standing images of the user; And a control unit.

In addition, the input unit receives a user profile including sex and age before receiving the clothes from the user.

In addition, the three-dimensional body model provider may select a plurality of standard body data for creating the three-dimensional body model of the user in the database with reference to the user profile.

The three-dimensional body model providing unit may include a three-dimensional body model generating unit for generating the three-dimensional body model of the user by referring to the plurality of standard body data based on the user's key and waist circumference length; And a three-dimensional body model modifying unit that modifies the three-dimensional body model based on a length of each part of the user's body that is not used in generating the three-dimensional body model.

The three-dimensional body model generation unit may determine a weight for each of the standard body data based on at least one of a key and a waist circumference of the user and apply the weight corresponding to each standard body data And the three-dimensional body model of the user is generated by linearly summing the standard body data to which the weight is applied.

The three-dimensional body model modifying unit may measure the obesity rate of the user through a ratio of the measured user's key to the waist circumference length, and may display the user's body mass in the generated three-dimensional body model through the measured obesity rate And the thickness of each part of the body is corrected.

Further, the display unit is characterized in that the selected clothes are displayed so as to move corresponding to the movement of the three-dimensional body model of the user.

In addition, as the costume and other costumes applied to the three-dimensional body model are input to the input unit by the user, the display unit applies the other costume to the three-dimensional body model for display.

At least one embodiment of the present invention configured as described above generates a three-dimensional model using a plurality of standard body data and a user's key and waist circumference length, so that it is possible to quickly generate a three- have. Accordingly, the user can quickly confirm the image of the costume worn over the three-dimensional model, thereby improving the convenience of the user. In addition, since the interface of the display unit for inducing user input and soliciting selection is configured to be convenient for the user and to provide a large amount of information, convenience for the user can be improved.

1 is a structural view of an apparatus for providing a three-dimensional garment wearing model based on depth information according to an embodiment of the present invention.
2A to 2D are schematic views illustrating an embodiment for measuring a straight line length of each part of a body according to an embodiment of the present invention.
FIGS. 3A through 3C are schematic views illustrating an embodiment for measuring the circumferential length of each part of the body according to an embodiment of the present invention. FIG.
4 is a schematic diagram illustrating nine standard three-dimensional body models stored in a database in accordance with one embodiment of the present invention.
FIG. 5 is a table showing the obesity rate measured according to the ratio of the key / waist circumference according to an embodiment of the present invention.
Figure 6 is an illustration of a three-dimensional body model corresponding to each obesity index according to one embodiment of the present invention.
7A and 7B are three-dimensional body models wearing simulated garments according to an embodiment of the present invention.
8 is a flowchart of a method of providing a 3D garment model based on depth information according to an embodiment of the present invention.
9 is a structural view of a display unit according to an embodiment of the present invention.

Hereinafter, a method and apparatus for providing a three-dimensional garment wearing model based on depth information according to an embodiment of the present invention will be described in detail with reference to the drawings.

In the present specification, the same or similar reference numerals are given to different embodiments in the same or similar configurations. In addition, it should be considered that the components of the drawings attached hereto can be enlarged or reduced for convenience of explanation.

Referring to FIG. 1, an apparatus 100 according to an embodiment of the present invention includes an input unit 100, a body measurement unit 120, a database 130, a three-dimensional body model providing unit 140, 150, a clothes simulation unit 160, and a display unit 170.

The input unit 110 is a configuration for selecting clothes or inputting a user profile. The input unit 110 may be configured in the form of a keypad, a keyboard, a mouse, a microphone, or the like. Preferably, the input unit 110 may be a touch screen. In this case, the input unit 110 and the display unit 170 have the same configuration. When the input unit 110 is a touch screen, the user profile input condition 161 and the garment type 163 can be displayed. The user profile input condition 161 may include information on gender and age, and the kind of clothes 163 includes all the clothes in the screen of the input unit 110, It is displayed as a two-dimensional model. At this time, the user can input his / her own profile through the input unit 110, and can select and input the clothes he / she wants to wear.

The body measuring unit 120 measures the length of each part of the user's body and includes a depth camera 121, a linear-length measuring unit 122, and a circumferential-length measuring unit 123.

The depth camera 121 photographs a specific object using an infrared sensor and acquires depth information in real time on the photographed object. In one embodiment of the present invention, the depth camera 121 is used to capture the user's body and extract depth information of the user's body therefrom. The depth camera 121 extracts depth information from a front or a side view of the user and provides depth information to a body measurement unit 120, which will be described later. Therefore, the user must stand in front of the depth camera 121 when photographing the depth camera 121, or photograph the depth camera 121 while standing side by side.

The straight-line-length measuring unit 122 measures the straight-line length of each part of the body through the depth information of the user's frontal granularity, and measures, for example, the leg-length, arm-length, height and width of the body.

The straightness measuring unit 122 first detects the edge of the user's body through an outline extraction algorithm. Referring to FIG. 2A, a body of a user to which an outline extraction algorithm is applied is shown. If the outline extraction algorithm is used, only the silhouette of the user is judged. Next, referring to FIG. 2B, the straightness measuring unit 122 detects a distal end portion of the user's body such as a hand tip, a foot tip, or the like through a terminal region extracting algorithm based on the determined silhouette of the user. In FIG. 2B, it can be seen that the tip of the hand, the tip of the foot, and the tip of the head are highlighted with a square. Here, the end region extraction algorithm may include a K-Curvature algorithm. Then, based on the determined end of the body, the body's major joints (skeleton joints) or skeletal parts are sensed to distinguish the main body parts. Referring to FIG. 2C, it can be seen that the major joints or skeleton parts of the body are marked with black dots.

Then, the linear length of each part of the body is measured as shown in Fig. 2d. For example, according to the end portion extraction algorithm, the length of the straight line connecting the toe and the head end becomes the user's key (h). Also, when measuring the distance between the black points on the arm, you can measure the straight line length of the lower arm or the total length of the arm. In addition, when measuring the distance between two black points on the boundary between the torso and both arms, the width (w) of the torso can be measured. That is, the distance between the black points or the distance between the distal ends can measure the straight line distance of each part of the body.

The circumferential length measuring unit 123 measures the circumferential length of each part of the body through the depth information of the frontal and lateral granular surface of the user. For example, the circumferential length measuring unit 123 measures the circumferential length of the waist, the chest, the calf, the thigh, .

3A to 3C are illustrations for extracting the waist circumference length from each part of the body. 3A, the circumference length measuring unit 123 extracts the front circumference shape of the waist from the depth information of the front grain of the user. The curved line shown on the left side of FIG. 3A is the frontal circumference of the waist. Then, the circumferential length measuring unit 123 extracts the side circumferential shape of the waist from the depth information of the side grain of the user. The curve shown on the left side of FIG. 3B is in the form of a lateral circumference of the waist. The circumferential length measuring unit 123 estimates the front circumferential shape of the waist as the circumferential shape of the back of the waist and estimates that the circumferential shapes of the left and right sides of the waist are all the same. As shown in FIG. 3C, the circumferential length measuring unit 123 may be arranged such that the front surface, the rear surface, the left side surface, and the right side circumferential surface have a full waist circumference shape, and then a position where the joints are arranged between the circumferential shapes is detected. Then, the circumferential length measuring unit 123 completes the entire waist circumference shape by inserting the seam at the detected position. The circumferential length measuring unit 123 can measure the length of the waist circumference from the complete circumferential waist shape completed.

The database 130 stores a plurality of standard body data and a three-dimensional image of the garment.

The plurality of standard body data is classified and selected from the national standard body data of the country to which the user belongs, and includes information on the length of each part of the body to form a three-dimensional body model. For example, standard body data may include linear length and circumferential length of each part of the body, a three-dimensional image of each standard body, and the like.

According to an embodiment of the present invention, a plurality of standard body data may be classified into a plurality of categories based on the height of the keys and body (for example, waist circumference) and gender. Preferably, it can be classified into nine types. When a plurality of standard body data is classified into nine, a three-dimensional image of each standard body is shown in FIG. Referring to FIG. 4, the standard body of a woman is classified into nine types based on the thickness of the key and the trunk. The type of key is divided into a large key, a middle key and a small key. The thickness of the body is divided into a thick body, a middle body, and a thin body. Particularly, FIG. 4 is classified based on the female body. Therefore, when classifying the body according to the male body, the definition of the length of each part defining the standard body may be changed.

The three-dimensional image of the costume is the three-dimensional image of the costume that the store has. The three-dimensional image of the garment is precisely produced and stored reflecting the color and material of the garment. For example, in the case of a garment of silk material, it may be simulated to be felt in a shiny texture and stored in the database 130. The three-dimensional image of the garment may be captured in at least one direction through the camera 121, extracted from the information, automatically generated in three dimensions by a predetermined process, and stored in the database 130.

 In addition, the database 130 may store an obesity rate table. The obesity rate is an index that can be used to modify the three-dimensional body model described below. Referring to FIG. 5, the obesity rate table includes information on obesity index and degree of obesity. The WTHR (Waist To Height Ratio) is an obesity index, and the obesity index is measured by the ratio of the original height to the waist circumference. The obesity rate has different obesity indices according to sex, and the higher the obesity index, the higher the obesity rate. Then, the shape of the three-dimensional model for each degree of obesity can be stored in the database 130. Referring to FIG. 6, a three-dimensional side view of excitation models in the case of low body weight, normal body, and overweight body is shown. The shape of each model is defined such that the waist circumference is significantly different from the thigh circumference to the chest circumference according to the obesity rate.

The three-dimensional body model providing unit 140 provides a three-dimensional body model based on the measured straight line length and circumferential length of the user's body. The three-dimensional body model providing unit 140 includes a three-dimensional body model generating unit 141 and a three-dimensional body model modifying unit 142.

The three-dimensional body model generation unit 141 generates a three-dimensional body model based on the user profile condition inputted by the user, the user's key and the waist circumference length, Match the data and generate a three-dimensional body model through the matching result. For example, when selecting a group of standard body data, it can be selected based on the user's gender and age. Then, there are nine kinds of standard body data in the selected group, and when the user's key and waist circumference are taken as a reference, the user's body can be judged to be close to the "large key & middle body" among the nine standard bodies . In this case, the user's three-dimensional body model is created to resemble a standard three-dimensional body model having a " large key & middle torso ".

Specifically, the three-dimensional body model generation unit 141 assigns different weights to the respective standard body data according to the user's key and waist circumference, and linearly integrates each of the standard body data reflecting the weight values. At this time, the combined result can be used to create a user's three-dimensional body model similar to any of the nine standard bodies.

The three-dimensional body model modifier 142 generates a secondary three-dimensional body model by modifying the generated three-dimensional body model in detail. Since the generated three-dimensional body model is generated based on only the standard body data, key, and waist circumference, the shape and the approximate shape of the actual user are similar, but the shapes and lengths are not the same. Therefore, in order to correct such a portion, the three-dimensional body model correcting unit 142 corrects the position, the lower arm length, and the upper arm length of each joint, excluding the height and the waist circumference measured in the body measuring unit 120 , Body part information such as calf length, thigh length, chest circumference, body width, etc. are used to modify the three-dimensional body model.

In addition, the three-dimensional body model correction unit 142 can use the obesity rate as a measure of the correction of the three-dimensional body model. Specifically, the three-dimensional body model correction unit 142 can calculate the obesity index using the user's key and waist circumference. The three-dimensional body model correction unit 142 determines the degree of obesity of the user with reference to the obesity rate table stored in the database 130 according to the calculated obesity index. Then, the three-dimensional body model correction unit 142 reflects the modification of the user's three-dimensional body model with reference to the shape of the three-dimensional model according to the determined degree of obesity. For example, if the degree of obesity is " overweight ", the user's three-dimensional body model may be modified so that waist circumference, chest circumference, thigh circumference become thicker. On the other hand, in the measurement of obesity rate, if the user's weight is also an additional input variable, more accurate obesity rate can be measured, so that a more accurate 3-dimensional body model can be corrected.

The motion recognition unit 150 recognizes the motion of the user in order to reflect the result of the motion of the user in real time on the 3D body model wearing the costume. Specifically, the motion recognition unit 150 can recognize the movement of the user through the depth information of the user using the depth camera 121 or the like. The motion recognition unit 150 transmits the recognition result of the motion of the user to the clothes simulation unit 160 to be described later.

The costume simulation unit 160 simulates the three-dimensional body model generated by the user through the input unit 110 so as to be applied to the generated three-dimensional body model. Further, the costume simulation unit 160 simulates the motion of the user and the costume Simulate. Specifically, the costume simulation unit 160 detects a three-dimensional image of the user's selected garment from the database 130, and applies the three-dimensional image of the detected garment to the generated three-dimensional body model. At this time, the costume is applied to fit the size, bend, and length of each part of the three-dimensional body model. Also, as the user moves, the three-dimensional body model is also simulated to move, and the costume worn on the three-dimensional body model is also simulated corresponding to the motion of the three-dimensional body model. This process is also referred to as so-called cross simulation, and is exemplarily illustrated in FIGS. 7A and 7B. FIG. 7A is a simplified diagram illustrating a simulation image in a general state in which a user stands, and FIG. 7B is a simplified diagram illustrating a simulation image in a moving state of the user. 7B is compared with FIG. 7A, it can be seen that as the model in the image moves, the clothing of the model also changes to flicker or wrinkle.

The display unit 170 displays the three-dimensional body model of the user generated through the three-dimensional body model providing unit 140, the costume simulating unit 160, and the motion recognizing unit 150 and provides the three-dimensional body model to the user. The display unit 170 may include a display device, a screen, or the like capable of displaying an image. Also, as described above, when the display unit 170 is configured as a touch screen, the input unit 110 and the display unit 170 may have the same configuration.

Hereinafter, a method of providing a three-dimensional garment wearing model based on depth information according to an embodiment of the present invention will be described in detail with reference to FIGS. 8 and 9. FIG.

First, the configuration of the display unit 170 for displaying a user three-dimensional body model will be described in detail. The display unit 170 according to an embodiment of the present invention may have the same configuration as the input unit 110 when configured with a touch screen. The configuration of the display unit 170 will be described in detail with reference to FIG.

On one side of the screen of the display unit 170, a user profile input condition 171 and a user's body size 172 may be displayed. The user profile input condition 171 may include information on gender and age. The gender may be classified into male and female, and the age may be classified into children, adolescents, and adults. no. The user's body size 172 includes information measured at the body measurement unit 120. [ For example, key, waist circumference, upper arm length, lower arm length, etc. may be displayed. The type of garment 173 can be displayed on the other side of the screen of the display unit 170. [ The kind of garment 173 includes all the number of clothes that can be displayed on the other side of the screen of the display unit 170. [ In Fig. 9, "costume 1, costume 2, ..., costume n" is shown for convenience, but in reality, a three-dimensional image of each costume can be displayed. The user's three-dimensional body model 174 can be displayed at the center of the screen of the display unit 170. The three-dimensional body model may be displayed as a three-dimensional image by operation of the body measurement unit 120 and the three-dimensional body model providing unit 140. The background of the remaining area of the screen of the display unit 170 may be displayed. The background means an image for a region behind the user when photographing a user located in front of the position of the display unit 170, and can be displayed as a simple two-dimensional image.

8, the user inputs a user profile through the display unit 170 (the same as the input unit 110) (S101). At this time, the input method may be a form in which a user touches an item in the user profile input condition 171. [

Then, the user's body is photographed through the depth camera (S102). At this time, the user poses such that at least one of the user's frontal granularity or side granular granularity is photographed by the depth camera 121. When the frontal standing image is photographed, more accurate depth information can be extracted if the user shoots with both arms, such as a pose of the model shown in FIG. 2A. On the other hand, in order to measure the waist circumference length, it is necessary to acquire depth information about the front and side surface granularity, and therefore, it is preferable that both frontal and lateral granularity of the user are photographed for more accurate body measurement.

Next, the straight length and the circumference length of each part of the user's body are measured (S103). As described above, the linear length measuring unit 122 (see FIG. 1) measures the straight length of each part of the body such as the height of the key, the leg length, the arm length, and the trunk based on the depth information on the frontal granular surface. The circumferential length measuring unit 123 (see FIG. 1) measures the circumferential length of each part of the body such as the waist circumference, the chest circumference, the thigh circumference, and the like based on the depth information of the front surface and the side surface grain.

The three-dimensional body modeling unit 140 (see FIG. 1) generates a primary three-dimensional body model based on the measured key and waist circumference lengths and generates a three-dimensional body model such as arm length, leg length, By modifying the primary three-dimensional body model through detailed information, a secondary three-dimensional body model is created (S104).

Regarding the generation of the primary three-dimensional body model, the three-dimensional body model generation unit 141 (see FIG. 1) uses the measured key and waist circumference length to determine which of the plurality of standard body data the user's body . For example, when the first standard body data, the second standard body data, ..., the ninth standard body data are defined, the user's key and waist circumference are close to the second standard body data, It can be judged to be the most distant from the data. At this time, the highest weight is applied to the second standard body, the lowest weight is applied to the ninth standard body data, and the appropriate weight is applied to the remaining standard body. Then, a linear three-dimensional body model can be generated by linearly adding each weighted standard body data.

Illustratively, equations (1) and (2) below mathematically illustrate a method for generating a three-dimensional body model.

In Equation (1), B is a value for the generated three-dimensional body model. wi (α, β) is a weight, and α and β are variables related to the key and waist circumference. That is, the weight is determined according to the key and the waist circumference. As can be seen from Equation (2), the sum of all the weights should be 1. pi denotes standard body data. i is an index of standard body data, n is the number of standard body types, n = 9 when standard body is defined as 9, and i is defined as 0 to 8.

In connection with the generation of the second three-dimensional body model, the three-dimensional body model correction unit 142 (see FIG. 1) uses the data on the details of the body such as the arm length and the leg length, Modify it. At this time, the three-dimensional body model is modified by reflecting detailed items such as arm length, leg length, chest circumference, and joint position except for the key and waist circumference used in the generation of the first three-dimensional body model. In addition, the obesity rate can be measured and further reflected in the modification of the three-dimensional body model.

In addition, the operation of the user is recognized so that the generated three-dimensional body model moves according to the movement of the user (S105). The motion recognition can be performed by extracting depth information in real time using a depth camera 121 or the like and detecting a change in motion.

Then, the three-dimensional body model of the user is displayed through the display unit 170 (S106). As described above, the user's three-dimensional body model is displayed in the central area of the screen of the display unit 170. [ At this time, the displayed three-dimensional body model may be a state in which a user wears a costume worn at the time of shooting, or a state in which a predetermined costume is worn. Also, on the screen of the display unit 170, a user's body dimension such as a key, a waist circumference or the like may be displayed so that the user's body is accurately measured. Also. The type of garment 173 can be displayed on the screen of the display unit 170 for the user's selection. Here, the three-dimensional body model displayed on the display unit 170 can be moved in accordance with the movement of the user.

The user selects a garment through the display unit 170 (S107). At this time, the user can select the desired clothes by touching the screen of the display unit 170. [ Alternatively, the user may select a desired outfit through the movement of the user's three-dimensional body model. For example, if a user moves his / her hand so that the arm portion of the three-dimensional body model overlaps the " Ward 1 " region, " Ward 1 "

Then, the selected garment is applied to the user's three-dimensional body model and displayed (S108). At this time, the garment simulation unit 160 simulates the selected garment to fit the size of the three-dimensional body model. In addition, the clothes simulation unit 160 receives the motion recognition result and simulates the worn clothes to move in accordance with the movement of the user.

The user can confirm the simulation result to which the selected clothes are applied through the display unit 170. Here, if the user wants to try on another costume, he can choose another costume.

If there is such an input, the flow returns to step S107 to display the simulation result for the other costume. If there is no such input, the process ends as it is (S109).

As described above, according to an embodiment of the present invention, a three-dimensional model is generated using a plurality of standard body data, a user's key and a waist circumference length, and thus a user's body and an accurate three- . In addition, since the interface of the display unit for inducing user input and soliciting selection is configured to be convenient for the user and to provide a large amount of information, convenience for the user can be improved. Therefore, when a magic mirror system such as the one embodiment of the present invention is provided in a department store, a clothes shop, etc., it is possible to provide more convenient and quick information to the consumer, which is considered to have a great effect as compared with the prior art.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments.

Therefore, the scope of the present invention is not limited thereto, and various modifications and improvements of those skilled in the art using the basic concept of the present invention defined in the following claims are also within the scope of the present invention.

100: Device 122: Depth camera
120: body measurement part 122: linear length measurement part
123: circumference length measuring unit 130: database
141: Three-dimensional body model generation unit 142: Three-dimensional body model correction unit
160:

Claims (20)

Extracting depth information of a user's body through a depth camera and measuring a length of each part of the body;
Generating a three-dimensional body model of the user with reference to a plurality of standard body data stored in a database based on at least one of the measured key length and the waist circumference of the user;
Recognizing the operation of the user so that the three-dimensional body model of the user moves corresponding to the movement of the user;
Selecting a costume from the user and applying the selected costume to the user's three-dimensional body model; And
And displaying the three-dimensional body model of the user to which the selected costume is applied to move according to an operation of the user,
Wherein the plurality of standard body data is classified and stored based on at least one of the lengths of the body parts in the database. The method according to claim 1,
Further comprising the step of receiving a user profile including sex and age before measuring the length of each part of the body. 3. The method of claim 2,
Wherein the generating the three-dimensional body model of the user comprises:
And selecting a plurality of standard body data for creating the user's three-dimensional body model from the database with reference to the user profile. The method according to claim 1,
Wherein measuring the length of each part of the body comprises:
A straight length of each part of the user's body including a height, a height, an arm length, a leg length and a width of each part;
Wherein the circumferential length of each part of the user's body including the waist circumference length, the bust circumference length, the thigh circumference length, the calf circumference length, and the arm circumference length is measured is provided. Way. 5. The method of claim 4,
Wherein measuring the length of each part of the body comprises:
Measuring a straight line length of each part of the user's body from depth information on a frontal image of the user,
Wherein a circumferential length of each part of the user's body is measured from depth information of the front and side standing images of the user. 5. The method of claim 4,
Wherein the generating the three-dimensional body model of the user comprises:
Determining respective weights for each of the standard body data based on at least one of the user's key and waist circumference length;
Applying a weight corresponding to each of the standard body data; And
Generating a three-dimensional body model of the user by linearly summing each of the standard body data to which the weight is applied;
Wherein the depth information includes at least one of depth information, depth information, and depth information. 5. The method of claim 4,
After generating the three-dimensional body model of the user,
And modifying the three-dimensional body model based on a length of each part of the user's body that is not used in the generation of the three-dimensional body model, wherein the three-dimensional body model is provided based on the depth information How to. 8. The method of claim 7,
Wherein modifying the three-dimensional body model comprises:
Measuring an obesity rate of the user through a ratio of the measured user's key to the waist circumference length; And
Modifying the thickness of each part of the body in the generated three-dimensional body model through the measured obesity rate;
Wherein the depth information includes at least one of depth information, depth information, and depth information. The method according to claim 1,
Wherein the step of displaying the three-dimensional body model of the user to which the selected clothes are applied to move according to the operation of the user,
And displaying the selected clothing to move corresponding to the movement of the user's three-dimensional body model. The method according to claim 1,
Displaying the user's three-dimensional body model and then applying the selected other costume to the three-dimensional body model and displaying it, as the costume and other costumes applied on the three-dimensional body model are selected by the user The method of claim 1, further comprising the step of: A body measurement unit for extracting depth information of a user's body and measuring a length of each part of the user's body;
A database for storing a plurality of standard body data classified on the basis of at least one of lengths of respective parts of the body;
A three-dimensional body modeling unit for providing the three-dimensional body model of the user with reference to the plurality of standard body data based on at least one of the measured lengths of the user's keys and the waist circumference;
An operation recognizing unit recognizing an operation of the user so that the three-dimensional body model of the user moves corresponding to the movement of the user;
An input unit for receiving clothes to be applied to the user's three-dimensional body model from the user; And
A display unit for displaying the 3D body model to which the input costume is applied to operate in accordance with the motion of the user;
Wherein the depth information comprises at least one of the following: 12. The method of claim 11,
Wherein the body measurement unit comprises: a linear length of each part of the user's body including a height, an arm length, a leg length and a width of each part;
A circumferential length of each part of the user's body including a waist circumference length, a chest circumference length, a thigh circumference length, a calf circumference length, and an arm circumference length is measured. . 13. The method of claim 12,
The body-
A depth camera for photographing a body of the user and extracting depth information;
A straight line length measuring unit for measuring a straight line length of each part of the user's body from depth information on the frontal standing image of the user; And
A circumference length measuring unit for measuring a circumference length of each part of the user's body from the depth information of the front and side standing images of the user;
Wherein the virtual clothes-attaching device comprises: 12. The method of claim 11,
Wherein the input unit receives a user profile including sex and age before receiving the clothes from the user. 15. The method of claim 14,
The three-dimensional body model providing unit,
And a plurality of standard body data for creating the three-dimensional body model of the user is selected from the database with reference to the user profile. 12. The method of claim 11,
The three-dimensional body model providing unit,
A three-dimensional body model generation unit for generating the three-dimensional body model of the user by referring to the plurality of standard body data based on the user's key and waist circumference length; And
A three-dimensional body model modifying unit that modifies the three-dimensional body model based on a length of each part of the user's body that is not used in generating the three-dimensional body model;
Wherein the depth information comprises at least one of the following: 17. The method of claim 16,
Wherein the three-dimensional body model generation unit comprises:
Determining a weight for each of the standard body data based on at least one of the key and the waist circumference of the user, applying the weight corresponding to each of the standard body data, Wherein the three-dimensional body model of the user is generated by linearly combining the three-dimensional body model of the user and the three-dimensional body model of the user. 17. The method of claim 16,
The three-dimensional body model modifying unit may include:
Measuring the obesity rate of the user through the measured ratio of the user's key and the waist circumference length and modifying the thickness of each part of the body in the generated three-dimensional body model through the measured obesity rate To provide a three-dimensional garment wearing model based on depth information. 12. The method of claim 11,
The display unit includes:
And displaying the selected garment to move corresponding to a movement of the user's three-dimensional body model. 12. The method of claim 11,
Wherein the display unit applies the other clothing image to the three-dimensional body model and displays the same based on the user's input of the costume and other costumes on the three-dimensional body model to the input unit To provide a three-dimensional garment wearing model.

Images