KR102329445B1 - Smart mirror - Google Patents

Abstract

The present invention relates to an active smart mirror for virtual fitting, and more specifically, to an active smart mirror for virtual fitting, wherein height of a mirror display can be varied, so that the mirror display can be used according to height of a user and a simulation image obtained by combining clothes with a body figure image of the user is represented through the mirror display to provide virtual fitting. Moreover, height of the mirror display can be automatically adjusted, based on information on height of the user and the size of the simulation image represented on the mirror display can be varied, based on the information on the height of the user. According to the present invention, the active smart mirror of the present invention performs a calibration process for the body figure of the user and obtains information on a physical shape of the user, thereby forming a fashion style proper for the user in virtual fitting, and varies information on a physical shape of the user by using an image of the user really wearing the clothes selected in virtual fitting to generate more precise information on the physical shape of the user.

Description

Virtual Fit Active Smart Mirror {Smart mirror}

The present invention relates to a virtual fitting active smart mirror, and more particularly, since the height of the mirror display can be varied, the mirror display can be used according to the height of the user, and a simulation image in which clothes are synthesized with the user's body image can provide virtual fitting by displaying the . It can vary, and by performing the user's body calibration process to acquire the user's body type information, it is possible to form the clothes fit for the user at the time of virtual fitting, and the image when the clothes selected at the time of virtual fitting are actually worn It relates to a virtual fitting active smart mirror that can generate more precise body shape information by changing the user's body shape information using

A smart mirror functions as a mirror by reflecting a certain amount of light incident from the front by forming a polarizing reflective film on the front of the display, and at the same time, a device that transmits the light emitted from the rear display to the front to display the display image together. am.

Such smart mirrors have been installed in beauty salons and the like to play images such as movies while customers are receiving beauty services to relieve customers' boredom, or to improve purchasing power by outputting advertisement screens.

However, in order to utilize the smart mirror as a full-length mirror, it was necessary to employ a longer display than necessary to reflect the whole body to users of different heights. There was a problem.

Accordingly, it is necessary to develop a smart mirror that can easily adjust the height of the lift and can form a display with an appropriate size while functioning as a full-length mirror, and that can form necessary information in the vicinity of the user's field of view.

KR10-2020-0095049 (public number) 2020.08.10.

An object of the present invention is to provide a virtual fitting active smart mirror that can utilize the mirror display according to the height of the user because the height of the mirror display can be varied.

Another object of the present invention is to provide a virtual fitting active smart mirror capable of providing virtual fitting by displaying a simulation image in which clothes are synthesized on a user's body image through a mirror display.

Another object of the present invention is to provide a virtual fitting active smart mirror capable of automatically adjusting the height of a mirror display using user's key information.

Another object of the present invention is to provide a virtual fitting active smart mirror capable of varying the size of a simulation image displayed on a mirror display by using user's key information.

Another object of the present invention is to provide a virtual fitting active smart mirror capable of forming a user's style of clothes during virtual fitting by performing a user's body calibration process and acquiring user body type information.

Another object of the present invention is to provide a virtual fitting active smart mirror capable of generating more precise body shape information by varying the user's body shape information using an image of actual wearing of clothes selected during virtual fitting. There is this.

The present invention, the base frame is supported on the ground, the installation surface is formed on the top; a lifting frame coupled to the installation surface of the base frame and extending upwardly of the base frame; a mirror frame installed to be slidable up and down on the elevating frame; a mirror display coupled to the mirror frame and reflecting more than a set amount of light incident from the front, provided with a display module, and emitting light emitted from the display module to the front; a driving unit for generating power for lifting and lowering the mirror frame; a power transmission unit connected to the driving unit and the mirror frame to elevate the mirror frame according to the driving of the driving unit; and a controller configured to generate an image to be displayed on the mirror display, drive the mirror display, and determine a driving amount of the driver.

In addition, the present invention includes a camera that is installed in the mirror frame to take an image of the front, wherein the control unit extracts the user's body from the image taken from the camera, and then stores clothes pre-stored in the extracted user's body A simulation image is generated by synthesizing and displayed on the mirror display.

In addition, the control unit of the present invention measures the height of the user from the image captured by the camera, and determines the driving amount of the driving unit based on the measured key information of the user.

In addition, the controller of the present invention changes the size of the simulation image based on the measured user's key information.

In addition, the control unit of the present invention guides a preparation motion for user body calibration to the mirror display, and the camera creates a calibration image by photographing the user moving along the preparation motion, the control unit, A feature point of the rotation amount of each part of the body is extracted from the calibration image, the joint position of each part of the body is specified from the extracted feature point of the rotation amount, and body shape information of the user is obtained from the specified joint position.

In addition, the control unit of the present invention receives the user's weight information, and corrects the user's body type information based on the measured height of the user and the inputted weight information of the user.

In addition, the control unit of the present invention, clothing information including clothing size information, material information, and thickness information is pre-stored, and substituting the clothing information into the user's body shape information, Fit information, which is a state in which physical displacement of clothing information has occurred, is generated, and a simulation image to which the fit information is applied is generated and displayed on the mirror display.

In addition, the control unit of the present invention, after photographing a state in which the clothes applied to the simulation image are actually worn, corrects the body shape information from the shape of the clothes actually worn.

According to the present invention, although a mirror display having a function of a mirror and a function of a display is provided, since the height of the mirror display can be varied, there is an effect that the mirror display can be utilized according to the height of the user.

In addition, the present invention has the effect of providing virtual fitting by photographing a user through a camera and displaying a simulation image obtained by synthesizing clothes with a body image of the user through a mirror display.

In addition, the present invention has the effect of measuring the height of the user through the image captured by the camera, and automatically adjusting the height of the mirror display using the measured height information of the user.

In addition, the present invention has the effect of being able to vary the size of the simulation image displayed on the mirror display by using the user's key information.

In addition, the present invention has an effect that the user's body shape information can be acquired by performing a user's body calibration process, so that the appearance of clothes at the time of virtual fitting can be formed to suit the user.

In addition, the present invention has the effect of generating more precise body shape information by varying the user's body shape information using the image when the clothes selected at the time of virtual fitting are actually worn.

1 is a perspective view of a virtual fitting active smart mirror according to an embodiment of the present invention;
2 is a partially cutaway perspective view of a virtual fitting active smart mirror according to an embodiment of the present invention;
3 is a plan sectional view of a main part of a virtual fitting active smart mirror according to an embodiment of the present invention;
4 is a flowchart of a height adjustment process of a virtual fitting active smart mirror according to an embodiment of the present invention;
5 is a flowchart of a simulation process of a virtual fitting active smart mirror according to an embodiment of the present invention;

Hereinafter, an embodiment of the present invention will be described in detail with reference to the accompanying drawings.

In the present invention, the base frame 100 is supported on the ground and the installation surface 101 is formed thereon, and the base frame 100 is coupled to the installation surface 101 of the base frame 100 to extend upward and downward of the base frame 100 . The frame 200, the mirror frame 300 installed slidably up and down on the elevating frame 200, and the mirror frame 300 are coupled to reflect more than a set amount of light incident from the front, but the display module A mirror display 400 that is provided to emit light emitted from the display module forward, a driving unit 500 that generates power for lifting and lowering the mirror frame 300 , and the driving unit 500 and the mirror frame 300 . A power transmission unit 510 that is connected to elevate the mirror frame 300 according to the driving of the driving unit 500 , generates an image to be displayed on the mirror display 400 , drives the mirror display 400 , and the driving unit 500 ) is configured to include a control unit 600 that determines the driving amount.

The base frame 100 serves to stand up and support the elevating frame 200 and the mirror frame 300 and the mirror display 400 mounted on the elevating frame 200 from the ground. An installation surface 101 is formed.

The base frame 100 is supported from the ground by being provided with wheels 102 at the bottom of the grid-type frame 110 in the drawing, and the installation surface 101 is formed on the upper surface of the grid-type frame 110 to form the installation surface 101 . Although it is shown that the elevating frame 200 is coupled to the lattice frame 110 in which the bar-shaped frame is configured in a lattice form, it is also possible that the lattice frame 110 is configured without the installation surface 101, and the wheel 102 at the bottom is not limited thereto. Of course, a form without ) is also possible. The wheel 102 at the bottom of the base frame 100 is configured to easily move the virtual fitting active smart mirror of the present invention, and a locking means is provided to position the locking means in an open state and then move the virtual fitting active smart mirror And, if the locking means on the wheel 102 is placed in the locked state after the movement of the virtual fitting active smart mirror is completed, it is possible to prevent an unintentional change of position.

The lifting frame 200 is coupled to the upper surface of the base frame 100 , that is, the installation surface 101 , and the circuit board constituting the control unit 600 is installed in a separate control box and installed on the installation surface 101 . ) can be coupled to the top.

In addition, although the driving unit 500 is illustrated as being installed on the elevating frame 200 in the drawing, it is also possible to be installed on the installation surface 101 of the base frame 100 , and the driving power of the driving unit 500 is the power transmission unit. The position of the driving unit 500 may be anywhere as long as it has a structure capable of elevating the mirror frame 300 by driving the 510 .

The lifting frame 200 provides an installation space in which the mirror frame 300 is installed, and also serves to guide the mirror frame 300 so that it can be lifted without being separated, and for this purpose, the base frame 100 ) is coupled to the installation surface 101 and extends upward of the base frame 100 .

Since the lifting frame 200 has to play a role of supporting the mirror frame 300 away from the ground and guiding it when the mirror frame 300 is raised and lowered, the mirror frame 300 is guided and lifted. The guide frame 220 is slidably coupled to the mirror frame 300 so that the guide frame 220 is not deformed or wobble by the weight of the mirror frame 300 and the mirror display 400 . ) is configured to include a support frame 210 that firmly supports the. In this case, the support frame 210 is rigidly coupled to the installation surface 101 of the base frame 100 so as not to flow, and may be composed of a single part, but is shown in the present invention in order to increase the structural strength compared to the weight of the material. It can also be constructed in the form of a frame as shown.

The support frame 210 shown in the drawings of the present invention is coupled to the installation surface 101 of the base frame 100 so as to be spaced apart from each other and extends upwardly with four vertical frames 211 and adjacent vertical frames 211 . A support plate ( 213) is further included. Then, the guide frame 220 is coupled to the support plate 213 . However, the guide frame 220 may also be coupled to the horizontal frame 212 and the support plate 213 is not necessarily configured. In addition, the front side of the support frame 210 is a shield 230 , and the side and rear surfaces of the plate-shaped finishing material 240 are combined to prevent the internal configuration of the vertical frame 211 from being exposed to the outside.

On the other hand, the guide frame 220 is a form in which the guide rail is formed vertically, and the shape of the guide rail can be any as long as it guides the mirror frame 300 to be slidable up and down. That is, the guide frame 220 may have a cylindrical shape or a square pillar shape. Alternatively, it may be configured in a form in which a groove is formed on the side of a bar-type frame such as a guide rail of an LM guide. The point is that any structure that can guide the mirror frame 300 to be slidable up and down is possible.

The mirror frame 300 serves to allow the mirror display 400 to be positioned spaced apart from the ground by being lifted by the guide frame 220 while the mirror display 400 is fixed, and for this purpose, the lifting frame 200 It is installed to be slidable up and down on the guide frame 220 of the.

The mirror frame 300 does not refer to a single frame of any frame type for fixing the mirror display 400 , but collectively refers to various components connecting the mirror display 400 to the elevating frame 200 .

Accordingly, the mirror frame 300 of the present invention includes a sliding block 310 that is slidably installed on the guide frame 220 of the elevating frame 200, and a connection bracket that is coupled to the sliding block 310 and extends forward ( 320 , and a mirror fixing plate 330 coupled to the front of the connection bracket 320 .

First, when the sliding block 310 is guided by the guide frame 220 to be lifted up and down, the connection bracket 320 coupled to the sliding block 310 is lifted along the sliding block 310, and also the connection bracket ( The mirror fixing plate 330 coupled to the 320 has an integrated structure in which the connection bracket 320 and the sliding block 310 are raised and lowered. At this time, the connection bracket 320 is configured in a "工" shape to prevent the components inside the elevating frame 200 from being directly exposed to the field of view when viewed from the outside, so that one horizontal side is on the sliding block 310, the other horizontal side It is configured to be coupled to the mirror fixing plate 330 , and is configured to cover the remaining space with a separate screen 230 , except for a narrow gap on the vertical side connecting the two horizontal sides. The screen 230 is formed on the front part of the elevating frame 200 and is configured to cover the components inside the elevating frame 200, and the connection bracket 320 of the mirror frame 300 can secure a route for elevating. It has a shape in which an incision is formed long in the vertical direction so that the The shield 230 is preferably made of two pieces and coupled to the elevating frame 200 such that a cutout is formed between the two pieces spaced apart from each other in parallel.

On the other hand, the mirror frame 300 , specifically, the sliding block 310 of the mirror frame 300 is connected to the power transmission unit 510 while being guided by the guide frame 220 of the elevating frame 200 to drive the driving unit 500 . ) is driven up and down. The lifting and lowering configuration of the mirror frame 300 can be borrowed from known linear movement configurations such as a ball screw method, a chain method, and a timing belt method. In the present invention, the ball screw method will be shown and described, but of course, other linear movement methods are also possible. When the mirror frame 300 is lifted up and down by the ball screw method, the sliding block 310 has through-holes vertically formed inside, and a ball nut 311 is inserted and fixed in the through-hole. And when the power transmission unit 510 in the form of a screw is inserted into the ball nut 311, and the power transmission unit 510 is rotated by the driving unit 500, the sliding block 310 is raised or lowered according to the rotation direction. will be.

The driving unit 500 drives the power transmission unit 510 to raise or lower the mirror frame 300 so that the mirror display 400 can be positioned according to the height of the user, and the driving amount is controlled by the control unit 600 . it is decided

The driving unit 500 may be configured as a motor, and is coupled to the elevating frame 200 in the vicinity of the lower end of the elevating frame 200 according to the drawings, but the installation position is not limited thereto. The driving unit 500 may be provided at the upper end of the elevating frame 200 as long as it is a position capable of driving the power transmission unit 510 without interfering with the elevating route of the elevating frame 200 , and may be mounted on the elevating frame 200 . Of course, it is also possible to be fixed to the installation surface 101 of the base frame 100 without being coupled.

The mirror display 400 serves to provide image information while functioning as a mirror, and for this purpose, it is coupled to the mirror frame 300 and reflects more than a set amount of light incident from the front, but the display module This is provided so that the light emitted from the display module can be emitted forward.

The mirror display 400 is coupled to the front of the mirror fixing plate 330 of the mirror frame 300 , and receives and displays image information generated from the control unit 600 .

The mirror display 400 may be configured as an integral type in which the display module itself is manufactured including a polarizing reflective film, or may be configured in the form of attaching a reflective plate including a polarizing reflective film to the display module, and such a mirror display 400 is not commercially available. Since it is a sufficiently formed configuration, a detailed description thereof will be omitted.

A camera 410 is provided on one side of the mirror display 400 , preferably above the mirror display 400 so as to photograph a user in front.

The camera 410 is installed on the top or front upper portion of the mirror frame 300 to take a front image, and serves to transmit the captured image to the controller 600 . The image taken from the camera 410 is transmitted to the controller 600 and used as data for measuring the distance between the camera 410 and the user, the height of the user, and the like, and at the same time generates a simulation image that synthesizes clothes on the user's body used as data for

In this case, the distance between the user and the camera 410 can be applied to the same concept as the distance between the mirror display 400 and the user, and for this purpose, the camera 410 is positioned vertically above the mirror display 400 . is preferably located.

There may be several methods of measuring the distance to the user through the camera 410 . A single example is the depth camera 410 . The depth camera 410 is largely a stereo method, a Time-Of-Flight (ToF) method, a structured pattern method, etc., but it is not necessary to measure a minute distance in micrometer (um) units, and the scanning speed is fast, and the , a ToF method with a low price and not complicated software configuration is widely used even under general lighting. The ToF method obtains travel time information by measuring the delay or phase shift of the modulated optical signal for a pixel, and calculates the distance from the travel time information. Samsung Electronics' Galaxy Note 10+ and Apple's It was also applied to the iPhone X. This ToF method has an advantage in that not only the distance from the camera 410 to the user but also the height of the user can be measured immediately. The process of measuring the distance to the user and the height of the user by using the image taken from the camera 410 is performed by the controller 600 .

On the other hand, since the control unit 600 is installed on the installation surface 101 of the base frame 100 in the form of a control box, the mirror display 400 and the camera 410 are spaced apart from the base frame 100 and lifted up and down. , a communication line for the display and the camera 410 to communicate with the controller 600 is stretched or tightened. Therefore, in the present invention, in order to improve the durability of the communication line by preventing sagging and external exposure of the communication line, the communication line is built inside and both ends thereof are coupled to the mirror frame 300 and the control unit 600, respectively, so that the mirror frame 300. A cable bearer 610 that performs a bending operation according to the elevation of the is configured. Since such a cable bearer 610 is a known configuration, a detailed description thereof will be omitted.

The controller 600 generates an image to be displayed on the mirror display 400 , drives the display module of the mirror display 400 , and determines the driving amount of the driver 500 . To this end, the control unit 600 is embedded in the control box in the form of a circuit board and is coupled to the installation surface 101 of the base frame 100 , and is electrically connected to the camera 410 , the mirror display 400 and the driving unit 500 . do.

Looking at the operation of the control unit 600 , first, the control unit 600 measures the height of the user from the image captured by the camera 410 . Then, the driving amount of the driving unit 500 is determined based on the measured key information of the user. The driving amount of the driving unit 500 is based on the fact that the mirror display 400 is positioned at a height at which the user's image reflected by the mirror display 400 can be captured by the user's eyes. The position of the mirror display 400 in which the user's eyes can contain his or her whole body is that the height of the top is 1/2 between the user's eyes and the crown, and the height of the bottom is 1/ between the user's eyes and the soles of the feet. At two points, you can see the whole body. In this case, even if the position of the user's eyes is not difficult to be tracked, the height between the human eye and the crown does not differ greatly from person to person, so it is not unreasonable to designate it as a set value. In addition, since the mirror display 400 will be manufactured in an up-and-down length with a margin rather than a size that tightly fills the user's crown to the sole of the foot, the position of the mirror display 400 is the lowest top height for containing the user's whole body and It is reasonable to calculate that the midpoint of the highest bottom height is the middle point of the mirror display 400 .

That is, the height of the user is h, the position of the sole of the foot is 0, the preset distance between the crown and the eye is y, the lowest top height of the mirror display 400 is a, the highest bottom height of the mirror display 400 is b, the mirror If the distance from the top and bottom of the display 400 to the center is m, and the final height of the middle of the mirror display 400 is M,

If we rewrite Equation 3,

That is, the control unit 600 determines the driving amount of the driving unit 500 so that the center of the mirror display 400 is a point obtained by subtracting a value obtained by dividing the set distance between the crown and the eye in half from the 3/4 point of the user's height. will do That is, since the value obtained by dividing the distance between the crown and the eye in half is very insignificant, the center of the mirror display 400 is approximately 3/4 of the height of the user. Of course, in this case, in the case of a very tall user or a very short user, since there is a limit in the height at which the mirror frame 300 fixing the mirror display 400 is lifted along the lifting frame 200, the mirror display ( The maximum height and minimum height of 400) are preset and stored, and when the calculated height of the mirror display 400 exceeds the maximum height or is less than the minimum height, the maximum height and minimum height of the set mirror display 400 are stored in the mirror display ( It is desirable to have a final height of 400).

On the other hand, it is also possible to manually adjust the height of the mirror display 400, for this purpose, an up button and a down button on one side of the lift frame 200, and an emergency stop button used when it is necessary to urgently stop the equipment This may be provided.

Next, the controller 600 extracts the user's body from the image captured by the camera 410 , and then generates a simulation image synthesizing the clothes pre-stored in the extracted user's body and displays it through the mirror display 400 . . In this case, the user's body synthesized in the simulation image may be expressed as it is only the user's face, and the user's body part may be an avatar corresponding to the user's body type. The reason why even the user's body part is not used in the simulation image is that if the clothes to be synthesized for the simulation are smaller than the outlines of the clothes the user is currently wearing, the outlines may overlap. Because it can be created.

In addition, it is preferable that the size of the generated simulation image is varied and applied based on the measured height information of the user. That is, even if it is a simulation image, it is because the image as if the user is looking directly in the mirror has less discomfort and can express the feeling of wearing clothes well. At this time, the height of the avatar including the user's face in the simulated image is a value obtained by subtracting the highest bottom height of the mirror display 400 from the lowest top height of the mirror display 400, that is, the mirror display obtained by subtracting the equation 2 from the equation 1 It becomes h/2, which is the minimum length of (400), which means half the length of the user's height.

On the other hand, even users of the same height can look different when wearing the same clothes according to their weight. For example, when a user weighing 180 cm and 80 kg and a user weighing 180 cm or 120 kg wear a cotton T-shirt, it is obvious that the wearing appearance is not the same. In such a situation, even if an avatar is created using only the user's key information and the clothes are synthesized and displayed, the sense of disparity felt by ordinary people when viewing the clothes worn by the mannequins placed in front of the clothing store is not significantly different.

Therefore, it is necessary to correct the simulation image in which the clothes are synthesized according to the user's body type. Accordingly, if the user's body shape is captured by using the camera 410 while wearing only the underwear that the user is wearing, body shape information can be acquired without great difficulty. However, since the present invention must be installed and utilized in a shopping mall, etc., the user cannot take off all of his outerwear in an exposed environment, and there is a possibility of image leakage or illegal use even when shooting while wearing only underwear in a limited space. Therefore, it is difficult to take off the outerwear.

Accordingly, the present invention performs a calibration process so that even a user in a state of wearing outerwear can acquire body shape information. To this end, the controller 600 guides the preparation motion for the user's body calibration to the mirror display 400 . The preparation motion is a motion that the user must follow in order to specify the user's joint position, and a motion capable of measuring the degree of bending of the shoulder, elbow, wrist, pelvis, and knee is mainly provided.

The camera 410 generates a calibration image by taking a picture of the user moving along the preparation motion, and the control unit 600 extracts the characteristic points of the rotation amount of each part of the body from the calibration image transmitted from the camera 410, and extracts The joint position of each part of the body is specified from the characteristic point of the specified amount of rotation, and information on the user's body type is obtained from the specified joint position.

At this time, the characteristic point of the amount of rotation of each part of the body does not simply mean a rotational center point. In the case of an elbow that moves with one joint, the center of rotation is the position of the elbow joint. have complex movements. Therefore, depending on the type of joint, the position of the joint is specified based on the amount of rotation of the body part connected to the joint, and the parameter for specifying the position of the joint from the characteristic point of the amount of rotation of the body part is pre-stored in each joint part at the time of initial measurement. It can follow the rotation characteristic value of .

Meanwhile, the controller 600 may receive the user's weight information, and may correct the user's body type information based on the measured height of the user and the inputted weight information of the user.

Clothing information including clothing size information, material information, and thickness information is pre-stored in the controller 600, and the controller 600 substitutes the clothing information into the user's body type information, The pit information in which the physical displacement of is generated is generated, and a simulation image to which the pit information is applied is generated and displayed on the mirror display 400 . In this process, an avatar is created based on the user's body type information, and clothes with fit information applied to the created avatar are synthesized. Accordingly, while the user sees a simulation image in which clothes to which fit information is applied to an avatar similar to his or her body type are synthesized, he or she can refer to the appearance of the clothes without discomfort.

However, the body shape information generated by specifying the user's joint position may be slightly different from the actual user's body shape. The reason is that a person's body shape varies not only with the skeleton, but also with the amount of muscle, the shape of the muscle, and the thickness of the subcutaneous fat. Therefore, it is necessary to correct the body shape information generated from the position of the joint.

Correction of body type information is referred to from a state in which the user actually wears clothes. The controller 600 corrects body shape information from the shape of the clothes actually worn after photographing a state of wearing the clothes applied to the simulation image. Since the body shape information corrected here is made from the shape of the clothes actually worn, it is technically very difficult to inversely calculate the body shape information from the shape of the clothes through the physics engine. Therefore, in the present invention, information such as shoulder width, chest and belly curvature, pelvis and hip width, etc., which have the greatest influence on clothing fit, is extracted from the actually worn clothes shape to correct body shape information. The correction of the body type information is to input a value obtained by subtracting the thickness information set in the clothes information from the shape of the clothes actually worn as a correction value of the body shape information.

If the body type information is generated only when the user takes a normal posture, it may be possible to obtain the outline after taking a picture of the user wearing a specific clothes without a calibration process. However, since the present invention takes a method of generating body shape information in which joint positions are specified and correcting body shape information from a state of wearing actual clothes, a simulation image corresponding to the corresponding posture is generated no matter what posture the user takes. will be able to do

Meanwhile, the present invention may include a user registration or user authentication process. The user authentication or user registration process is to store the user's body shape information in the server and then use the user's body shape information stored in the server without performing a cumbersome calibration process when reused in the future.

In addition, it is desirable that not only the first user but also the existing user continue to correct the body shape information by photographing the actual wearing state with the camera 410, which changes the body shape of the user from time to time and the body shape information is repeatedly corrected. This is because more precise body shape information can be obtained. At this time, instead of going through a cumbersome process of taking a separate camera 410 for correcting body shape information, when looking at the mirror to check the fit of the actual clothes after wearing the actual clothes, the corresponding mirror is used as the virtual fitting active smart mirror of the present invention. As only needs to be used, the user simply puts on the clothes and checks the wearing state, but the camera 410 and the control unit 600 correct the user's body type information.

According to the present invention having the above configuration, the mirror display 400 having a mirror function and a display function is provided, and the height of the mirror display 400 can be varied, so that the mirror display 400 can be adjusted according to the height of the user. There is an effect that can be used.

In addition, the present invention has the effect of providing virtual fitting by photographing the user through the camera 410 and displaying a simulation image obtained by synthesizing the user's body image with clothes through the mirror display 400 .

In addition, according to the present invention, the height of the user is measured through the image captured by the camera 410 , and the height of the mirror display 400 can be automatically adjusted using the measured height information of the user.

In addition, according to the present invention, the size of the simulation image displayed on the mirror display 400 can be varied by using the user's key information.

In addition, the present invention has an effect that the user's body shape information can be acquired by performing a user's body calibration process, so that the appearance of clothes at the time of virtual fitting can be formed to suit the user.

In addition, the present invention has the effect of generating more precise body shape information by varying the user's body shape information using the image when the clothes selected at the time of virtual fitting are actually worn.

100: base frame 101: installation surface
102: wheel 110: grid frame
200: elevating frame 210: support frame
211: vertical frame 212: horizontal frame
213: support plate 220: guide frame
230: screen 240: finishing material
300: mirror frame 310: sliding block
311: ball nut 320: connection bracket
330: mirror fixing plate
400: mirror display 410: camera
500: driving unit 510: power transmission unit
600: control unit 610: cable bayer

Claims (8)

a base frame supported on the ground and having an installation surface formed thereon;
a lifting frame coupled to the installation surface of the base frame and extending upwardly of the base frame;
a mirror frame installed to be slidable up and down on the elevating frame;
a mirror display coupled to the mirror frame and reflecting more than a set amount of light incident from the front, provided with a display module, and emitting light emitted from the display module to the front;
a driving unit for generating power for lifting and lowering the mirror frame;
a power transmission unit connected to the driving unit and the mirror frame to elevate the mirror frame according to the driving of the driving unit;
a control unit for generating an image to be displayed on the mirror display, driving the mirror display, and determining a driving amount of the driving unit;
a camera installed on the mirror frame to photograph a front image;
includes,
The control unit extracts the user's body from the image taken from the camera, and then generates a simulation image synthesizing the clothes stored in the extracted user's body and displays it on the mirror display,
The control unit guides a preparation motion capable of measuring a degree of bending of a joint including a shoulder, an elbow, a wrist, a pelvis, and a knee for user body calibration to the mirror display,
The camera creates a calibration image by photographing the user moving along the preparation motion,
The control unit extracts a characteristic point of the rotation amount of each part of the body from the calibration image, specifies the joint position of each part of the body from the extracted characteristic point of the rotation amount, and obtains the user's body type information from the specified joint position,
The controller is configured to pre-store clothing information including clothing size information, material information, and thickness information, and substitutes the clothing information to the user's body type information, but physically displacement of the clothing information according to the user's body type information Generates fit information in the generated state, generates a simulation image to which the fit information is applied, and displays it on the mirror display,
The control unit, a virtual fitting active smart mirror for correcting the body type information from the shape of the actually worn clothes after taking a picture of the actual wearing of the clothes applied to the simulation image.
delete The method of claim 1,
The controller measures the height of the user from the image captured by the camera, and determines the driving amount of the driver based on the measured key information of the user.
4. The method of claim 3,
The control unit is a virtual fitting active smart mirror that varies the size of the simulation image based on the measured user's key information.
delete 5. The method of claim 4,
The controller receives the user's weight information and corrects the user's body type information based on the measured height of the user and the inputted weight information of the user.
delete delete

Images