KR20200099708A - Smart mirror system - Google Patents

Abstract

The present invention provides a smart mirror system which helps to select clothing more conveniently and quickly. According to one embodiment of the present invention, the smart mirror system comprises: a photographing unit which photographs the front; a display unit which displays a picture or image photographed by the photographing unit; a clothing image extracting unit which extracts a clothing image from the photograph or video photographed by a user wearing clothing; a body image extracting unit which extracts a human body image from the photographed video; a clothing data generation unit which stores the clothing image extracted by the clothing image extraction unit; an image synthesizing unit for synthesizing an image of the clothing selected by the user among the clothing images previously stored in the body image of the user and loading the image on the display unit; and a communication unit for transmitting and receiving data.

Description

Smart mirror system {SMART MIRROR SYSTEM}

The present invention relates to a smart mirror system.

In the past, large displays that could only be seen on large billboards or high-end TVs are installed and utilized in general public places or retail stores in modern times, so that the technology development of display devices has been made rapidly, and the price range is sufficiently diverse. It has become cheaper as possible.

In particular, due to the recent development of the computing industry and the development of wireless communication, technologies such as home appliance convergence and remote home appliance control are gradually increasing. Among these, recently developed smart mirrors have been developed that have two purposes, one used in clothing stores and those used in general daily life. First, the technology used in clothing stores is displayed on the mirror function so that you can wear clothes virtually. By adding more functions, it played a role of synthesizing and showing virtual clothing to the user's actual appearance. However, this technology allows you to try on clothes directly in the store, and if you are not in the store, you can run it with a simple program that combines clothes with your own photos, so you can check it directly on a web page without the need for hardware help. It wasn't a great success.

However, a smart mirror that has a sort of secretary function used in daily life adds a display function that includes computing power capable of acting as a secretary to the mirror, and is in the spotlight as a technology that serves as a personal assistant in the future.

In particular, Philips, a large Dutch home appliance company, added a display device to the rear of the large bathroom mirror used in the bathroom to act as a personal assistant and introduces a technology that provides various information to future smart home appliances. There is a precedent that suggested the development direction of Korea. Of course, a variety of experimental technologies are being introduced because it is a process of accumulating experience to determine which technology is suitable for the public, but a technology that is greatly shining except for some digital signage grafting technology has not yet appeared.

As a prior art for such a smart mirror, Korean Patent Registration No. 10-1541180'smart mirror device and a system according to it are disclosed. The present invention is formed to have a built-in camera unit and a camera unit that outputs customer pictures taken of a customer standing in a predetermined position, and receives and displays customer photos from the camera unit so that the customer standing in a predetermined position can be viewed. The formed smart mirror is arranged side by side on one side of the smart mirror and is provided with customer information about the customer from the customer, checks the authentication status, receives customer photos from the camera and displays them, or selects a customer from among a plurality of customer photos. It relates to a smart mirror device including a touch authentication screen unit that provides a picture to the smart mirror. It is a mirror that can provide easy information to the user by fusion and display of the clothing image as a digital technology with the actual image of the user. In the case of visiting a store, the user can try on the clothes themselves, and in other cases, it is a technology that can be used through a simple web page, so its utilization is low.

As another prior art, Korean Patent Registration No. 10-1604030 discloses a “multi-touch sensing device using an array-type rear camera”. A display panel that displays an image, a sensing light source that emits light for sensing a touch image displayed on a rear surface of the display panel by an object, and a camera that senses a touch image by dividing a region of the touch image. The multi-touch sensing device can reduce the thickness of the multi-touch sensing device by arranging a camera at the bottom edge or by having a mirror that reflects the touch image, and a multi-touch sensing device that can improve image quality and sensing sensitivity by providing an optical shutter. It relates to a sensing device. Such a sensing device is easy to provide information to a user, but it is a configuration only for display and does not disclose how and what information can be transmitted, so it is a technology that requires further research.

Therefore, in order to solve such a problem, a display device and a mirror are combined to provide a variety of information, guidance, and alarms to the user, as well as develop a smart mirror that can be controlled according to the situation by remotely interlocking with other devices. The necessity is emerging.

The present invention is to solve the above-described prior art, and an object of the present invention is to provide a driving method of a smart mirror system that helps to quickly select clothes.

However, the objects of the present invention are not limited to the above-mentioned objects, and other objects that are not mentioned will be clearly understood by those skilled in the art from the following description.

A smart mirror system according to an aspect of the present invention includes a photographing unit for photographing a front side, a display unit for displaying a picture or image taken by the photographing unit, and a clothing for extracting a clothing image from a photograph or image taken by a user wearing clothing. An image extraction unit, a body image extraction unit that extracts a body image of a person from a photographed image, a clothing data generation unit that stores a clothing image extracted from the clothing extraction unit, a user among the clothing images previously stored in the body image of the user And an image synthesizing unit for synthesizing the image of the selected clothing and loading the image on the display unit, and a communication unit for transmitting and receiving data.

Here, the smart mirror system may further include a clothing classification unit that stores the input use period of the clothing, color, material, and use of the clothing, and classifies the clothing.

In addition, the smart mirror system may further include a weather analysis unit that receives and analyzes weather data, and a weather matching unit that selects and displays clothing matching the analyzed weather from the stored clothing image.

In addition, the weather matching unit may include a time matching module that analyzes a change in temperature over time and selects and displays clothes by time.

In addition, the weather matching unit may include a temperature matching module that selects and displays clothing according to temperature and a rainy weather matching module that selects clothing according to snow and rain.

In addition, the smart mirror system may further include a matching selector by selecting and displaying pre-stored clothing matching the clothing selected by the user.

In addition, the smart mirror system provides data on a clothing trend at a preset period on the display unit, selects and displays clothing products related to the trend selected by the user, and selects a trend that synthesizes and loads clothing selected by the user from among displayed clothing. May contain more wealth.

In addition, the smart mirror system further includes a preference storage unit that analyzes the expression of the user photographed by the photographing unit and stores information on clothing that the user prefers, and a wear analysis unit that analyzes and displays the pattern of clothing worn by the user for a week. can do.

In addition, the smart mirror system is installed on the front of a closet in which clothes are accommodated, a clothes recognition unit that recognizes clothes through wireless communication with a chip attached to the clothes, and a list display unit that displays clothes stored in the closet in the form of thumbnails. It may contain more.

In addition, the smart mirror system may further include a product recommendation unit that selects and recommends clothing sold in an internet shopping mall as clothing that can be matched with clothing selected by the user, and synthesizes and loads the clothing on the user's body image.

In addition, the product recommendation unit analyzes a pattern of clothing that the user prefers, a taste selection module that selects among the clothing on sale, a sales volume selection module that selects among clothing that is sold most during a preset period, and a buyer who purchases the clothing selected by the user. A redundant selection module for selecting the clothes purchased by the user and a discount selection module for selecting clothes that are being discounted from among the clothes that the user prefers.

In addition, the smart mirror system may further include a positive correction unit for displaying the corrected body image of the user to fit the clothing when the clothing recommended by the product recommendation unit is synthesized and displayed on the user's body image.

In addition, the smart mirror system further includes a negative correction unit for negatively correcting and displaying the user's body image when the clothing held by the user is synthesized and displayed on the user's body image after the clothing recommended by the product recommendation unit is displayed. can do.

The smart mirror system of the present invention allows the user to quickly, conveniently and quickly select clothes because the user directly stores clothing information held by the user and synthesizes the clothing image with the user's body image.

1 is a diagram showing a smart mirror according to an embodiment of the present invention.
2 is a block diagram showing a smart mirror system according to an embodiment of the present invention.
3 is a flowchart illustrating a method of driving a smart mirror system according to an embodiment of the present invention.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those skilled in the art can easily implement them. The present invention will be described in detail by exemplifying specific embodiments in the drawings, since various modifications may be made and various embodiments may be provided. However, this is not intended to limit the present invention to a specific embodiment, it is to be understood to include all changes, equivalents, and substitutes included in the spirit and scope of the present invention.

Terms including ordinal numbers, such as first and second, may be used to describe various elements, but the elements are not limited by the terms. These terms are used only for the purpose of distinguishing one component from another component.

For example, without departing from the scope of the present invention, a first element may be referred to as a second element, and similarly, a second element may be referred to as a first element. The term and/or includes a combination of a plurality of related listed items or any of a plurality of related listed items.

Unless otherwise defined, all terms used herein, including technical or scientific terms, have the same meaning as commonly understood by one of ordinary skill in the art to which the present invention belongs. Terms as defined in a commonly used dictionary should be interpreted as having a meaning consistent with the meaning in the context of the related technology, and should not be interpreted as an ideal or excessively formal meaning unless explicitly defined in this application. Hereinafter, the present invention and preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings.

1 is a view showing a smart mirror according to an embodiment of the present invention, Figure 2 is a configuration diagram showing a smart mirror system according to an embodiment of the present invention.

Referring to Figures 1 and 2, the smart mirror system 100 according to an embodiment of the present invention is installed in the closet 200 to display the interior and the user on the screen like a mirror using a camera, and various sensors It is a system that provides information about clothing using. In addition, the smart mirror system 100 according to the present embodiment may be installed on a door or a wall.

The smart mirror system 100 includes a photographing unit 11, a display unit 12, a clothing image extraction unit 14, a body image extraction unit 15, a clothing data generation unit 16, an image synthesis unit 17, and a communication unit. (13), clothing classification unit 18, preference storage unit 41, clothing recognition unit 42, list display unit 43, weather analysis unit 21, weather matching unit 30, matching selection unit 51 ), a trend selection unit 52, a product recommendation unit 60, a wear analysis unit 70, a positive correction unit 44, and a negative correction unit 45.

The photographing unit 11 is composed of a camera installed in front of the display unit 12 and photographs a space in front of the display unit 12. The photographing unit 11 may photograph the front space of the display unit 12 and provide the same screen as the mirror on the display unit 12.

The display unit 12 displays a picture or image taken by the photographing unit 11 and may be formed of a flat panel display. The display unit 12 may be formed of various types of displays such as LCD and OLED, and may be formed of a display that can be hung on a wall or a window. The display unit 12 is a display that is hung on the front of a closet into which clothes are inserted. Can be done

The clothing recognition unit 42 may recognize clothing through wireless communication with a chip attached to the clothing. An RFID chip or a chip capable of wireless communication may be installed on the clothing, and the clothing recognition unit 42 Clothing stored in the wardrobe 200 may be recognized by sending and receiving information through communication.

The list display unit 43 displays a list of clothes accommodated in the closet 200, but may display the list in the form of a thumbnail. The list display unit 43 includes only a list of clothes accommodated in the closet 200 among the clothes owned by the user. It can be displayed, and according to the user's selection, the entire list of clothing held by the user can be displayed.

The clothing image extracting unit 14 extracts a clothing image from a photograph or video taken by a user wearing clothing. The clothing image extracting unit 14 analyzes the captured image, cuts out a portion corresponding to the clothing, converts it into an image and extracts it.

The body image extracting unit 15 extracts a body image of a person from the photographed photo or image. The body image extracting unit 15 analyzes the captured image, cuts a part corresponding to the external appearance of the lion's body, converts it into an image, and extracts it.

The clothing data generation unit 16 compares the extracted image with a previously stored image, and when it is determined as a new image, stores the extracted image and adds it to a new clothing list.

The image synthesizing unit 17 synthesizes the image of the clothing selected by the user from among the clothing images previously stored in the user's body image and loads it onto the display unit 12. The image synthesis unit 17 adjusts the size of the clothing image so that the clothing image fits the body image.

The communication unit 13 receives and transmits data by communicating with the server through wired or wireless communication. The communication unit 13 may transmit and receive weather information and clothing data information. In addition, data information on clothing worn by the user may be transmitted and received.

The clothing classification unit 18 stores the input use period of the clothing, the material of the clothing, and the use of the clothing, and classifies the clothing. The clothing classification unit 18 may classify clothing according to seasons, and classify the types into tops, bottoms, coats, jumpers, and the like.

The preference storage unit 41 analyzes the user's facial expression photographed by the photographing unit and stores information about clothing that the user prefers. The preference storage unit 41 analyzes the user's face photographed by the photographing unit 11 and classifies it as a preferred clothing when the user's expression is bright, and classifies it as non-preferred clothing when the user's expression is dark.

The wear analysis unit 70 may analyze a pattern of clothing worn by the user for a week and display it on the display unit 12. In addition, the wear analysis unit 70 may classify clothing that the user frequently wears as preferred clothing, and classify clothing that the user wears less frequently as clothing to be discarded. In addition, the wear analysis unit 70 may determine whether or not washing is necessary according to the number of times the user wears, and may create and display a list of clothes classified as clothes requiring washing.

The weather analysis unit 21 receives and analyzes weather data, and analyzes a trend of clothing with respect to temperature changes, seasons, and weather. The weather matching unit 30 selects and displays clothing matching the analyzed weather from the stored clothing image. The weather matching unit 30 includes a temperature matching module 31, a time matching module 32, and a rain matching module 33. ) Can be included.

The temperature matching module 31 may select clothes suitable for the temperature of the current time, and analyze the season to select clothes suitable for the current temperature of the current season. The time matching module 32 analyzes a change in temperature over time and selects and displays clothes for each time. The time matching module 32 may select clothing suitable for a temperature change according to the going out time input by the user. The rain matching module 33 selects clothing according to snow and rain. It can easily spoil or get wet, so you can choose clothing that won't damage snow and rain.

The matching selection unit 51 may select and display pre-stored clothing matching the clothing selected by the user. The matching selector 51 may select and display the clothes that best match the clothes selected by the user from among clothes held by the user in consideration of the color, pattern, and material of the clothes. For example, when a user selects a top, the matching selection unit 51 may select and display a bottom and an outer coat that best match the selected top.

The trend selection unit 52 provides data on a clothing trend at a preset period, selects and displays clothing products related to the trend selected by the user, and synthesizes and loads clothing selected by the user from among displayed clothing. The trend selection unit 52 may provide data on clothing trends such as lookbooks, fashion magazines, and Internet articles on a weekly, monthly, or quarterly basis. When the user selects a trend from the provided data, the trend selector 52 displays clothing products related to the selected trend. For example, when a user selects a check mooney from an article in which a checkered pattern is in fashion, the trend selection unit 52 may load products such as a coat, a T-shirt, and pants with a checkered pattern inserted into the display unit 12. In addition, the trend selection unit 52 may synthesize and load a product selected by the user with the user's body image.

The product recommendation unit 60 selects and recommends clothes sold in an internet shopping mall as clothes that can be matched with the clothes selected by the user, and synthesizes and loads them in the user's body image. When the user selects pants, the product recommendation unit 60 recommends a T-shirt product that matches the pants, synthesizes it with the user's body image, and loads the product on the display unit 12.

The product recommendation unit 60 may include a taste selection module 61, a sales amount selection module 62, a redundancy selection module 63, and a discount selection module 64. The taste selection module 61 analyzes a pattern of clothes that the user prefers, selects and loads clothes on sale. The taste selection module 61 may recommend and load a plurality of clothing products matching a clothing pattern that a user prefers.

The sales amount selection module 62 selects the clothing that has been sold most during a preset period, the overlap selection module 63 selects the clothing purchased by a buyer who has purchased the clothing selected by the user, and the discount selection module 64 You can select the apparel on sale among the apparel that the user prefers. The product recommendation unit 60 may load information of at least two or more overlapping products from the taste selection module 61, the sales amount selection module 62, the redundancy selection module 63, and the discount selection module 64.

When the product recommendation unit 60 combines and displays the clothing recommended by the product recommendation unit 60 with the user's body image, the positive correction unit 44 modifies and displays the user's body image to fit the clothing. The affirmative correction unit 44 modifies the user's body image such as increasing the user's height or thinning the body width so as to induce the purchase of a product, so that the user's body fits the recommended clothing.

When the clothing recommended by the product recommendation unit 60 is displayed so as to induce the purchase of the product, the negative correction unit 45 synthesizes and displays the clothing held by the user with the body image of the user. To display. The irregularity correction unit 45 induces dissatisfaction with the clothing held so that the recommended product can stand out.

As described above, in the smart mirror system 100 according to the present embodiment, since the user directly inputs clothing data and synthesizes and provides clothing or clothing products suitable for the user, the user can more easily select or purchase clothing.

Hereinafter, a method of driving a smart mirror system according to an embodiment of the present invention will be described. 3 is a flowchart illustrating a method of driving a smart mirror system according to an embodiment of the present invention.

2 and 3, the driving method of the smart mirror system according to the present embodiment includes a photographing step (S101), a clothing image extraction step (S102), a clothing data generation step (S103), and a composite display step (S104). ), clothing classification step (S105), matching selection step (S106), weather matching step (S107), product recommendation step (S108), positive correction step (S109), negative correction step (S110).

In the photographing step S101, clothing and a user are photographed using the photographing unit 11 installed in front of the display unit. In the photographing step S101, a user and clothing located in the front space of the display unit 12 may be photographed, and the same screen as a mirror may be provided on the display unit 12.

In step S102 of extracting a clothing image, a clothing image is extracted from a photograph or video taken by a user wearing clothing. In the clothing image extraction step (S102), the captured image is analyzed, the portion corresponding to the clothing is cut, imaged, and extracted.

In the clothing data generation step (S103), the extracted image is compared with a previously stored image, and if it is determined as a new image, it is stored and added to a new clothing list.

In the synthesis display step S104, the image of the clothing selected by the user from among the clothing images previously stored in the user's body image is synthesized and loaded onto the display unit 12. In the synthesis display step S104, the size of the clothing image is adjusted so that the clothing image fits the body image.

The clothing classification step S105 stores the input use period of the clothing, the material of the clothing, and the use of the clothing, and classifies the clothing. In the clothing classification step S105, clothing may be classified according to seasons, and types may be classified into tops, bottoms, coats, jumpers, and the like.

In the matching selection step S106, a pre-stored clothing matching the clothing selected by the user may be selected and displayed. The matching selection step S106 may select and display a clothing that best matches the clothing selected by the user from among clothing held by the user in consideration of the color, pattern, and material of the clothing. For example, when the user selects the top, the matching selection step S106 may select and display the bottoms and coats that best match the selected top.

In the weather matching step (S107), clothing matching the analyzed weather is selected and displayed from the stored clothing image. The weather matching step S107 may include a temperature matching step, a time matching step, and a rain matching step.

In the temperature matching step, clothing suitable for the temperature of the current time may be selected, and clothing suitable for the current temperature of the current season may be selected by analyzing the season. In the time matching step, a change in temperature over time is analyzed and clothing is selected and displayed by time. In the time matching step, clothing suitable for a temperature change according to a user's outing time may be selected. In the rain matching step, clothing is selected according to snow and rain. In the case of snow or rain, the clothing may be easily damaged or wet, so clothing that is not damaged by snow and rain may be selected.

In the product recommendation step S108, clothing that is sold in an internet shopping mall is selected and recommended as clothing that can be matched with the clothing selected by the user, and synthesized and loaded into the user's body image. In the case where the user selects pants and in the product recommendation step S108, a T-shirt product that matches the pants is recommended, synthesized with the user's body image, and loaded on the display unit 12.

The product recommendation step S108 may include a taste selection step, a sales volume selection step, a duplicate selection step, and a discount selection step. In the step of selecting a taste, the user selects and loads clothes on sale by analyzing a pattern of clothes that the user prefers. The taste selection step may recommend and load a plurality of clothing products matching a clothing pattern that a user prefers. The sales volume selection step selects clothing that has been sold the most during a preset period, the redundant selection module selects the clothing purchased by the buyer who purchased the clothing selected by the user, and the discount selection step is the clothing that is being discounted among the clothing that the user prefers. You can choose

In the positive correction step (S109), when the clothing recommended in the product recommendation step (S108) is synthesized and displayed on the user's body image, the user's body image is modified to fit the clothing and displayed. In the affirmative correction step, the user's body image is corrected such as increasing the user's height or thinning the body width so that the user's body fits the recommended clothing so as to induce the purchase of a product.

In the negative correction step (S110), when the clothing recommended by the product recommendation unit is displayed in order to induce the purchase of the product, the user's body image is negatively modified when the user's clothing is synthesized and displayed on the user's body image. Indicate. In the negative correction step (S110), dissatisfaction with the clothes held so that the recommended product can stand out is induced.

As described above, in the present specification and drawings, a preferred embodiment of the present invention has been disclosed, and although specific terms are used, this is only used in a general meaning to easily explain the technical content of the present invention and to aid understanding of the invention. , It is not intended to limit the scope of the present invention. In addition to the embodiments disclosed herein, it is apparent to those of ordinary skill in the art that other modified examples based on the technical idea of the present invention may be implemented.

100: smart mirror system
11: Filming Department
12: display
13: Communication Department
14: clothing image extraction unit
15: body image extraction unit
16: clothing data generation unit
17: image composition unit
18: clothing classification unit
21: Weather analysis unit
30: Weather Matching Unit
31: temperature matching module
32: time matching module
33: rain matching module
41: preferred storage
42: clothing recognition unit
43: list display
44: positive revision
45: negative revision
51: Matching selection unit
52: Trend selector
60: product recommendation section
61: taste selection module
62: Sales Volume Selection Module
63: redundant selection module
64: Discount Selection Module
70: wear analysis unit
200: wardrobe

Claims (13)

A photographing unit for photographing the front side;
A display unit that displays a picture or image taken by the photographing unit;
A clothing image extracting unit for extracting a clothing image from a photo or video taken by a user wearing clothing;
A body image extracting unit for extracting a body image of a person from the captured image;
A clothing data generation unit that stores the clothing image extracted by the clothing extraction unit;
An image synthesizing unit for synthesizing an image of a clothing selected by the user among the clothing images previously stored in the body image of the user and loading the image on the display unit; And
A communication unit for transmitting and receiving data;
Smart mirror system comprising a.
The method of claim 1,
Smart mirror system, characterized in that it further comprises a clothing classification unit for storing the input use period of the clothing, color, material, and use of the clothing and classifying the clothing.
The method of claim 2,
A smart mirror system, further comprising: a weather analysis unit receiving and analyzing weather data; and a weather matching unit selecting and displaying clothing matching the analyzed weather from the stored clothing image.
The method of claim 3,
The weather matching unit comprises a time matching module that analyzes a change in temperature over time and selects and displays clothing by time.
The method of claim 3,
The weather matching unit comprises a temperature matching module that selects and displays clothes according to temperature and a rain matching module that selects clothes according to snow and rain.
The method of claim 1,
A smart mirror system, characterized in that it further comprises a matching selector by selecting and displaying pre-stored clothing matching the user and the selected clothing.
The method of claim 1,
The display unit further comprises a trend selection unit that provides data on a clothing trend at a preset period, selects and displays clothing products related to the trend selected by the user, and synthesizes and loads clothing selected by the user from among the displayed clothing. Smart mirror system.
The method of claim 1,
A smart mirror, characterized in that it further comprises a preference storage unit that analyzes the user's facial expression photographed by the photographing unit to store information on clothing that the user prefers, and a wear analysis unit that analyzes and displays a pattern of clothing worn by the user for a week. system.
The method of claim 1,
The smart mirror system further includes a clothing recognition unit that is installed on the front of a closet in which clothes are accommodated, and recognizes clothes through wireless communication with a chip attached to the clothes, and a list display unit that displays clothes stored in the closet in the form of thumbnails. Smart mirror system, characterized in that.
The method of claim 1,
A smart mirror system, further comprising a product recommendation unit that selects and recommends clothing sold in an internet shopping mall as clothing that can be matched with the clothing selected by the user, and synthesizes and loads it in the user's body image.
The method of claim 10,
The product recommendation unit analyzes the pattern of clothing that the user prefers, a taste selection module that selects from among the clothing on sale, a sales volume selection module that selects from the clothing that has been sold most during a preset period, and the purchaser who purchases the clothing selected by the user A smart mirror system comprising: a redundant selection module for selecting one clothing and a discount selection module for selecting clothing that is being discounted from among clothing that the user prefers.
The method of claim 10,
The smart mirror system, further comprising: a positive correction unit for modifying and displaying the user's body image to fit the clothing when the clothing recommended by the product recommendation unit is synthesized and displayed with the user's body image.
The method of claim 10,
A smart mirror further comprising a negative correction unit configured to negatively modify and display the user's body image when the clothing recommended by the product recommendation unit is displayed and displayed by combining the clothing held by the user with the user's body image. system.

Images