KR102419934B1 - A half mirror apparatus - Google Patents

Abstract

According to an embodiment of the present invention, there is provided a half-mirror device, comprising: a half-mirror unit having preset transmittance and reflectance; a sensor unit that senses the user's voice; a display unit provided on a rear surface of the half mirror unit parallel to the half mirror unit and displaying an image; a communication unit for performing communication using at least one communication protocol; A storage unit in which the cosmetic kit is accommodated; a cosmetic kit recognition unit for recognizing the cosmetic kit stored in the receiving unit; and a processor for controlling the half mirror unit, the sensor unit, the display unit, the communication unit, the receiving unit, and the cosmetic kit recognition unit. including, wherein the processor recognizes the cosmetic kit stored in the receiving unit using the cosmetic kit recognition unit, searches for a makeup guide video using the cosmetic kit in real time, and displays the search result on the display unit, The makeup guide video included in the search result is limited to a pre-made video synchronized with the guide GUI (Graphic User Interface) for guiding the makeup area and makeup method consistent with the video content for each playback time, and using the sensor unit, the user , selects any one of the search results, plays the selected video on the first area of the display unit, and synchronizes with the playback of the selected video to display the guide GUI except for the first area. The display may be displayed on the second area so as to overlap the makeup target part of the user reflected on the hub mirror unit.

Description

Half mirror device {A HALF MIRROR APPARATUS}

The present specification proposes a half mirror device and a control method thereof.

A half mirror means a mirror in which the reflectance and transmittance are half and half (ie, about 50%).

A half-mirror is made by attaching a very thin layer of metal such as nickel, aluminum, or titanium to the glass surface, and it allows light to pass through. For this reason, the front of the half mirror has a reflectance similar to that of a general mirror, but when light is projected on the back of the half mirror, the light passes through the half mirror. As a result, the half-mirror becomes transparent, allowing the viewer to see through the half-mirror.

An object of the present specification is to propose an apparatus for providing various emotional services through a half mirror.

According to an embodiment of the present invention, there is provided a half-mirror device, comprising: a half-mirror unit having preset transmittance and reflectance; a sensor unit that senses the user's voice; a display unit provided on a rear surface of the half mirror unit parallel to the half mirror unit and displaying an image; a communication unit for performing communication using at least one communication protocol; A storage unit in which the cosmetic kit is accommodated; a cosmetic kit recognition unit for recognizing the cosmetic kit stored in the receiving unit; and a processor for controlling the half mirror unit, the sensor unit, the display unit, the communication unit, the receiving unit, and the cosmetic kit recognition unit. Including, wherein the processor recognizes the cosmetic kit stored in the receiving unit using the cosmetic kit recognition unit, searches for a makeup guide video using the cosmetic kit in real time and displays the search result on the display unit, The makeup guide video included in the search result is limited to a pre-made video synchronized with the guide GUI (Graphic User Interface) for guiding the makeup area and makeup method consistent with the video content for each playback time, and using the sensor unit, the user , selects any one of the search results, plays the selected video on the first area of the display unit, and synchronizes with the playback of the selected video to display the guide GUI except for the first area. The display may be displayed on the second area so as to overlap the makeup target part of the user reflected on the hub mirror unit.

According to an embodiment of the present invention, since the half mirror device includes a half mirror, it has the effect of providing a mirror function and a function as a picture frame at the same time.

In addition, since the half-mirror device according to an embodiment of the present invention also serves as a light stick, there is no need for a separate light stick, thereby reducing costs, and greatly improving unity and sense of belonging among fans through the light stick. have.

In addition, the half-mirror device according to an embodiment of the present invention has an effect of guiding a user to easily put on makeup by using the physical characteristics of the half-mirror.

In addition, the effects of the present invention are not limited to the above-described effects, and will be described below in detail with reference to each embodiment.

1 is a diagram illustrating a half mirror device according to an embodiment of the present invention.
2 illustrates a block diagram of a half mirror device according to an embodiment of the present invention.
3 is a diagram illustrating a control method of a half-mirror device according to an embodiment of the present invention.
4 is a diagram schematically illustrating a relationship with an external device/server according to an embodiment of the present invention.
5 is a diagram illustrating a support control system of a half-mirror device according to an embodiment of the present invention.
6 is a diagram illustrating a half-mirror device controlled by a management server/device according to an embodiment of the present invention.
7 is a diagram illustrating a half mirror device controlled by a management server/device according to an embodiment of the present invention.
8 is a diagram illustrating a half mirror device according to another embodiment of the present invention.
9 is a flowchart illustrating a makeup guide method of a half mirror device according to an embodiment of the present invention.
10 is a diagram illustrating a half-mirror device displaying a guide GUI and a makeup guide video according to an embodiment of the present invention.
11 is a view illustrating an example of photographing using a camera unit of a half-mirror device according to an embodiment of the present invention.
12 is a diagram illustrating a half-mirror device executing a preview function according to the embodiment of FIG. 11 .

Since the technology to be described below can have various changes and can have various embodiments, specific embodiments are illustrated in the drawings and described in detail. However, this is not intended to limit the technology described below to specific embodiments, and it should be understood to include all modifications, equivalents, and substitutes included in the spirit and scope of the technology described below.

Terms such as first, second, A, and B may be used to describe various components, but the components are not limited by the above terms, and only for the purpose of distinguishing one component from other components. used only as For example, a first component may be named as a second component, and similarly, the second component may also be referred to as a first component without departing from the scope of the technology to be described below. and/or includes a combination of a plurality of related listed items or any of a plurality of related listed items.

In terms of terms used herein, the singular expression should be understood to include a plural expression unless the context clearly dictates otherwise, and terms such as "comprises" include the described feature, number, step, operation, and element. , parts or combinations thereof are to be understood, but not to exclude the possibility of the presence or addition of one or more other features or numbers, step operation components, parts or combinations thereof.

Prior to a detailed description of the drawings, it is intended to clarify that the classification of the constituent parts in the present specification is merely a division according to the main function that each constituent unit is responsible for. That is, two or more components to be described below may be combined into one component, or one component may be divided into two or more for each more subdivided function. In addition, each of the constituent units to be described below may additionally perform some or all of the functions of other constituent units in addition to the main function it is responsible for. Of course, it can also be performed by being dedicated to it.

In addition, in performing the method or operation method, each process constituting the method may occur differently from the specified order unless a specific order is clearly described in context. That is, each process may occur in the same order as specified, may be performed substantially simultaneously, or may be performed in the reverse order.

1 is a diagram illustrating a half mirror device according to an embodiment of the present invention.

Referring to FIG. 1 , a half mirror device 100 of the present invention is configured to include a half mirror. The half-mirror device 100 may be configured to include a half mirror and a light source for projecting light to a rear surface of the half mirror.

When the light source does not project light to the half-mirror, the half-mirror acts as a mirror by reflecting the light (refer to FIG. 1(a)). On the other hand, when the light source projects light to the half mirror, the half mirror may be (semi)transparent by transmitting the light.

In the present specification, various emotional services can be provided to users by using the characteristics of the half mirror.

For example, the user may pre-store specific photos (eg, family photos, companion animal photos, star photos) inside the half-mirror device 100 , and usually use the half-mirror device 100 as a mirror. While in use, by manipulating the half-mirror device 100 so that the light source projects light to the half-mirror, it can also be used as a picture frame (refer to FIG. 1(b) ).

Hereinafter, a detailed configuration of the half-mirror device 100 will be described.

2 illustrates a block diagram of a half mirror device according to an embodiment of the present invention.

Referring to FIG. 2 , the half mirror device includes a processor 210 , a half mirror unit 220 , an LED unit 230 , a sensor unit 240 , a communication unit 250 , a housing unit 260 , and a display unit 270 . , a memory unit 280 and/or a power supply unit (not shown). Of course, at least one of the above components may be excluded or a new component may be included according to an embodiment.

The processor 210 may communicate with the units/components of the half-mirror device and control them by transmitting and receiving various control signals. In particular, the processor 210 may control units/configurations of the half-mirror apparatus to perform various embodiments proposed in the present specification. Accordingly, in this specification, the processor 210 may be described as the same as the half-mirror device.

The half-mirror unit 220 corresponds to the above-described half-mirror. The front surface of the half mirror unit 220 is exposed to the outside to serve as a mirror, and the housing unit 260 and/or the display unit 270 are parallel to the half mirror unit 220 on the rear/rear side of the half mirror unit 220 . is placed

The LED (Light Emitting Diode) unit 230 serves as a light source for projecting light to the half mirror unit 220 and may include a plurality of LEDs. The plurality of LEDs may be disposed on the back side (or inside) of the half-mirror unit 220 at predetermined intervals along the boundary line of the half-mirror unit 220 , and emit light in a predetermined emission pattern under the control of the processor 210 . can Here, the emission pattern may be defined by the emission color, emission timing, emission period, and/or emission interval of each of the plurality of LEDs. Accordingly, the LED unit 230 not only serves as a light source for projecting light to the half-mirror unit 220, but may also function as a light rod commonly used by fans to support a star. An embodiment of the light stick will be described in detail below with reference to FIGS. 6 to 7 .

The sensor unit 240 may sense various user inputs including at least one sensor, and transmit the sensing result to the processor 210 . Here, the user input may include a touch input, a motion (or vibration) input, and/or a voice input. In particular, the sensor unit 240 may sense a user's preset voice input and/or motion (or vibration) input, and transmit the sensing result to the processor 210 .

The communication unit 250 may perform communication using at least one communication protocol. Here, the at least one communication protocol may include Bluetooth, Long Term Evolution (LTE), 5 Generation (5G), Near Field Communication (NFC), and/or Wireless Fidelity (WiFi). In particular, the communication unit 250 may receive an image to be displayed on the display unit 270 and/or a control signal/information regarding a light emission pattern of the LED unit 230 using at least one communication protocol.

The housing unit 260 may be provided on the back side (or inside) of the half-mirror unit 220 in parallel to the half-mirror unit 220 to perform a function of accommodating a picture. A sliding member may be installed in the housing 260 to slide inward or outward of the half-mirror device. Accordingly, the user can expose the housing unit 260 to the outside by sliding the housing unit 260 to the outside of the half-mirror device, and the picture is stored in the exposed housing unit 260 and then slides inside again. photos can be stored in the half-mirror device.

The display unit 270 may be provided on the back side (or inside) of the half mirror unit 220 in parallel with the half mirror unit 220 to perform a function of displaying an image. In this case, the displayed image may be an image transmitted from an external device/server or an image directly searched for by the half-mirror device. Detailed examples related thereto will be described below.

The memory unit 280 may store various information/data/signals. In particular, the memory unit 280 may store a control signal/information regarding an image and/or a light emission pattern received from the outside.

3 is a diagram illustrating a control method of a half-mirror device according to an embodiment of the present invention.

The user may control the half-mirror apparatus 100 by performing various user inputs.

As an embodiment, referring to FIG. 3 , the user may activate the LED unit of the half-mirror device 100 by performing a preset voice input. For example, the user may perform a voice input 'Mirror, mirror, who is the prettiest in this world?' It may be exposed through the half mirror part. A preset voice input may be set by a user in advance, and the half-mirror apparatus 100 may provide a user interface for setting a preset voice input to the user.

And/or, as another embodiment, the user may activate the LED unit of the half-mirror device 100 by performing a preset motion/vibration input. For example, the user can 'knock' as if knocking on the half-mirror, and the half-mirror device 100 recognizes this and activates the LED so that the image/photo inside the half-mirror is exposed through the half-mirror. can The preset motion/vibration input may also be preset by the user like the preset voice input, and the half-mirror apparatus 100 may provide a user interface for setting the preset vibration/motion input to the user.

If the half-mirror device 100 is provided with a display unit, the user may change the image displayed on the display unit and/or the light emission pattern of the LED unit by performing a preset voice input and/or motion (or vibration) input. . This may also be set by the user, and a user interface for setting may be provided to the user in advance.

4 is a diagram schematically illustrating a relationship with an external device/server according to an embodiment of the present invention.

Referring to FIG. 4 , the half-mirror apparatus 100 may communicate with an external device (eg, a user terminal) 400 and/or an external server 410 through a communication unit. In particular, the half-mirror device 100 may be paired with a specific device (eg, a user/administrator terminal) 400 to perform one-to-one communication in real time.

The half-mirror device 100 performs communication (or is paired) with the external device 400 to receive a control signal/information regarding an image to be displayed and/or a light emission pattern from the device 400 , and display based on this. It can control the part and the LED part. Here, the image and the emission pattern may be received by the half-mirror device 100 in a mutually synchronized state.

The external device 400 may be a device in which an application/software/program that provides an image (and/or a light emission pattern) that the user wants to provide/update (in real time) is installed. The user can set a keyword of an image to be provided through the corresponding application/software/program, and the external device 400 searches for the keyword on the web (real-time), and uses the half-mirror device for the search result image (real-time) can send it In this case, the external device 400 may transmit a corresponding search result image and/or a specific emission pattern synchronized thereto to the half-mirror device 100 . For example, the user may set 'BTS' as a keyword through a user interface provided by a specific application of the external device 400 . In this case, the external device 400 may search for BTS on the web in real time and transmit the searched image to the half mirror device 100 (in real time).

And/or, the external device 400 may be a device in which an application/software/program for providing only specific content is installed. In this case, the external device 400 continuously/real-time receives specific content from the application/software/program management device/server 410 instead of performing a web search, and delivers it to the half-mirror device 100 . have. For example, a user may install a 'BTS fan-only application' on the external device 400, and various contents related to BTS may be provided to the external device 400 from the management server 410 of the application. . At this time, the application can be managed directly by the BTS entertainment agency, and can be operated in a way that selectively provides undisclosed materials that are not disclosed to the outside media only to paid members who have paid the amount.

The above-described application/software/program may be directly installed on the half-mirror device 100 instead of the external device 400 . In this case, the half-mirror device 100 may directly determine an image and/or a light emission pattern by performing a web search or communicating with the application/software/program management server 410 .

As described above, the half-mirror device 100 of the present invention can also function as a light stick, and specific embodiments thereof will be described later with reference to FIGS. 5 to 7 . In particular, it is assumed that the embodiment of FIGS. 5 to 7 is a situation in which the user has visited a concert of a specific singer.

5 is a diagram illustrating a support control system of a half-mirror device according to an embodiment of the present invention.

Referring to FIG. 5 , a plurality of half-mirror devices 510-1 to 510-N may be connected/paired with one management server/device. Here, the plurality of half-mirror devices 510-1 to 510-N may correspond to half-mirror devices of spectators who are watching a specific concert (or performance), and the management server/device 500 performs the concert. It may correspond to the server/device of the administrator/personnel. In this case, the management server/device 500 may transmit a control signal regarding an image and/or a light emission pattern to the plurality of half-mirror devices 510-1 to 510-N in real time, and the plurality of half-mirror devices (510-1 to 510-N) may operate based on such a control signal. In this case, the transmitted image and/or the emission pattern may be transmitted in a mutually synchronized state (eg, the first emission pattern is projected during the display of the first image and the second emission pattern is projected during the display of the second image).

6 and 7 are diagrams illustrating a half-mirror device controlled by a management server/device according to an embodiment of the present invention.

Referring to FIG. 6 , the manager may determine an image and/or a light emission pattern suitable for an atmosphere of a performance/song currently in progress, and transmit a control signal therefor to the half-mirror devices of the audience. For example, during the performance of the first song, the control signals for the first image 610-1 and the first emission pattern 610-2 are transmitted to the half mirror devices, and during the performance of the second song, the second image 620-1 and a control signal related to the second emission pattern 620-1 may be transmitted to the half-mirror devices. In other words, the half mirror devices located in the concert (or performance) venue can be unified and controlled by the manager. and a sense of unity. In this case, the manager may provide a live performance/concert live broadcast screen in real time to their half-mirror device as the image for the back seat spectators who cannot see the performance well.

Referring to FIG. 7 , the manager may provide an image including a notice or notification message related to a concert (or performance) currently in progress to the half-mirror devices of the spectators. Since a notice or notification message is provided to all half-mirror devices located in the concert (or performance) venue, confusion and safety accidents among visitors can be reduced, and the manager can more safely and easily lead the scene.

8 is a diagram illustrating a half mirror device according to another embodiment of the present invention.

The half-mirror device proposed in the present specification may be implemented in the form of a hand mirror as described above, but may also be implemented in the form of a cosmetic case as illustrated in this figure.

Referring to FIG. 8 , the half mirror device in the form of a cosmetic case may include a half mirror unit, a sensor unit, a display unit, a communication unit, a receiving unit, a cosmetic kit recognition unit, and a processor. In particular, in the half-mirror device in the form of a cosmetic case, the half-mirror unit and the display unit may be provided in the upper case unit as illustrated in this drawing, but the present invention is not limited thereto and may be provided in the lower case unit according to embodiments. For the rest of the configuration except for the receiving unit and the cosmetic kit recognition unit, the above-described description may be applied in the same manner, and thus redundant descriptions will be omitted.

The accommodating part is an area/configuration in which the cosmetic kit is accommodated, and an internal space corresponding to the volume of the cosmetic kit for accommodating the cosmetic kit may be formed.

The cosmetic kit is a container/kit containing cosmetics used for user's makeup, and may be accommodated in the receiving unit by being mounted/inserted into the receiving unit so that the lower part of the cosmetic kit is accommodated/received in the inner space of the receiving unit. Cosmetic kits are very diverse depending on the type of cosmetics contained inside (for example, cosmetic kits for eye color makeup, cosmetic kits for eyebrow makeup, cosmetic kits for cheek makeup, cosmetic kits for lip makeup, cosmetic kits for skin makeup, etc.) There may be, and the user can use the cosmetic kit by selectively inserting / storing the cosmetic kit in the receiving part according to the part to be made up.

The cosmetic kit recognition unit may recognize the cosmetic kit accommodated in the receiving unit using at least one recognition means. For example, a Quick Response (QR) code containing various product information about the cosmetic kit (e.g. product name, product type, product unique identification number, product brand, product vendor, country of manufacture, product manufacturing date, etc.); A barcode, etc. may be displayed on the outside of the cosmetic kit, or it may be embedded in a near field communication (NFC) chip and embedded in the cosmetic kit. can That is, the cosmetic kit recognition unit may recognize the cosmetic kit accommodated in the receiving unit based on a specific code recognition unit or a short-range communication protocol, and the present invention is not limited to the above-described embodiment.

In addition, the half-mirror device may further include a camera unit for photographing an image according to an embodiment, and an embodiment of using the camera unit will be described below in detail with reference to each drawing.

The half-mirror unit of the half-mirror device can basically serve as a mirror to reflect the user's makeup, and the display unit allows the user to apply makeup more easily and better based on the user's face reflected in the half-mirror unit. You can perform various functions to guide you so that you can do it. This makeup guide embodiment will be described in more detail below with reference to FIGS. 9 to 12 .

9 is a flowchart illustrating a makeup guide method of a half mirror device according to an embodiment of the present invention. 10 is a diagram illustrating a half-mirror device displaying a guide GUI and a makeup guide video according to an embodiment of the present invention.

Referring to FIG. 9 , first, the half-mirror device may recognize the cosmetic kit accommodated in the receiving unit using the cosmetic kit recognition unit ( S901 ), and the recognition method is as described above in FIG. 8 .

Next, the half-mirror device may search the makeup guide video using the cosmetic kit in real time and display the search result on the display unit (S902). More specifically, the half-mirror device includes product information (eg, product name, product type, product unique identification number, product brand, product vendor, product manufacturing country, and product manufacturing date) of the cosmetic kit recognized using the cosmetic kit recognition unit. At least one) may be searched for on a video platform (eg, YouTube or a platform for providing videos related to makeup), and the search result may be displayed through the display unit. In this case, the search results may be provided in order of popularity and search.

In this case, the video provided as a search result may be limited to a video that is pre-produced in synchronization with the guide GUI proposed in this specification. Here, the guide GUI means a GUI provided/displayed to visually guide the makeup method and makeup area so that the user can easily understand the makeup method and the makeup area, and may be displayed in synchronization with the contents of the video for each playback time.

For example, in the first playback section of the makeup guide video, when the content of applying makeup on the tail of the eyelids using the second color of the makeup kit is played, the half-mirror device 1000 displays as illustrated in FIG. 10 . The guide line 1030 indicating the tail region of the eyelids and the second color information 1040 may be displayed as a guide GUI. The guide GUIs 1030 and 1040 displayed on the display unit (not shown) pass through the half mirror 1010 so that the user can recognize it from the outside.

The guide GUI (in particular, a guide line indicating the makeup area) can be output based on the outline extracted from the user's actual makeup target area (eg, eyes, nose, mouth, cheeks, forehead, eyebrows, chin, etc.). have. Although the width, width, length, shape, etc. of the makeup target area are all different for each user, if the guide GUI is provided assuming the same size of the makeup target area, efficiency/usability as a makeup guide is inevitably reduced. Accordingly, the half-mirror device extracts an outline for each makeup target area (eg, eyes, nose, mouth, cheeks, face, forehead, eyebrows, chin, etc.) from the user's face image obtained in advance, and the extracted outline By providing a guide GUI based on , it is possible to provide a more efficient user-customized makeup guide. Providing the guide GUI based on the outline not only means providing the guide GUI based on the position of the outline, but also scaling and providing the guide GUI based on the size/size of the outline. For example, if the initial setting/input horizontal size of the guide GUI is 3 cm, but the horizontal size of the outline is 5 cm, the horizontal size of the guide GUI may be scaled to 5 cm and provided based on the position of the outline.

The user may position his/her makeup target portion to be reflected on the half-mirror unit according to the extraction outline displayed through the half-mirror unit, and may apply makeup according to the guide GUI provided based on the extraction outline. For example, as shown in FIG. 10 , after the eyes are positioned so that the eyes are reflected on the half mirror part according to the eye extraction outline displayed through the half mirror part, the eyelid makeup area is indicated according to the guide of the guide GUI. Makeup can be performed by applying color 2 of the cosmetic kit within the guidelines. As a result, the guide GUI may be displayed at least partially overlapping the user's makeup target region.

The guide GUI may be produced through an application/program implemented to perform the embodiment provided in this specification, and may be synchronized with the makeup guide video. A user (especially a makeup guide video maker) divides a makeup guide video into a plurality of playback sections according to the content of each playback time through these applications/programs, and sets a guide GUI to be provided for each playback section, making it easy to create a makeup guide video and a guide GUI. can be synchronized. The synchronized makeup guide video and the guide GUI may be uploaded to the server of the application/program in synchronization/connection with each other, and may be provided as a search result of step S902.

Next, the half-mirror device may sense the user's voice by using the sensor unit to select one of the moving images from the search results (S903).

Finally, the half-mirror device may reproduce the selected video on the first area of the display unit, and display the guide GUI on the second area except for the first area in synchronization with the reproduction of the selected video (S904). For example, as shown in FIG. 10 , the half-mirror apparatus 1000 includes guide GUIs 1030 and 1040 (and an outline 1020 ) on the upper side (first area) of the display unit (not shown), and the lower side of the display unit (not shown). In the (second area), the selected video 1050 may be displayed, respectively.

Video playback may be controlled based on a user's voice. For example, motions related to video playback, such as playback, pause, and next/previous video playback of a video, may be controlled based on a user's voice command.

11 is a view illustrating an example of photographing using a camera unit of a half-mirror device according to an embodiment of the present invention. 12 is a diagram illustrating a half-mirror device executing a preview function according to the embodiment of FIG. 11 .

The outline of the makeup target part of the user 1130 may be extracted from the face image of the user inputted by the user in advance, but according to an embodiment, the image is captured in real time using the camera unit 1120 provided in the half-mirror device 1110 . may be extracted.

In more detail, the half-mirror device 1110 may further include a camera unit 1120 that captures an image according to an embodiment, and activates the camera unit 1120 to obtain a face image of the user 1130 . can In particular, the half-mirror device 1110 may obtain a face image of the user 1130 by activating the camera unit 1120 when the video playback starts, and extract the outline of the makeup target region 1140 . The outline extracted in this way may be output together with the guide GUI described above, and may be used as a reference line of the guide GUI. The extracted outline may be enlarged and output to fit the size of the first area of the display unit.

In addition, the half-mirror device 1110 may provide a preview function of the appearance of makeup according to the video selected by the user 1130 . To this end, it is premised that the makeup result image of the completed makeup for each video is stored in association with each video in advance. From the makeup result image stored in association with each moving picture, the half-mirror device 1110 may extract only the makeup area to generate a preview GUI. The makeup result image may be stored by a user (particularly, a video maker) in association with each video of each makeup guide. Next, the half-mirror device 1110 activates the camera unit 1120 to capture the face image of the user 1130 in real time to obtain the relative position coordinates of the makeup target part 1140 in the half-mirror unit. have. For example, when the makeup target part is the eye 1140 , the half-mirror device 1110 recognizes the eyes 1140 among the face images of the user 1130 obtained by activating the camera unit 1120 , and the entire face The relative position coordinates of the eye 1140 in the image may be acquired in real time. In addition to the relative position coordinates, the half-mirror device 1110 may also extract the outline of the eye 1140 in real time.

The half-mirror device 1110 converts/scales the relative position coordinates obtained in real time into the relative position coordinates on the display unit screen to recognize the relative position of the user's makeup target part 1140 reflected on the display unit and the half mirror unit. can The half-mirror apparatus 1110 may display the previously generated preview GUI on the converted display screen coordinates after it is assumed that there is a makeup target part in the converted relative position coordinates. In this case, the half-mirror device 1110 may use the outline extracted in real time together with the relative position coordinates of the makeup target region 1140 in the preview GUI in order to more accurately apply the preview GUI. More specifically, the half-mirror device 1110 assumes that there is a makeup target area 1140 in the form of an outline extracted in the relative position coordinates obtained in real time, and then applies the preview GUI generated prior to the outline in advance. It is also possible to display a view GUI.

As such, according to the present embodiment, the half-mirror device 1110 tracks the makeup target part 1140 of the user 1130 in real time and applies the preview GUI to the makeup target part 1140, as shown in FIG. Likewise, even though the actual user has not yet put on makeup, the user 1130 may appear as if the makeup has been applied through the half-mirror device 1110 . The user 1130 can easily find and select a video guiding a makeup method suitable for him/her by applying a makeup method for each video in advance through such a preview function. According to the present embodiment, only the preview GUI (makeup image) is displayed without the user 1130 being displayed on the display unit, and the face of the user 1130 reflected on the half mirror unit and the preview GUI overlap each other. As a result, an effect similar to that of applying makeup occurs.

Meanwhile, although not shown in the drawings, the half-mirror device proposed in the present specification may record a user's makeup situation in real time during the playback time of the makeup guide video to generate a video.

Cosmetics and makeup methods are very diverse, so it is very difficult for a user to remember a specific makeup method every time. Therefore, even if the user sees the same makeup guide video and puts on makeup, the actual makeup result will be very different, for example, if a different cosmetic is used in the middle or if the makeup is applied by applying a part different from the guide content of the actual video. Therefore, even if the user wants to do the same makeup as on a specific day, it is difficult to remember in detail the specific makeup order/method and cosmetics used at that time, so it is very difficult to implement the same. In order to solve this problem, the half-mirror device according to an embodiment of the present specification generates a video by recording a makeup situation while a user is putting on makeup, and uses the generated video as a makeup guide video for a currently stored cosmetic kit. It can be stored in the memory unit. The makeup guide video stored in the memory unit may be provided together with other videos as a makeup guide video search result for the corresponding cosmetic kit later.

To this end, the half-mirror device may activate the camera unit to record the makeup situation of the user in real time when the reproduction of the makeup guide video selected by the user is started. In this case, the half-mirror device may record not only the makeup situation of the user, but also the display details of the guide GUI currently being output to the display unit. The guide GUI recorded in this way may be automatically synchronized with the playback of a video currently being recorded and stored together with the video in the memory unit. The reason that the guide GUI of the currently playing makeup guide video is extracted and not synchronized with the recorded video is inconsistent with the actual user's makeup situation because the guide GUI is produced in synchronization with each playback section of the makeup guide video. This is because they are very likely to do it (especially if the user puts on makeup while performing playback control-related actions such as pause, look back, look forward, etc.). In order to prevent such discrepancy, the half-mirror device may record the display details of the guide GUI in an actual makeup situation, and mutually synchronize the guide GUI and the recorded video based on the display details of the guide GUI. The guide GUI thus completed can display the makeup situation of the user in accordance with the playback contents of the recorded video, and the user can easily implement the same makeup with reference to this.

The half-mirror device may stop recording by inactivating the camera unit after acquiring the face image of the user at the end of playback of the makeup guide video selected by the user, and may generate the recorded makeup situation as a video. After synchronizing the generated video with the guide GUI display details, the half-mirror device may designate a user's face image acquired at the end of video playback as a thumbnail for the video and store it in the memory unit.

Furthermore, the half-mirror device according to another embodiment of the present specification may determine whether correction makeup is necessary and inform the user of the need. Since the user not only continuously moves the facial muscles, but also secretions such as sweat and sebum are continuously secreted through the skin, the makeup may be deformed over time and may be in a state requiring correction makeup. Accordingly, the half-mirror device recognizes the user's face image acquired when the video playback expires as the final makeup image, activates the camera unit (in particular, whenever the half-mirror device is opened) to acquire the user's face image, and obtains A face image of a user and a final makeup image can be compared in real time for each makeup target area. According to the comparison result, the half-mirror device can recognize a makeup target area that does not match more than a preset ratio as an area requiring correction makeup, and provides information on the recognized area (eg, the eyeliner is smeared a lot! Correction) guidance message such as I think this is necessary) can be displayed using the display unit. The half-mirror device may determine/recognize whether or not correction makeup is required by comparing the saturation of each image to be makeup-targeted, the size of the makeup area, color, brightness, saturation, brightness, and the like of both images during comparison.

Although each drawing has been described separately for convenience of description, it is also possible to design to implement a new embodiment by merging the embodiments described in each drawing. In addition, the present invention is not limited to the configuration and method of the embodiments described as described above, but the above-described embodiments are configured by selectively combining all or part of each embodiment so that various modifications can be made. it might be

In addition, although preferred embodiments have been illustrated and described above, the present specification is not limited to the specific embodiments described above, and those of ordinary skill in the art to which the specification belongs without departing from the gist of the claims Various modifications are possible by the person, of course, these modifications should not be individually understood from the technical spirit or perspective of the present specification.

210: processor
220: half mirror unit
230: LED unit
240: sensor unit
250: communication department
260: housing unit
270: display unit
280: memory unit

Claims (6)

In the half mirror device,
having a predetermined transmittance and reflectance, a half mirror unit;
a sensor unit that senses the user's voice;
a display unit provided on a rear surface of the half-mirror unit in parallel to the half-mirror unit to display an image;
a communication unit for performing communication using at least one communication protocol;
A storage unit in which the cosmetic kit is accommodated;
a cosmetic kit recognition unit for recognizing the cosmetic kit stored in the receiving unit; and
a processor for controlling the half mirror unit, the sensor unit, the display unit, the communication unit, the receiving unit, and the cosmetic kit recognition unit; including,
The processor is
Recognizing the cosmetic kit accommodated in the receiving unit using the cosmetic kit recognition unit,
A makeup guide video using the cosmetic kit is searched in real time and the search result is displayed on the display unit,
The makeup guide video included in the search result is limited to pre-produced videos synchronized with the guide GUI (Graphic User Interface) for guiding the makeup area and makeup method consistent with the video content for each playback time,
Sensing the user's voice using the sensor unit, selecting any one video from the search results,
The selected video is reproduced on the first area of the display unit, and the guide GUI is overlapped with the makeup target part of the user reflected on the half mirror in a second area except for the first area in synchronization with the reproduction of the selected video. A half-mirror device that displays as much as possible. The method of claim 1,
a camera unit for taking an image; further comprising,
The processor is
Obtaining the face image of the user using the camera unit,
extracting the outline of the makeup target part from the user's face image,
Displaying the extracted outline and the guide GUI,
The guide GUI is displayed to guide a makeup area and a makeup method corresponding to the video content for each playback time based on the extracted outline. 3. The method of claim 2,
The processor is
By activating the camera unit to capture the face image of the user in real time to obtain the relative position coordinates of the makeup target in the half mirror unit,
A preview GUI is generated by extracting the makeup area of the makeup target area from the makeup result image previously linked with the selected video using the display unit, and the preview GUI is displayed in the area of the display unit corresponding to the obtained relative position coordinates. A half-mirror device that displays a viewing GUI. 4. The method of claim 3,
a memory unit for storing data; further comprising,
The processor is
When the playback of the selected video starts, the camera unit is activated to record the makeup situation of the user in real time,
Record the display details of the guide GUI together with the recording of the makeup situation,
After acquiring the face image of the user at the playback expiration time of the selected video, the camera unit is deactivated to stop the recording, and the recorded makeup situation is created as a video,
After synchronizing the generated video with the guide GUI display details, the obtained user's face image is designated as a thumbnail and stored in the memory unit. 5. The method of claim 4,
The video stored in the memory unit is added as a real-time search result of a makeup guide video using the cosmetic kit, a half mirror device. 6. The method of claim 5,
The processor is
Recognizing the user's face image acquired when the playback of the selected video expires as the final makeup image,
Activating the camera unit to obtain the user's face image, and comparing the obtained user's face image and the final makeup image in real time for each makeup target part,
As a result of the comparison, the makeup target area that does not match more than a preset ratio is recognized as an area requiring correction makeup,
The half-mirror device for displaying information on the recognized area using the display unit.

Images