KR20210081526A - Virtual beauty cosmetic apparatus - Google Patents

Abstract

A virtual cosmetic surgery device for allowing anyone to easily perform virtual cosmetic surgery processing on a face region is proposed. The proposed device, which is a device for providing a virtual cosmetic surgery service to a customer entering a booth, includes: a viewpoint guide lamp unit for indicating a moving viewpoint that has to be gazed by the customer; an image input unit for inputting three-dimensional face image data of a face of the customer moving along the viewpoint guide lamp unit to a control unit; the control unit for generating an initial three-dimensional face image based on the three-dimensional face image data; a customizing unit for performing at least one of surgery and decoration of the initial three-dimensional face image and generation of an avatar; and a display and input unit for displaying a transformation screen for the surgery, a decoration screen for the decoration, and an avatar generation screen for the generation of the avatar, displaying a three-dimensional face image customized by the customizing unit, and inputting an item selection of the customer on the screens.

Description

Virtual beauty cosmetic apparatus

The present invention relates to a virtual cosmetic cosmetic apparatus, and more particularly, to a virtual cosmetic cosmetic apparatus that allows users to try coordinating their own face.

With the rapid development of modern science and civilization, people's lifestyles have been diversified and individualized, and as a result, consumption expenditures related to their appearance and body are rapidly increasing. This phenomenon is more prominent in the occupational class where many people have to be dealt with, such as in the service industry or sales job.

For this reason, interest in facial plastic surgery is increasing, and facial cosmetic surgery is performed in plastic surgery and cosmetic surgery.

In general, plastic surgery or cosmetic surgery shows a virtual image after plastic surgery to a customer using image processing. Here, the virtual image must accurately represent the customer's face after surgery. Therefore, the size of the program to be processed, the processing time, and the user interface were not given much importance.

However, the conventional cosmetic surgery system has a problem in that it takes a considerable amount of time to process because the professional element is strong and the emphasis is on accurately displaying the deformation result.

In addition, there is a problem in that the system including the deformation program is very expensive, and the operation is very complicated, so that the user is limited to those who are familiar with such a cosmetic cosmetic system.

Prior Art 1: Republic of Korea Patent Publication No. 10-2014-0133903 (Automatic scanner and method for three-dimensional digitization of parts around the human head) Prior Art 2: Republic of Korea Patent Publication No. 10-2019-0042493 (System and method for automatically generating face correction design and application protocol for handling identifiable facial deviations) Prior art 3: Republic of Korea Patent Publication No. 10-2001-0113301 (Beauty management service system using the Internet)

The present invention has been proposed in order to solve the above-described problems in the prior art, and an object of the present invention is to provide a virtual cosmetic surgery apparatus that allows anyone to easily perform a virtual cosmetic surgery process on their face.

Another object of the present invention is to provide a virtual cosmetic surgery apparatus capable of generating an avatar in the form of one's own face, using the avatar in a game, and generating an image using the avatar having one's own face. .

In order to achieve the above object, a virtual cosmetic cosmetic device according to a preferred embodiment of the present invention is a device that provides a virtual cosmetic cosmetic service to a customer who has entered the booth, and displays a moving point that the customer should look at. a point of view guide lamp unit; an image input unit for inputting three-dimensional face image data of a customer's face moving along the viewpoint guide lamp unit to the controller; a controller for generating an initial three-dimensional face image based on the three-dimensional face image data; a customizing unit performing at least one of shaping and decorating the initial three-dimensional face image and generating an avatar; and displaying a deformable screen for the cosmetic surgery, a decorating screen for decorating, and an avatar generating screen for generating the avatar, displaying a three-dimensional face image customized in the customizing unit, and a menu of the customer on the screens. and a display and input unit for inputting a selection.

The customizing unit may include: a forming unit that transforms the initial three-dimensional face image according to the customer's menu selection; a decorating unit for decorating the initial three-dimensional face image or the three-dimensional face image that has undergone the shaping unit according to the customer's menu selection; and an avatar generating unit configured to generate an avatar according to the customer's menu selection based on the 3D face image or the initial 3D face image that has undergone at least one of the shaping unit and the decorating unit.

The shaping unit may change at least one of a face shape, eyes, nose, mouth, and facial beauty of the initial three-dimensional face image.

A button for each part, a plurality of presets for the selected part, and a detailed adjustment slider for the selected part are displayed on the deformation screen, and the shaping unit selects a face shape button from the button for each part and selects a face from among the plurality of presets. When a shape preset is selected and detailed adjustments for the selected region are input through the detailed adjustment slider, the face shape of the initial 3D face image may be changed based on the selected information and the input information.

On the deformation screen, a button for each part, a plurality of presets for the selected part, and a detailed adjustment slider for the selected part are displayed, and the shaping unit is configured such that an eye button is selected from the button for each part and any one of the presets is preset. is selected and detailed adjustment of the selected region is input through the detailed adjustment slider, the eyes of the initial 3D face image may be deformed based on the selected information and the input information.

On the deformation screen, a button for each part, a plurality of presets for the selected part, and a detailed adjustment slider for the selected part are displayed, and the shaping unit is configured such that a nose button is selected from the button for each part and any one of the presets is preset. is selected and detailed adjustment of the selected region is input through the detailed adjustment slider, the nose of the initial 3D face image may be deformed based on the selected information and the input information.

A button for each part, a plurality of presets for the selected part, and a detailed adjustment slider for the selected part are displayed on the deformation screen, and the shaping unit selects a mouth button from the button for each part and presets any one of the plurality of presets. is selected and detailed adjustment of the selected region is inputted through the detailed adjustment slider, the mouth of the initial 3D face image may be deformed based on the selected information and the inputted information.

On the modified screen, a button for each part, a plurality of presets for the selected part, and a detailed adjustment slider for the selected part are displayed, and the shaping unit selects a facial beauty button from the button for each part and selects one pupil from among the plurality of presets. When a preset is selected and detailed adjustment of the selected part is input through the detailed adjustment slider, the facial beauty of the initial 3D face image may be changed based on the selected information and the input information.

The decorating unit may decorate at least one of eyebrows, hair, eye shadow, eye line, eyelashes, cheek touch, and lip of the initial three-dimensional face image or the three-dimensional face image passed through the molding unit.

On the decorating screen, a button for each part, a plurality of presets for the selected part, and a color palette for the selected part are displayed, and the decorating unit includes an eyebrow button selected from the button for each part, and any one eyebrow preset from the plurality of presets. When a color is selected and any one color is selected from the color palette, the eyebrows of the initial three-dimensional face image or the three-dimensional face image passing through the shaping unit can be decorated based on the selected information.

On the decorating screen, a button for each part, a plurality of presets for the selected part, and a color palette for the selected part are displayed, and the decorating unit is configured such that a hair button is selected from the button for each part and any one of the presets is selected. When a color is selected and any one color is selected from the color palette, the hair of the initial 3D face image or the 3D face image that has undergone the shaping unit may be decorated based on the selected information.

On the decorating screen, buttons for each part, a plurality of presets for the selected part, a color palette for the selected part, and an adjustment slider for the selected part are displayed, and the decorating unit is configured to select an eye shadow button from the button for each part, and When any one eye shadow preset is selected from among a plurality of presets, a certain color is selected from the color palette, and detailed adjustments for the selected area are inputted through the adjustment slider, the initial value is based on the selected information and the input information. It is possible to decorate the eye shadow of the 3D face image of , or the 3D face image that has passed through the shaping unit.

On the decorating screen, buttons for each part, a plurality of presets for the selected part, and a color palette for the selected part are displayed, and the decorating unit selects an eyeline button from the button for each part and selects an eyeliner from among the plurality of presets. When a preset is selected and any one color is selected from the color palette, an eyeliner of the initial 3D face image or the 3D face image that has passed through the shaping unit may be decorated based on the selected information.

On the decorating screen, a button for each part, a plurality of presets for the selected part, and a color palette for the selected part are displayed, and the decorating unit includes an eyelash button selected from the button for each part and any one eyelash preset from the plurality of presets. When a color is selected and one color is selected from the color palette, the eyelashes of the initial 3D face image or the 3D face image that have passed through the shaping unit may be decorated based on the selected information.

On the decoration screen, a button for each part, a plurality of presets for the selected part, a color palette for the selected part, and an adjustment slider for the selected part are displayed, and the decorating unit is configured to select a ball touch button from the button for each part, and the When any one ball touch preset is selected from among a plurality of presets, a certain color is selected from the color palette, and detailed adjustments for the selected part are inputted through the adjustment slider, the initial information is based on the selected information and the input information. It is possible to decorate the 3D face image of , or the cheek touch of the 3D face image that has passed through the molding unit.

On the decorating screen, buttons for each part, a plurality of presets for the selected part, and a color palette for the selected part are displayed, and the decorating unit selects a lip button from the button for each part and selects a lip preset from the plurality of presets. When a color is selected and selected from the color palette, the lip of the initial 3D face image or the 3D face image that has undergone the shaping unit may be decorated based on the selected information.

A plurality of facial expression presets are displayed on the avatar creation screen, and the avatar generator selects one of the initial three-dimensional face image and the three-dimensional face image that has undergone at least one of the shaping unit and the decorating unit, selected by the customer. You can create an avatar by applying a facial expression preset and animating it.

It may further include; a mailing unit for transmitting at least one of the initial 3D face image and the 3D face image customized by the customizing unit to the outside.

According to the present invention having such a configuration, anyone can easily perform virtual cosmetic plastic surgery on their face, thereby enabling intuitive facial coordination by reflecting the customer's condition and requirements as they are.

The realistic 3D scan can realistically transform the face, improving customer satisfaction.

In addition, an avatar in the form of one's own face can be generated and used in a game through the avatar, and an image using the avatar having one's own face can be generated.

1 is a configuration diagram of a virtual cosmetic surgery apparatus according to an embodiment of the present invention.
FIG. 2 is a view showing an internal configuration of the customizing unit shown in FIG. 1 .
3 is an external perspective view of a booth in which a virtual cosmetic cosmetic device according to an embodiment of the present invention is installed.
FIG. 4 is a view showing the inside of the booth for explaining the installation form of the image input unit, the lighting unit, the viewpoint guide lamp unit, and the manipulation unit shown in FIG. 1 .
5 to 9 are examples of screens employed to explain the operation of the virtual cosmetic surgery apparatus according to an embodiment of the present invention.

Since the present invention can have various changes and can have various embodiments, specific embodiments are illustrated in the drawings and described in detail.

However, this is not intended to limit the present invention to specific embodiments, and it should be understood to include all modifications, equivalents and substitutes included in the spirit and scope of the present invention.

The terms used in the present application are only used to describe specific embodiments, and are not intended to limit the present invention. The singular expression includes the plural expression unless the context clearly dictates otherwise. In the present application, terms such as “comprise” or “have” are intended to designate that a feature, number, step, operation, component, part, or combination thereof described in the specification exists, but one or more other features It should be understood that this does not preclude the existence or addition of numbers, steps, operations, components, parts, or combinations thereof.

Unless defined otherwise, all terms used herein, including technical and scientific terms, have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. Terms such as those defined in a commonly used dictionary should be interpreted as having a meaning consistent with the meaning in the context of the related art, and should not be interpreted in an ideal or excessively formal meaning unless explicitly defined in the present application. does not

Hereinafter, preferred embodiments of the present invention will be described in more detail with reference to the accompanying drawings. In describing the present invention, in order to facilitate the overall understanding, the same reference numerals are used for the same components in the drawings, and duplicate descriptions of the same components are omitted.

FIG. 1 is a configuration diagram of a virtual cosmetic surgery apparatus according to an embodiment of the present invention, and FIG. 2 is a diagram illustrating an internal configuration of the customizing unit 22 shown in FIG. 1 .

The virtual cosmetic surgery apparatus according to an embodiment of the present invention may include an image input unit 14 , a lighting unit 16 , a viewpoint guide lamp unit 18 , and a manipulation unit 100 .

The image input unit 14 may take a three-dimensional image of the customer's face and transmit it to the control unit of the manipulation unit 100 .

For example, the image input unit 14 may include a camera capable of recognizing depth. The image input unit 14 may transmit the three-dimensional depth and color of each point of the captured image to the controller of the manipulation unit 100 .

Of course, if necessary, the image input unit 14 may be configured as an electronic device such as a smartphone having a camera function.

The lighting unit 16 provides lighting when the image input unit 14 captures the customer's face.

For example, the lighting unit 16 employs lighting capable of adjusting the brightness and color of light.

In the viewpoint guide lamp unit 18, a plurality of light sources may be elongated in a band shape in the horizontal direction. A plurality of light sources are sequentially turned on and off by the lighting controller of the manipulation unit 100 . Here, the plurality of light sources may be composed of LEDs emitting light. The plurality of light sources may be referred to as light sources for a viewpoint guide.

Accordingly, the viewpoint guide lamp unit 18 displays a left and right moving viewpoint (eg, including a direction and a position) that the customer (user) should look at.

In this way, when the customer tilts his or her face from side to side along the light source for the point of time guide that is turned on and off in sequence, the image input unit 14 can three-dimensionally photograph the customer's face (that is, including the front, left and right sides). .

The operation unit 100 is operated by a customer (user) who enters the booth.

For example, the manipulation unit 100 may be a portable computer such as a notebook computer or a laptop computer. Preferably, in consideration of the risk of loss, the manipulation unit 100 is preferably fixed inside a frame having a predetermined shape as shown in FIG. 4 to be described later.

The operation unit 100 allows a customer (user) to be provided with a virtual cosmetic surgery service. Here, the virtual cosmetic surgery service enables the customer to variously customize or coordinate the customer's face image (three-dimensional face image) by himself/herself.

To this end, the operation unit 100 includes a guide unit 10 , an input unit 12 , a lighting controller 20 , a customizing unit 22 , a display unit 24 , a storage unit 26 , a mailing unit 28 , and a control unit. (30) may be included.

The guide unit 10 provides various guides (eg, text, voice or video guide) so that the customer can easily use the virtual cosmetic surgery service.

The input unit 12 may input text such as a name or ID, a title, and an e-mail address of a customer who uses the virtual cosmetic surgery service.

In addition, the input unit 12 may input the start of the virtual cosmetic surgery service, and may select and input various customizing selection menus (items) for the 3D face image of the customer.

The lighting controller 20 transmits a lighting signal, a brightness signal, a lighting color signal, etc. to the lighting unit 16 and the viewpoint guide lamp unit 18 to control the brightness and color of the lighting and the lighting position of the light source for the viewpoint guide. .

The customizing unit 22 may perform various shaping and/or decorating on the customer's three-dimensional face image, and may generate an avatar based on the final three-dimensional face after the shaping and/or decorating has been completed. Here, the plastic surgery may mean a modification of a face shape, eyes, nose, mouth, etc. of a three-dimensional face image, and a modification of facial beauty. Decorating may mean adjusting hair, eyebrows, eye shadow, eyeliner, eyelashes, cheek touch (blusher), lip, etc. of the 3D face image. In order to generate the avatar, animation effects (eg, additionally applying facial expressions and/or motions) may be applied to the final 3D face that has finished shaping and/or decorating.

To this end, the customizing unit 22 may include a forming unit 22a, a decorating unit 22b, and an avatar generating unit 22c as shown in FIG. 2 .

The shaping unit 22a may transform the 3D image of the customer's face according to the customer's input.

For example, the shaping unit 22a may perform detailed deformation on the face shape, eyes, nose, mouth, etc. of the three-dimensional face image, and may perform detailed deformation on facial beauty.

The decorator 22b may adjust the 3D face image of the customer according to the input of the customer.

For example, the decorator 22b may make detailed adjustments to hair, eyebrows, eye shadow, eye line, eyelashes, cheek touch (blusher), lip, and the like of the 3D face image.

The avatar generator 22c may generate an avatar based on the final 3D face that has undergone the shaping in the shaping part 22a and/or the decorating in the decorating part 22b.

For example, the avatar generating unit 22c applies the expression selected by the customer (user) to the final three-dimensional face that has undergone the shaping in the shaping part 22a and/or the decorating in the decorating part 22b, and then animates it. You can create an avatar.

If necessary, the avatar generator 22c may additionally apply motions other than facial expressions. When the motion is additionally applied, it can be understood that the motion is not directly applied to the final 3D face, but is applied to the body to which the final 3D face is adopted.

Of course, the above-described avatar generating unit 22c is not the final three-dimensional face that has undergone the shaping and/or decorating in the shaping part 22a and/or the shaping part 22b, but the shaping and/or shaping in the shaping part 22a. Alternatively, an avatar may be created by animating the first 3D face image that has not been decorated by the decorating unit 22b as it is.

In other words, the above-described customizing unit 22 does not create the avatar in the avatar generating unit 22c after unconditionally performing the decorating in the decorating unit 22b after the molding in the forming unit 22a, but in the forming unit 22a. ), and one or more operations of the decorating unit 22b and the avatar generating unit 22c are selectively performed.

In FIG. 1 , the display unit 24 displays various kinds of guidance from the guide unit 10 and displays text inputted from the input unit 12 on the screen.

In addition, the display unit 24 not only displays a three-dimensional face image of the customer, but also displays various customization selection menus related to shaping, decorating, and avatar generation so that the operation of the customizing unit 22 is possible.

Here, the display unit 24 may be configured as a touch monitor. Accordingly, the display unit 24 may display instructions according to the face scanning process on the screen, and may receive a touch input from a customer (user).

In FIG. 1 , the input unit 12 and the display unit 24 are configured separately, but as described above, when the display unit 24 is configured as a touch monitor, the display unit 24 performs the functions of the input unit 12 together. can Accordingly, when the display unit 24 is configured as a touch monitor, the input unit 12 is not separately required, and the display unit 24 configured as a touch monitor may be referred to as a display and input unit.

The storage unit 26 is based on a three-dimensional face image of a customer who has not undergone plastic surgery and/or decoration, a final three-dimensional face that has been plasticized and/or decorated, and a final three-dimensional face that has finished plastic surgery and/or decoration Saves the avatars created with Here, the information stored in the storage unit 26 may be stored for each customer.

More specifically, the storage unit 26 stores the customer (user)'s personal information, information utilization and marketing consent information, contact information, the customer's three-dimensional face image, and customization data (that is, the customizing unit 22). 3D face), and an avatar.

The information stored in the storage unit 26 can be used for marketing according to customer (user) consent or can be linked with services of other companies.

The mailing unit 28 is based on the customer's three-dimensional face image, the final three-dimensional face stored in the storage unit 26, the final three-dimensional face, and the final three-dimensional face that has finished the cosmetic and/or decorating. The generated avatar may be sent to a person designated by the customer (eg, the customer himself or another person) via e-mail.

The control unit 30 controls the overall operation of the manipulation unit 100 .

That is, the controller 30 transmits a lighting control signal to the lighting controller 20 .

The controller 30 may generate a 3D face image by processing the image received from the image input unit 14 and the depth value of each point. That is, the controller 30 may generate a 3D face image based on the 3D face image data from the image input unit 14 . The generated 3D face image is provided to the customizing unit 22 for customization. Here, the three-dimensional face image generated by the controller 30 is referred to as the initial three-dimensional face image described in the claims of the present invention.

The controller 30 may control the deformation of the 3D face image according to the input of the customer (user) or control the application of cosmetics, glasses, earrings, hairstyles, etc. to the 3D face image.

The controller 30 may control a change in color tone of makeup for a three-dimensional face image.

The controller 30 may control rotation and enlargement/reduction of the 3D face image according to the input of the customer (user).

The control unit 30 receives the contact information and e-mail address of the customer (user) and controls so that the scanned and customized 3D face data can be transmitted to the customer or others through e-mail.

3 is an external perspective view of a booth in which a virtual cosmetic surgery apparatus according to an embodiment of the present invention is installed, and FIG. 4 is a booth for explaining the installation form of the image input unit, the lighting unit, the viewpoint guide lamp unit, and the operation unit shown in FIG. It is a drawing showing the inside.

The virtual cosmetic surgery apparatus according to an embodiment of the present invention is installed in a booth as illustrated in FIG. 3 , and provides a virtual cosmetic cosmetic service to customers entering the booth.

3 shows the exterior of the booth, the booth supports the booth and blocks external light with a booth frame 40, a door for entry and a curtain 32 that blocks external light, and advertisements and It may include an external monitor 34 that outputs information about the booth.

Meanwhile, as shown in FIG. 4 , an image input unit 14 , a lighting unit 16 , a viewpoint guide lamp unit 18 , and an operation unit 100 are installed inside the booth.

In FIG. 4 , it is assumed that the operation unit 100 is a notebook computer, but this is only an example. A customer (user) sits on a chair (eg, a chair capable of rotating and height adjustment) placed in front of the operation unit 100, looks at the display unit (monitor) of the operation unit 100, and performs a face scan according to the guidance, and the customer's 3 You can customize the dimensional face image.

In FIG. 4 , the image input unit 14 is positioned at the upper end of the manipulation unit 100 , but the installation position of the image input unit 14 is adjustable.

In Fig. 4, there are three lighting units 16 in all. That is, the lighting unit 16 includes a circular lighting unit 16 disposed on the front wall of the booth to be spaced apart from the operation unit 100, and a diagonal-shaped lighting unit 16 disposed on the left corner side of the inside of the booth to be spaced apart from the operation unit 100. ), and may include a lighting unit 16 in the form of a diagonal pattern disposed on the right corner side of the booth to be spaced apart from the operation unit 100 .

Here, the circular lighting unit 16 allows the light to be evenly spread on the front of the customer's (user's) face. The lighting unit 16 in the shape of a diagonal pattern disposed on the left corner side of the booth allows the light to spread evenly to the left face of the customer (user). The lighting unit 16 in the shape of a diagonal pattern disposed on the right corner side of the inside of the booth allows the light to spread evenly to the right face of the customer (user).

The viewpoint guide lamp unit 18 is installed long in the horizontal direction above the circular lighting unit 16 disposed on the upper portion of the manipulation unit 100 .

For example, in the viewpoint guide lamp unit 18 , a plurality of light sources 18a such as LEDs emitting light are installed to be spaced apart from each other at equal intervals, and the plurality of light sources are sequentially turned on and off by the lighting controller 20 . will be carried out In this way, a plurality of light sources must be sequentially turned on and off to know the direction and location where the customer (user) should look. Accordingly, the customer (user) tilts his head from side to side while looking at the light sources that are sequentially turned on and off, so that the image input unit 14 can three-dimensionally scan the face of the customer.

This time, the operation of the virtual cosmetic surgery apparatus according to the embodiment of the present invention will be described with reference to the screen examples of FIGS. 5 to 9 .

First, when a customer (user) enters the booth and sits on a chair and then touches the screen according to the guide phrase "Touch the screen" on the display unit 24 to receive the virtual cosmetic surgery service, the subsequent screen (i.e., A screen introducing the virtual cosmetic surgery service) is displayed on the display unit 24 .

Accordingly, the customer selects to start the virtual cosmetic cosmetic service after seeing a brief introduction to the virtual cosmetic cosmetic service.

The selection of the start of the virtual cosmetic surgery service is made through the input unit 12, and in response to a request to start the virtual cosmetic surgery service, the controller 30 controls the guide unit 10 to provide a predetermined usage guide (eg, text, voice, video). guidance) (e.g., "Move your face according to the instructions", "Please take off your glasses", "Please tie up your long hair", "Please adjust your face so that the edges are green", "Follow the green light on your face Please move", etc.) is displayed on the display unit 24 .

Then, the lighting unit 16 is turned on, and the image input unit 14 three-dimensionally photographs the face of the customer moving along the viewpoint guide lamp unit 18 .

Thereafter, the control unit 30 generates a 3D face image by processing the image received from the image input unit 14 and the depth value of each point, and then displays it on the display unit 24 . Here, the 3D face image displayed on the display unit 24 may be the 3D face image 50 as illustrated in FIG. 5 . In FIG. 5 , unexplained reference numeral 51 is a guide text indicating that shooting (ie, scanning) has been completed, and unexplained reference numeral 52 is a warning pop-up in which it is requested to proceed again when shooting (scan) is wrong. In FIG. 5 , unexplained reference numeral 53 denotes a redo button for returning to the scan preparation screen and proceeding again when photographing (scanning) is not successful, and unexplained reference numeral 54 is a next screen button for moving to the next screen.

In this way, when the customer presses the next screen button 54 after the shooting (scan) is completed, a screen that can transform (shape) the 3D face image 50 (that is, the deformed screen (refer to FIG. 6)) is displayed. displayed on the display unit 24 . On the transformation screen, not only the 3D face image 50 but also various transformation selection menus (items) are displayed. The transformation selection menu may include buttons for each part and detailed setting items for the selected part.

For example, as for the deformable screen, as shown in FIG. 6 , a screen capable of deforming a face may be provided as an initial screen.

Accordingly, the customer selects a desired part by clicking the button 55 for each part on the screen on which the face can be transformed. Here, the button 55 for each part may include a face button 55a, a face beauty button 55b, an eye button 55c, a nose button 55d, and a mouth button 55e.

For example, if the customer clicks the face button 55a from the button 55 for each part, detailed information may be additionally set. That is, the detailed face setting items may include a plurality of face shape presets 56 and the detailed face adjustment slider 57 .

When the customer clicks a desired preset in the face shape preset 56 , the controller 30 applies the corresponding face shape to the 3D face image 50 through the customizing unit 22 .

The face detail adjustment slider 57 may slidably adjust the cheekbones, chin size, chin length, chin protrusion, chin tip width, and face width of the 3D face image 50 . The customer can make detailed adjustments for each part by using the detailed face adjustment slider 57 . These fine adjustment values are applied to the customizing unit 22 to make fine adjustments to the corresponding part.

On the other hand, if the customer clicks the facial beauty button 55b from the button 55 for each part, it is possible to additionally set detailed information accordingly. That is, the detailed facial beauty setting items may include a plurality of eye presets and a detailed facial beauty adjustment slider. Here, the facial beauty detailed adjustment slider can finely adjust dark circles, aegyo cheeks, nasolabial folds, face whitening, teeth whitening, etc. of the three-dimensional face image 50 in a sliding manner. These fine adjustment values are applied to the customizing unit 22 to make fine adjustments to the corresponding part.

When a customer clicks a desired preset from a plurality of eye presets, the controller 30 applies the corresponding pupil to the 3D face image 50 through the customizing unit 22 .

On the other hand, if the customer clicks the eye button 55c from the button 55 for each part, it is possible to additionally set the corresponding details. That is, the detailed eye setting items may include a plurality of double eyelid presets and a detailed eye adjustment slider. Here, the detailed eye adjustment slider may finely adjust the eye size, the corner of the eye, the opening of the corner of the eye, the eyebrow, the size of the pupil of the 3D face image 50 in a sliding manner. These fine adjustment values are applied to the customizing unit 22 to make fine adjustments to the corresponding part.

When a customer clicks a desired preset from a plurality of double eyelid presets, the control unit 30 applies the corresponding double eyelid to the three-dimensional face image 50 through the customizing unit 22 .

On the other hand, if the customer clicks the nose button 55d in the button 55 for each part, it is possible to additionally set the details accordingly. That is, the detailed nose setting item may include a plurality of nose presets and a detailed nose adjustment slider. Here, the nose detail adjustment slider can finely adjust the bridge of the nose, the tip of the nose, the cheeks, the width of the nose, the size of the nose, and the like of the three-dimensional face 50 in a sliding manner. These fine adjustment values are applied to the customizing unit 22 to make fine adjustments to the corresponding part.

When a customer clicks a desired preset from a plurality of nose presets, the control unit 30 applies the corresponding nose to the 3D face image 50 through the customizing unit 22 .

On the other hand, if the customer clicks the mouth button 55e in the button 55 for each part, the corresponding details may be additionally set. That is, the detailed mouth setting items may include a plurality of mouth presets and a mouth detail adjustment slider. Here, the detailed mouth adjustment slider may finely adjust the size of the lips, the upper lip, the lower lip, the corners of the mouth, and the width of the lips of the three-dimensional face image 50 in a sliding manner. These fine adjustment values are applied to the customizing unit 22 to make fine adjustments to the corresponding part.

When a customer clicks a desired preset from a plurality of mouth presets, the control unit 30 applies the corresponding mouth to the 3D face image 50 through the customizing unit 22 .

In FIG. 6 , unexplained reference numeral 58 denotes an initialization button for canceling all customizing changes and returning to the initial scanned image, and unexplained reference numeral 59 denotes a title screen button for returning to the title screen when clicked. Unexplained code 60 is a button for deleting the last change of customization and returning to the previous appearance or undoing the customer's undo.

In this way, after the customer clicks the button 55 for each part and completes the transformation (molding) on the desired part, the next screen button 54 is clicked. Accordingly, the control unit 30 displays the decoration screen as shown in FIG. 7 on the display unit 24 . For example, as for the decorating screen, as shown in FIG. 7 , a screen for decorating eyebrows may be provided as an initial screen. Of course, if there is no need for transformation (shaping) on the 3D face image 50, it can go directly to the decorating screen.

The decoration screen of FIG. 7 may include not only the 3D face image 50 but also a button 61 for each part for selecting decorations for each part of the 3D face image 50 . The three-dimensional face image 50 of FIG. 7 is a deformed (molded) or undeformed image. That is, if the customer selects a transformation for the 3D face image 50 in FIG. 6 , the 3D face image 50 in FIG. 7 will be a deformed image somewhere, and the customer selects the 3D face image 50 in FIG. 6 . If a transformation is not selected for , the 3D face image 50 of FIG. 7 will be an undeformed image.

Accordingly, the customer selects a desired part by clicking the button 61 for each part on the decoration screen on the display unit 24 . Here, the button 61 for each part is an eyebrow button 61a, a hair button 61b, an eye shadow button 61c, an eyeline button 61d, an eyelash button 61e, a ball touch button 61f, and a lip. A button 61g may be included.

For example, if the customer clicks the eyebrow button 61a from the button 61 for each part, detailed information may be additionally set. That is, the detailed eyebrow setting items may include a plurality of eyebrow presets 62 and a color palette 63 having a plurality of different colors.

When the customer clicks a desired preset in the eyebrow preset 62 , the controller 30 applies the corresponding eyebrow to the 3D face image 50 through the customizing unit 22 .

When the customer clicks a desired color in the color palette 63 , the controller 30 changes the eyebrow color of the 3D face image 50 to the clicked color through the customizing unit 22 .

On the other hand, if the customer clicks the hair button 61b from the button 61 for each part, the corresponding details may be additionally set. That is, the detailed hair setting item may include a plurality of hair presets and a color palette having a plurality of different colors.

When the customer clicks a desired preset in the hair preset, the controller 30 applies the corresponding hair to the 3D face image 50 through the customizing unit 22 .

When the customer clicks a desired color from the color palette, the controller 30 changes the hair color of the three-dimensional face image 50 to the clicked color through the customizing unit 22 .

On the other hand, if the customer clicks the eye shadow button 61c from the button 61 for each part, the corresponding details may be additionally set. That is, the detailed eye shadow setting items may include a plurality of eye shadow presets, a color palette having a plurality of different colors, and an adjustment slider.

When the customer clicks on a desired preset from the eye shadow preset, the controller 30 applies the corresponding eye shadow to the 3D face image 50 through the customizing unit 22 .

When the customer clicks on a desired color from the color palette, the control unit 30 changes the color of the eye shadow of the 3D face image 50 to the clicked color through the customizing unit 22 .

In addition, the aforementioned adjustment slider can adjust the density and range of the eyeshadow, and the customer can finely adjust the density and/or range of the eyeshadow by sliding the adjustment slider. These fine adjustment values are applied to the customizing unit 22 , and fine adjustment of the eye shadow of the 3D face image 50 is made by the customizing unit 22 .

On the other hand, if the customer clicks the eyeliner button 61d from the button 61 for each part, the corresponding details may be additionally set. That is, the detailed eye line setting item may include a plurality of eye line presets and a color palette having a plurality of different colors.

When the customer clicks a desired preset in the eyeline preset, the controller 30 applies the corresponding eyeline to the 3D face image 50 through the customizing unit 22 .

When the customer clicks on a desired color from the color palette, the control unit 30 changes the color of the eye line of the 3D face image 50 to the clicked color through the customizing unit 22 .

On the other hand, if the customer clicks the eyelash button 61e in the button 61 for each part, the corresponding details may be additionally set. That is, the detailed eyelash setting item may include a plurality of eyelash presets and a color palette having a plurality of different colors.

When the customer clicks a desired preset in the eyelash preset, the controller 30 applies the corresponding eyelash to the 3D face image 50 through the customizing unit 22 .

When the customer clicks a desired color from the color palette, the controller 30 changes the color of the eyelashes of the three-dimensional face image 50 to the clicked color through the customizing unit 22 .

On the other hand, if the customer clicks the ball touch button 61f from the button 61 for each part, it is possible to additionally set the corresponding details. That is, the detailed ball touch setting items may include a plurality of ball touch presets, a color palette having a plurality of different colors, and an adjustment slider.

When the customer clicks a desired preset from the cheek touch preset, the controller 30 applies the corresponding cheek touch (blusher) to the 3D face image 50 through the customizing unit 22 .

When the customer clicks a desired color from the color palette, the controller 30 changes the color of the ball touch of the 3D face image 50 to the clicked color through the customizing unit 22 .

In addition, the above-described adjustment slider can adjust the density and range of the ball touch, and the customer can finely adjust the density and/or range of the adjustment slider in a sliding manner. These fine adjustment values are applied to the customizing unit 22 , and fine adjustments are made to the ball touch of the 3D face image 50 by the customizing unit 22 .

On the other hand, if the customer clicks the lip button 61g from the button 61 for each part, it is possible to additionally set the corresponding details. That is, the detailed lip setting item may include a plurality of lip presets and a color palette having a plurality of different colors.

When the customer clicks a desired preset in the lip preset, the controller 30 applies the lip to the 3D face image 50 through the customizing unit 22 .

When the customer clicks on a desired color from the color palette, the control unit 30 changes the color of the lip of the 3D face image 50 to the clicked color through the customizing unit 22 .

In FIG. 7 , unexplained reference numeral 64 denotes a previous screen button for moving to a previous screen. When the customer clicks the previous screen button 64, it goes to the customization screen, and when the customer clicks the next screen button 54, it goes to the animation screen.

In this way, after the customer clicks the button 61 for each part to finish decorating the desired part, the next screen button 54 is clicked. Accordingly, the controller 30 displays an avatar creation screen as shown in FIG. 8 on the display unit 24 .

Accordingly, when the customer clicks a desired preset from a plurality of expression presets 65 on the avatar creation screen on the display unit 24, the control unit 30 converts the corresponding expressions to the three-dimensional face image 50 through the customizing unit 22. apply

Thereafter, when the customer clicks the completion button 67 , the avatar creation inquiry phrase 66 is displayed on the display unit 24 in a pop-up manner.

When the customer clicks “Yes” in the avatar creation inquiry phrase 66 , the control unit 30 creates the avatar through the customizing unit 22 .

An avatar generated based on the 3D face image of the customer who has not undergone cosmetic surgery and/or decoration, the final 3D face after the cosmetic surgery and/or decoration, and the final 3D face after the cosmetic and/or decoration is completed will be stored in the storage unit 26 .

Of course, although only a plurality of facial expression presets are illustrated in FIG. 8, a plurality of motion presets other than the plurality of facial expression presets may be included on the avatar creation screen. When a plurality of motion presets exist together, when a customer clicks a desired expression and motion, the control unit 30 applies the corresponding expression and motion to the three-dimensional face image 50 through the customizing unit 22 . Actually, in the case of motion, it can be seen that the 3D face image 50 is applied to the body to which it is employed rather than directly applied to the 3D face image 50 .

When the final customization is completed in this way, the control unit 30 displays the customized face 70 or avatar on the display unit 24 as shown in FIG. 9 .

In FIG. 9 , an unexplained reference numeral 71 denotes a text indicating that the avatar creation has been completed, and an unexplained reference numeral 72 denotes a mail share button.

When the customer clicks the mail share button 72 , the control unit 30 displays a pop-up (not shown) in the form of a touch keyboard to write an address on the display unit 24 . Accordingly, when the customer clicks a send button (not shown) after inputting a mail address by manipulating the touch keyboard, the control unit 30 transmits the corresponding avatar to the mail address through the mailing unit 28 .

Thereafter, the display unit 24 displays a screen on which percentage text showing a change in percentage until transmission is completed and a guide text indicating a return to the title screen after transmission is completed for visual confirmation of the customer.

According to the embodiment of the present invention as described above, the cosmetic result can be predicted in advance by customizing the customer's eyes, nose, mouth, double eyelids, forehead, cheekbones, eyebrows, and the like.

In addition, it can be used in the game through an avatar in the form of one's own face.

Also, it is possible to generate an image using an avatar having its own face.

As described above, the best embodiment has been disclosed in the drawings and the specification. Although specific terms are used herein, they are only used for the purpose of describing the present invention, and are not used to limit the meaning or the scope of the present invention described in the claims. Therefore, it will be understood by those skilled in the art that various modifications and equivalent other embodiments are possible therefrom. Accordingly, the true technical protection scope of the present invention should be defined by the technical spirit of the appended claims.

10: guide unit 12: input unit
14: video input unit 16: lighting unit
18: viewpoint guide lamp unit 20: lighting controller
22: customizing unit 24: display unit
26: storage unit 28: mailing unit
30: control unit 100: control unit

Claims (18)

As a device that provides virtual cosmetic surgery service to customers who have entered the booth,
a point of view guide lamp for displaying a moving point at which the customer should look;
an image input unit for inputting three-dimensional face image data of a customer's face moving along the viewpoint guide lamp unit to the controller;
a controller for generating an initial three-dimensional face image based on the three-dimensional face image data;
a customizing unit performing at least one of shaping and decorating the initial three-dimensional face image and generating an avatar; and
Displaying the deformable screen for the cosmetic surgery, the decorating screen for decorating, and the avatar generating screen for generating the avatar, displaying a three-dimensional face image customized in the customizing unit, and selecting the customer's menu on the screens Virtual cosmetic cosmetic device comprising a; display and input unit for inputting. The method according to claim 1,
The customization unit,
a shaping unit that transforms the initial three-dimensional face image according to the customer's menu selection;
a decorating unit for decorating the initial 3D face image or the 3D face image that has been subjected to the shaping unit according to the customer's menu selection; and
and an avatar generating unit that generates an avatar according to the customer's menu selection based on the 3D face image or the initial 3D face image that has undergone at least one of the shaping unit and the decorating unit. cosmetic cosmetic device. 3. The method according to claim 2,
The molding part,
A virtual cosmetic molding apparatus, characterized in that it transforms at least one of a face shape, eyes, nose, mouth, and facial beauty of the initial three-dimensional face image. 4. The method according to claim 3,
On the transformation screen, buttons for each part, a number of presets for the selected part, and detailed adjustment sliders for the selected part are displayed,
The shaping unit may include, when a face shape button is selected from the button for each part, a face shape preset is selected from among the plurality of presets, and detailed adjustments for the selected part are inputted through the detailed adjustment slider, the selected information and the input A virtual cosmetic surgery apparatus, characterized in that the face shape of the initial three-dimensional face image is transformed based on the obtained information. 4. The method according to claim 3,
On the transformation screen, buttons for each part, a number of presets for the selected part, and detailed adjustment sliders for the selected part are displayed,
The shaping unit may include, when an eye button is selected from the buttons for each part, a double eyelid preset is selected from among the plurality of presets, and detailed adjustments for the selected part are inputted through the detailed adjustment slider, the selected information and the input information Virtual cosmetic surgery apparatus, characterized in that it deforms the eyes of the initial three-dimensional face image based on 4. The method according to claim 3,
On the transformation screen, buttons for each part, a number of presets for the selected part, and detailed adjustment sliders for the selected part are displayed,
The shaping unit may include, when a nose button is selected from the buttons for each part, a nose preset is selected from among the plurality of presets, and detailed adjustments for the selected part are inputted through the detailed adjustment slider, the selected information and the input information Virtual cosmetic surgery apparatus, characterized in that the nose of the initial three-dimensional face image is deformed based on 4. The method according to claim 3,
On the transformation screen, buttons for each part, a number of presets for the selected part, and detailed adjustment sliders for the selected part are displayed,
The shaping unit may include, when a mouth button is selected from the buttons for each part, a mouth preset is selected from among the plurality of presets, and detailed adjustments for the selected part are inputted through the detailed adjustment slider, the selected information and the input information Virtual cosmetic surgery apparatus, characterized in that it deforms the mouth of the initial three-dimensional face image based on. 4. The method according to claim 3,
On the transformation screen, buttons for each part, a number of presets for the selected part, and detailed adjustment sliders for the selected part are displayed,
The shaping unit may include, when a facial beauty button is selected from the button for each part, a pupil preset is selected from among the plurality of presets, and detailed adjustments for the selected part are inputted through the detailed adjustment slider, the selected information and the inputted information A virtual cosmetic surgery apparatus, characterized in that the facial beauty of the initial three-dimensional face image is transformed based on the information. 3. The method according to claim 2,
The decorating unit,
A virtual cosmetic cosmetic device, characterized in that the initial three-dimensional face image or the three-dimensional face image passed through the shaping unit decorates at least one of eyebrows, hair, eye shadow, eye line, eyelashes, cheek touch, and lips. 10. The method of claim 9,
On the decoration screen, buttons for each part, a plurality of presets for the selected part, and a color palette for the selected part are displayed,
The decorating unit may include, when an eyebrow button is selected from the button for each part, an eyebrow preset is selected from among the plurality of presets, and a color is selected from the color palette, based on the selected information, the initial three-dimensional face image or A virtual cosmetic cosmetic device, characterized in that the eyebrows of the three-dimensional face image passed through the shaping unit are decorated. 10. The method of claim 9,
On the decoration screen, buttons for each part, a plurality of presets for the selected part, and a color palette for the selected part are displayed,
The decorating unit may include, when a hair button is selected from the buttons for each part, a hair preset is selected from among the plurality of presets, and a color is selected from the color palette, based on the selected information, the initial three-dimensional face image or A virtual cosmetic cosmetic device, characterized in that it decorates the hair of the three-dimensional face image that has passed through the molding unit. 10. The method of claim 9,
On the decoration screen, buttons for each part, a plurality of presets for the selected part, a color palette for the selected part, and an adjustment slider for the selected part are displayed,
The decorating unit is configured to select an eye shadow button from the button for each region, select an eye shadow preset from among the plurality of presets, select a color from the color palette, and adjust the details of the selected region through the adjustment slider When this is input, the virtual cosmetic surgery apparatus according to claim 1, wherein the eye shadow of the initial 3D face image or the 3D face image that has been subjected to the shaping unit is decorated based on the selected information and the inputted information. 10. The method of claim 9,
On the decoration screen, buttons for each part, a plurality of presets for the selected part, and a color palette for the selected part are displayed,
The decorating unit may include, when an eyeline button is selected from the buttons for each part, an eyeline preset is selected from among the plurality of presets, and a color is selected from the color palette, based on the selected information, the initial three-dimensional face A virtual cosmetic cosmetic device, characterized in that it decorates an image or an eyeline of a three-dimensional face image that has passed through the molding unit. 10. The method of claim 9,
On the decoration screen, buttons for each part, a plurality of presets for the selected part, and a color palette for the selected part are displayed,
The decorating unit may include, when an eyelash button is selected from the button for each part, an eyelash preset is selected from among the plurality of presets, and a color is selected from the color palette, based on the selected information, the initial three-dimensional face image or Virtual cosmetic cosmetic device, characterized in that the eyelashes of the three-dimensional face image passed through the molding unit is decorated. 10. The method of claim 9,
On the decoration screen, buttons for each part, a plurality of presets for the selected part, a color palette for the selected part, and an adjustment slider for the selected part are displayed,
In the decorating unit, a ball touch button is selected from the buttons for each part, any one ball touch preset is selected from among the plurality of presets, a certain color is selected from the color palette, and detailed control of the selected part is performed through the adjustment slider. When this is input, the virtual cosmetic surgery apparatus according to claim 1, characterized in that the ball touch of the initial 3D face image or the 3D face image that has passed through the shaping unit is decorated based on the selected information and the inputted information. 10. The method of claim 9,
On the decoration screen, buttons for each part, a plurality of presets for the selected part, and a color palette for the selected part are displayed,
The decorating unit may include, when a lip button is selected from the buttons for each part, a lip preset is selected from among the plurality of presets, and a color is selected from the color palette, based on the selected information, the initial three-dimensional face image or A virtual cosmetic cosmetic device, characterized in that the lip of the three-dimensional face image that has passed through the molding unit is decorated. 3. The method according to claim 2,
A plurality of facial expression presets are displayed on the avatar creation screen,
The avatar generating unit generates an avatar by applying the facial expression preset selected by the customer to any one of the initial three-dimensional face image and the three-dimensional face image that has undergone at least one of the shaping unit and the decorating unit to animate. Virtual cosmetic plastic surgery device. The method according to claim 1,
and a mailing unit configured to transmit one or more of the initial 3D face image and the 3D face image customized by the customizing unit to the outside;

Images