WO2023239110A1

WO2023239110A1 - Virtual experience device for recommending customized style to user

Info

Publication number: WO2023239110A1
Application number: PCT/KR2023/007513
Authority: WO
Inventors: 강문태
Original assignee: 주식회사 네일클럽; 강문태
Priority date: 2022-06-10
Filing date: 2023-06-01
Publication date: 2023-12-14
Also published as: KR102554058B1

Abstract

The present invention relates to a virtual experience device for recommending a customized style to a user and, more specifically, to a technology that provides a customized style for a user's ears, eyes, mouth, and nose, and the user's face shape, head shape, and skin tone, wherein: when the user's skin image information is obtained through a first camera located in one area of the main body of the virtual experience device, the user's skin tone is identified and customized color tone information is obtained for the identified skin tone through a pre-stored first artificial intelligence algorithm; and when model data obtained by photographing the user's head through a second camera is obtained, a face object that is a 3D stereoscopic model is generated through the model data, and the identified skin tone is reflected to the generated face object and the face object is analyzed through a pre-stored second artificial intelligence algorithm.

Description

Virtual try-on device that recommends customized styles to users

The present invention relates to a virtual experience device that recommends a customized style to the user. Specifically, when acquiring the user's skin image information through the first camera located in one area of the main body of the virtual experience device, the pre-stored first artificial intelligence When the user's skin tone is identified through an algorithm and customized color tone information for the identified skin tone is acquired, and model data obtained by photographing the user's head through a second camera is obtained, a 3D three-dimensional model of the face is created through the model data. Creates an object, reflects the skin tone identified in the created face object, analyzes the face object through a pre-stored second artificial intelligence algorithm, and provides a customized style for the user's features, face shape, head, and skin tone. It's about technology.

The MZ generation, which is setting and leading recent consumption trends, is creating an unprecedented wave in the beauty industry. This generation, which values its own individuality, is rejecting the color trends presented by the beauty industry and pursuing its own color, showing an unprecedented consumption pattern. The era of so-called "personal color" has arrived. will be. In particular, the recent MZ generation uses personal color in a variety of ways, such as diagnosing their personal color themselves or having an expert diagnose their personal color, and looking for cool-toned and warm-toned colors when changing clothes, hair, and makeup. there is.

Accordingly, as the MZ generation's interest in personal color increases, the beauty industry is developing technologies that combine various services so that consumers can easily select and use products according to their tone.

As an example, Korean Patent Publication No. 10-2020-0045759 (Personal Color Matching Styling System) analyzes the information entered by the user to create a user avatar, diagnoses the personal color, and analyzes the keywords entered by the user to create a personal image diagnosed in the avatar. A technology that recommends customized styling based on color has been disclosed.

However, in the above-mentioned prior art, only the technology of diagnosing the user's personal color and recommending customized styling based on the diagnosed personal color to the avatar is disclosed, and the technology is located in one area of the main body of the virtual experience device. When acquiring the user's skin image information through the first camera, the user's skin tone is identified through the first pre-stored artificial intelligence algorithm, customized color tone information for the identified skin tone is acquired, and the user's skin tone is acquired through the second camera. When acquiring model data by photographing the head of a person, a face object, which is a 3D three-dimensional model, is created through the model data, and the identified skin tone is reflected in the created face object to create the face object through a pre-stored second artificial intelligence algorithm. As technology that provides a customized style for the user's facial features, facial features, head shape, and skin tone has not been disclosed, the need for technology that can solve this problem is emerging.

Accordingly, the present invention is a virtual experience device that recommends a customized style to the user, and when the user's skin image information is acquired through the first camera located in one area of the body of the virtual experience device, the user's skin image information is obtained through a pre-stored first artificial intelligence algorithm. When identifying the skin tone and obtaining customized color tone information for the identified skin tone, and obtaining model data obtained by photographing the user's head through a second camera, a facial object, which is a 3D three-dimensional model, is created through the model data; , By reflecting the skin tone identified in the generated facial object and analyzing the facial object through a pre-stored second artificial intelligence algorithm, customized styles for the user's features, face shape, head, and skin tone are provided to the user. The purpose is to allow you to express your individuality more effectively.

In the virtual experience device for recommending a customized style to a user implemented in a computing device including one or more processors according to an embodiment of the present invention and one or more memories storing instructions executable by the processor, located in one area of the main body When the first camera captures the user's facial skin and obtains skin image information reflecting the user's skin condition, the skin image information is analyzed through a pre-stored first artificial intelligence algorithm to identify the user's skin tone. a user skin analysis unit that acquires customized color tone information corresponding to the identified skin tone; When the function of the user's skin analysis unit is completed and the second camera located in one area of the main body captures the user's head and obtains model data, which is 3D scan data, the user's skin is analyzed based on the obtained model data. a face object generator that generates a first face object that is a 3D model of the head and reflects the identified skin tone to the first face object; When the skin tone is reflected in the first face object and the creation of the second face object is completed, a reference face object and the second face object based on a plurality of pre-stored reference shape information are created through a pre-stored second artificial intelligence algorithm. a styling information acquisition unit that compares and confirms reference shape information whose similarity rate is greater than or equal to a specified value, and obtains styling information corresponding to the confirmed reference shape information; And when the acquisition of the customized color tone information and the styling information is completed, a third face object is created by reflecting the style based on the customized color tone information and the styling information in the second face object, and the generated third face object is Characterized in that it includes a style recommendation unit that outputs through a display located in one area of the main body and recommends a customized style to the user.

When the first camera captures the user's facial skin, the user skin analysis unit controls a lighting module located in one area of the first camera to generate first image information, which is image information about the outer layer of the facial skin. a skin image acquisition unit that acquires second image information, which is image information about the basal layer of the skin; When the acquisition of the first image information and the second image information is completed, an analysis process that starts a skin condition analysis process of analyzing the first image information and the second image information through the pre-stored first artificial intelligence algorithm. beginning; When the skin condition analysis process starts, a skin type identification unit that overlaps an image based on the first image information and an image based on the second image information and identifies the user's skin type through the overlapped image; And while the function of the skin type identification unit is in progress, the skin color corresponding to the average value of the first skin color based on the first image information and the second skin color based on the second image information is converted to the user's skin tone. A customized color tone information determination unit that identifies and determines at least one color tone information matching the user's skin tone among a plurality of pre-stored color tone information as customized color tone information customized to the user's skin tone; including, the skin tone of the user The types preferably include normal type, dry type, oily type, sensitive type, pigmentation type, atopic type, dermatitis type, and sebum type.

When the first camera captures the user's facial skin, the skin image acquisition unit controls the lighting module to increase the amount of light irradiated to the facial skin, allowing the first camera to capture the lower surface layer of the facial skin. A light quantity control unit for photographing the base layer located at; And when the first camera acquires third image information including hair and the basal layer of the facial skin by photographing the basal layer of the facial skin in a state in which the light quantity is increased by the light quantity controller, the third camera It may be possible to include a second image acquisition unit that removes hair from the facial skin from an image based on image information and obtains the second image information including only the basal layer.

When the second camera acquires the model data, the facial object generator starts a modeling process and creates the first virtual 3D model corresponding to the shape of the user's head based on the acquired model data. an object modeling unit that generates a face object; And when the creation of the first face object is completed, the user's skin tone identified by the user skin analysis unit is reflected in the first face object, and then a type object based on the user's skin type based on the overlapping image. It is possible to include a second face object generator that reflects the first face object to complete the creation of the second face object.

The type object is formed in a form corresponding to dry trouble, oily trouble, sensitive trouble, pigmentation trouble, atopic trouble, dermatitis trouble, and sebum trouble formed on the user's facial skin based on the overlapping image, and is displayed on the first face. It is possible that it is a virtual object that is reflected in the object.

When the generation of the second face object is completed, the styling information acquisition unit generates reference face objects based on each of a plurality of pre-stored reference shape information through a pre-stored second artificial intelligence algorithm, and generates each of the generated reference face objects. and a comparative analysis process start unit that starts a comparative analysis process for the second facial object; When the comparative analysis process starts, each of the reference face objects is compared with the second face object to determine whether there is a reference face object among the reference face objects whose similarity rate with the second face object is greater than or equal to a specified value. a similarity rate confirmation unit; And if there is a reference face object among the reference face objects whose similarity rate with the second face object is more than a specified value, identifying styling information matched to the reference shape information corresponding to the reference face object whose similarity rate is more than the specified value. It is possible to include a styling information identification unit.

The plurality of pre-stored reference shape information is source information used to implement a facial object that is a 3D model corresponding to the head of a celebrity or other user, and it is possible that styling information is matched to each piece of information. do.

The pre-stored second artificial intelligence algorithm machine-learns the correlation between the plurality of pre-stored reference shape information and the styling information matched to each of the pre-stored plurality of reference shape information, and determines the pre-stored plurality of criteria in an external database. It is possible to receive new styling information for each piece of shape information and update the matching relationship for the plurality of previously stored reference shape information.

The styling information is a configuration that matches each of the plurality of pre-stored reference styling information, and includes a hair styling object and a makeup styling object for changing the hairstyle and makeup style of the second face object,

It is possible to include guide information for guiding a makeup method corresponding to the makeup styling object.

The style recommendation unit includes: a styling object reflection unit that reflects a hair styling object and a makeup styling object based on the styling information to the second face object when acquisition of the styling information is completed; And when the function of the styling object reflection unit is completed, the color based on the customized color tone information is reflected in the makeup styling object to generate a third face object, and the third face object is output through the display to the user. It is possible to include a guide information output unit that recommends a customized style to the user and also outputs makeup guide information for guiding a makeup method corresponding to the makeup styling object reflected in the second face object.

The present inventor's virtual experience device that recommends a customized style to a user is a facial object corresponding to the user's head with a suitable styling object based on the shape of the user's head (e.g., eyebrows, eyes, nose, lips, ears, face shape, and head shape). (e.g. hair styling object and makeup styling object) and customized color tone information matching the user's skin tone, various styles customized to the user can be recommended.

Additionally, by recommending a makeup style suitable for the user's skin type, it is possible to cover skin diseases suffered by the user.

1 is a block diagram for explaining a virtual experience device that recommends a customized style to a user according to an embodiment of the present invention.

Figure 2 is a block diagram illustrating a user skin analysis unit of a virtual experience device through a virtual experience device that recommends a customized style to a user according to an embodiment of the present invention.

Figure 3 is a block diagram illustrating a skin image acquisition unit of a virtual experience device through a virtual experience device that recommends a customized style to a user according to an embodiment of the present invention.

FIG. 4 is a block diagram illustrating a facial object creation unit of a virtual experience device through a virtual experience device that recommends a customized style to a user according to an embodiment of the present invention.

Figure 5 is a block diagram illustrating a styling information acquisition unit of a virtual experience device through a virtual experience device that recommends a customized style to a user according to an embodiment of the present invention.

Figure 6 is a block diagram illustrating a style recommendation unit of a virtual experience device through a virtual experience device that recommends a customized style to a user according to an embodiment of the present invention.

FIG. 7 is a diagram for explaining an example of the internal configuration of a computing device according to an embodiment of the present invention.

BRIEF DESCRIPTION OF THE DRAWINGS Various embodiments and/or aspects are now disclosed with reference to the drawings. In the following description, for purposes of explanation, numerous specific details are set forth to facilitate a general understanding of one or more aspects. However, it will also be appreciated by those skilled in the art that this aspect(s) may be practiced without these specific details. The following description and accompanying drawings set forth in detail certain example aspects of one or more aspects. However, these aspects are illustrative and some of the various methods in the principles of the various aspects may be utilized, and the written description is intended to encompass all such aspects and their equivalents.

As used herein, “embodiment,” “example,” “aspect,” “example,” etc. may not be construed to mean that any aspect or design described is better or advantageous than other aspects or designs. .

Additionally, the terms "comprise" and/or "comprising" mean that the feature and/or element is present, but exclude the presence or addition of one or more other features, elements and/or groups thereof. It should be understood as not doing so.

Additionally, terms containing ordinal numbers, such as first, second, etc., may be used to describe various components, but the components are not limited by the terms. The above terms are used only for the purpose of distinguishing one component from another. For example, a first component may be referred to as a second component, and similarly, the second component may be referred to as a first component without departing from the scope of the present invention. The term and/or includes any of a plurality of related stated items or a combination of a plurality of related stated items.

In addition, in the embodiments of the present invention, unless otherwise defined, all terms used herein, including technical or scientific terms, are as commonly understood by a person of ordinary skill in the technical field to which the present invention pertains. It has the same meaning. Terms defined in commonly used dictionaries should be interpreted as having a meaning consistent with the meaning in the context of the related technology, and unless clearly defined in the embodiments of the present invention, have an ideal or excessively formal meaning. It is not interpreted as

Referring to FIG. 1, a virtual experience device 100 (hereinafter referred to as a virtual experience device) for recommending a customized style to a user is implemented in a computing device including one or more processors and one or more memories storing instructions executable by the processor. ) may include a user skin analysis unit 101, a face object creation unit 103, a styling information acquisition unit 105, and a style recommendation unit 107.

According to one embodiment, the user skin analysis unit 101, when the first camera 101a located in one area of the main body photographs the user's facial skin and obtains skin image information reflecting the user's skin condition, pre-stored By analyzing the skin image information through the first artificial intelligence algorithm 101b, the user's skin tone can be identified and customized color tone information corresponding to the identified skin tone can be obtained.

According to one embodiment, the first camera 101a is located in one area of the main body of the virtual experience device and may be configured to photograph the user's facial skin. A separate lighting module may be formed in one area of the first camera 101a to radiate light to the area of the user's skin being imaged when photographing the user's facial skin.

In relation to the above, the first camera 101a can photograph not only the user's facial skin, but also the skin of other body parts other than the user's facial area. At this time, the virtual experience device 100 measures the oil and moisture status of the user's skin as well as the lighting module in one area in order to check the user's skin condition by photographing not only the user's facial skin but also the skin of other body parts. A sensor capable of detection may be located in one area.

Accordingly, the virtual experience device 100 determines whether the user's skin type is normal or dry based on data acquired through the first camera 101a and a sensor capable of detecting the oil and moisture state of the user's skin. You can determine whether the skin type is oily type, sensitive type, pigmentation type, atopic type, or sebum type. In addition, the virtual experience device 100 is based on data acquired through the first camera 101a and a sensor capable of detecting the oil and moisture state of the user's skin, and determines whether one area of the user's skin is a stretch mark area or vitiligo. It is possible to identify at least one of an area and a wound area. According to one embodiment, the user skin analysis unit 101 may acquire skin image information from the first camera 101a. The skin image information is information generated by photographing the user's facial skin and may include at least one of an image and a video. The skin image information may include first image information that is image information about the outer layer of the user's facial skin and second image information that is image information about the base layer of the user's facial skin.

According to one embodiment, when the acquisition of the skin image information is completed, the user skin analysis unit 101 may analyze the acquired skin image information through the pre-stored first artificial intelligence algorithm.

According to one embodiment, the pre-stored first artificial intelligence algorithm 101b is an algorithm for analyzing the skin image information to identify the user's skin tone and obtaining color tone information that is a personal color suitable for the identified user's skin tone. It can be.

According to one embodiment, the pre-stored first artificial intelligence algorithm 101b may include at least one of a supervised learning algorithm, a semi-supervised learning algorithm, and an unsupervised learning algorithm, but is not limited thereto. The pre-stored first artificial intelligence algorithm 101b analyzes the skin tone of other users or celebrities and the correlation between the skin type and color tone information in order to identify the user's skin tone and the user's skin type through the skin image information. And it may be a learning algorithm.

In addition, the previously stored first artificial intelligence algorithm 101b may include an artificial neural network model (ANN model), a convolution neural network model (CNN model), and a recurrent neural network model (RNN model), and various other models. Algorithms may be included.

Accordingly, the user skin analysis unit 101 analyzes the user's skin image information through the pre-stored first artificial intelligence algorithm 101b, identifies the user's skin tone through the analysis result, and identifies the identified skin tone. You can obtain hue information, which is a personal color that matches. At this time, there may be one or more color tone information matching the user's skin tone. That is, the color tone mentioned in the present invention corresponds to a personal color that matches the user's skin tone, and the color tone information may be personal color information that matches the user's skin tone.

At this time, the user skin analysis unit 101 identifies (or determines) the average value of the skin color based on the first image information and the skin color based on the second image information as the skin tone for the user's facial skin. )can do.

According to one embodiment, when the facial object creation unit 103 completes the function of the user skin analysis unit 101, the second camera 103a located in one area of the main body photographs the user's head and When model data, which is 3D scan data, is acquired, a first facial object, which is a 3D stereoscopic model, can be created on the user's head based on the acquired model data. When the face object creation unit 103 completes generating the first face object, the user's skin tone identified by the user skin analysis unit 101 may be reflected in the first face object.

According to one embodiment, the second camera 103a may be configured to photograph (or scan) the user's head. Accordingly, the second camera 103a scans (or photographs) the user's head and generates model data that can generate a 3D stereoscopic model corresponding to the shape and position of the user's facial features, face shape, and head shape. Can be acquired (or created). The model data may be source information for implementing the user's head as a 3D model in a virtual space.

According to one embodiment, when the second camera 103a acquires the model data, the facial object generator 103 creates a 3D stereoscopic model of the user's head based on the acquired model data. 1 You can create a face object. The first face object may refer to a virtual object corresponding to the shape and position of the eyebrows, eyes, nose, ears, face shape, and lips included in the user's head, and the shape of the head (or hair). That is, the first facial object may be a 3D model formed in a shape corresponding to the user's head.

According to one embodiment, when the generation of the first face object is completed, the face object creation unit 103 selects the skin color corresponding to the skin tone of the user identified by the user skin analysis unit 101 to the first face object. It can be reflected in the face object. For example, when the face object creation unit 103 completes generating the first face object corresponding to the head of user “A”, the skin tone of user “A” identified in the user skin analysis unit 101 The skin color corresponding to the skin index may be reflected in the first facial object.

At this time, the face object generator 103 may reflect a skin color based on a skin code (eg, #D99164) corresponding to the user's skin tone to the first face object.

According to one embodiment, when the skin tone is reflected in the first face object and the creation of the second face object 103b is completed, the styling information acquisition unit 105 uses a pre-stored second artificial intelligence algorithm. By comparing a reference face object based on a plurality of pieces of stored reference shape information with the second face object, reference shape information with a similarity rate greater than or equal to a specified value can be confirmed, and styling information corresponding to the confirmed reference shape information can be obtained.

According to one embodiment, the plurality of pre-stored reference shape information is source information for implementing facial objects of celebrities or other users in a virtual space, and styling information may be matched to each reference shape information. You can. The styling information matched to each of the reference shape information may be information including hairstyle and makeup information suitable for the shape of the reference face object based on each of the reference shape information.

According to one embodiment, the styling information acquisition unit 105 may generate a face object corresponding to a plurality of pre-stored reference shape information based on a pre-stored second artificial intelligence algorithm and implement the facial object in a virtual space. In relation to the above, when the styling information acquisition unit 105 completes the implementation of the face object corresponding to the plurality of pre-stored reference shape information, it may compare it with the user's second face object 103b.

According to one embodiment, the styling information acquisition unit 105 selects a face object whose similarity rate with the user's second face object 103b is greater than or equal to a specified value among the face objects corresponding to each of the plurality of pre-stored reference shape information. You can identify and check shape information corresponding to the identified face object.

In relation to the above, the styling information acquisition unit 105 determines the similarity rate with the user's second facial object 103b in the facial object corresponding to each of the plurality of pre-stored reference shape information, and determines the eyebrows and facial features respectively. You can check the similarity rate based on the shape, location, and angle, and you can check the similarity rate based on the shape of the face and head.

In relation to the above, the styling information acquisition unit 105 corresponds to each of a plurality of pre-stored reference shape information reflecting a skin tone included in the same series as the user's skin tone reflected in the second face object 103b. The face object and the second face object 103b may be compared. The skin tone series can be divided into spring warm tone, summer cool tone, fall warm tone, and winter cool tone. As a detailed series, spring warm tone can be composed of light series, bright series, and vivid series, and summer cool tone can be composed of light series, Cool mute series and soft series may be composed, autumn warm tones may be composed of warm mute series, soft series, and deep series, and winter cool tones may be composed of deep series, clear series, and bright series.

According to one embodiment, the styling information acquisition unit 105 selects a face object whose similarity rate with the user's second face object 103b is greater than or equal to a specified value among the face objects corresponding to each of the plurality of pre-stored reference shape information. If confirmed, styling information corresponding to the reference shape information corresponding to the confirmed face object can be obtained.

According to one embodiment, the styling information may be information including hairstyle information and makeup information suitable for a reference face object based on the reference shape information.

In relation to the above, the hair style information may include recommended hair salon information, hair style cost information, hair style name information, hair style care information, hair style price information, and recommended dyeing information. In addition, the hair style information may include a hair styling object. The hair styling object may be a virtual object to reflect the same hairstyle as that of another user in the second face object 103b.

Additionally, the makeup information may include makeup name information, makeup guide (eg, guide video) information, and makeup product information. In addition, the makeup style information may include a makeup styling object. The makeup styling object may be a virtual object for reflecting the same makeup style as that of another user on the second face object 103b.

According to one embodiment, the pre-stored second artificial intelligence algorithm may be an algorithm for checking the similarity rate by comparing a reference face object based on a plurality of pre-stored reference shape information with the user's second facial object 103b. . Additionally, the pre-stored second artificial intelligence algorithm may be an algorithm that analyzes and learns the correlation between the plurality of pre-stored reference shape information and styling information matched to each of the pre-stored plurality of reference shape information. At this time, the pre-stored second artificial intelligence algorithm can analyze and learn the correlation through a plurality of pre-stored reference shape information for other users and celebrities.

Accordingly, the pre-stored second artificial intelligence algorithm may receive new styling information from an external database and match the new styling information to each of the plurality of pre-stored reference shape information based on learning results.

That is, the pre-stored second artificial intelligence algorithm may include at least one of a supervised learning algorithm, a semi-supervised learning algorithm, and an unsupervised learning algorithm, but is not limited thereto. The pre-stored second artificial intelligence algorithm may be an algorithm that receives new styling information based on learning results and learns the relationship between a plurality of pre-stored reference shape information and styling information in order to match it to a plurality of pre-stored reference shape information. there is. In addition, the pre-stored artificial intelligence algorithm may include an artificial neural network model (ANN model), a convolution neural network model (CNN model), and a recurrent neural network model (RNN model), and may also include algorithms of various models. You can.

According to one embodiment, when the style recommendation unit 107 completes acquisition of the customized color tone information and styling information, the style recommendation unit 107 creates a third face reflecting a style based on the customized color tone information and the styling information in the second face object 103b. By creating an object 107a, the created third facial object 107a can be output through a display located in one area of the main body to recommend a customized style to the user.

In relation to the above, since the customized color tone information and the styling information may be plural, various third face objects 107a can be generated by reflecting various styles in the second face object 103b.

Referring to FIG. 2, a virtual experience device that recommends a customized style to a user (e.g., a virtual experience device that recommends a customized style to a user) implemented in a computing device including one or more processors and one or more memories that store instructions executable by the processor The virtual experience device 100 (hereinafter referred to as a virtual experience device) may include a user skin analysis unit 200 (eg, the user skin analysis unit 101 of FIG. 1).

According to one embodiment, the user skin analysis unit 200 uses a first camera 201a (e.g., the first camera 101a in FIG. 1) located in one area of the main body to photograph the user's facial skin and analyze the user's skin. When acquiring skin image information reflecting the condition, the skin image information can be analyzed through a pre-stored first artificial intelligence algorithm to identify the user's skin tone and obtain customized color tone information corresponding to the identified skin tone. there is.

According to one embodiment, the user skin analysis unit 200 has a detailed configuration for performing the above-described functions, including a skin image acquisition unit 201, an analysis process start unit 203, a skin type identification unit 205, and It may include a customized color tone information determination unit 207.

According to one embodiment, when the first camera 201a captures the user's facial skin, the skin image acquisition unit 201 controls the lighting module located in one area of the first camera 201a to control the facial skin. First image information 201b, which is image information about the outer layer of the skin, and second image information 201c, which is image information about the base layer of the skin, can be obtained.

According to one embodiment, the first camera 201a may have a lighting module located in one area. Accordingly, the capturing area (eg, skin layer) of the user's facial skin captured by the first camera 201a may change depending on the amount of light emitted from the lighting module.

According to one embodiment, when the analysis process start unit 203 completes the acquisition of the first image information 201b and the second image information 201c, the first image information 201c is processed through a pre-stored first artificial intelligence algorithm. A skin condition analysis process may be started by analyzing the image information 201b and the second image information 201c.

According to one embodiment, the skin condition analysis process may be a process performed to identify the skin tone of the user's facial skin and identify the user's skin type 203a.

According to one embodiment, the user's skin type 203a may include normal type, dry type, oily type, sensitive type, pigmentation type, atopic type, dermatitis type, and sebum type. That is, the skin condition analysis process identifies the user's skin type (203a) by analyzing the first image information (201b) and the second image information (201c) through the pre-stored first artificial intelligence algorithm. At the same time, it may be a process of identifying the user's skin tone.

According to one embodiment, when the skin condition analysis process starts, the skin type identification unit 205 overlaps an image based on the first image information 201b and an image based on the second image information 201c to , the user's skin type 203a can be identified through the overlapping images.

For example, the skin type identification unit 205 may overlap an image based on the first image information of user “A” and an image based on the second image information, and analyze the overlapped image. The skin type identification unit 205 may confirm that an image object corresponding to pigmentation exists in the overlapping image by analyzing the overlapping image using the pre-stored first artificial intelligence algorithm. Accordingly, the skin type identification unit 205 can confirm that the user's skin type 203a is a pigmentation type.

According to one embodiment, the customized color tone information determination unit 207 determines the first skin color and the second skin color based on the first image information 201b while the function of the skin type identification unit 205 is being performed. The skin color corresponding to the average value of the second skin color based on the image information 201c may be identified as the user's skin tone.

In relation to the above, the customized color tone information determination unit 207 may obtain the average value of the first skin color and the second skin color from the previously stored skin color data table 205a. Accordingly, the customized color tone information determination unit 207 may extract skin color information corresponding to the obtained average value from the previously stored skin color data table 205a.

According to one embodiment, when the customized color tone information determination unit 207 completes the extraction of the skin color information, it may identify the skin color based on the extracted skin color information as the user's skin tone.

Accordingly, the customized color tone information determination unit 207 determines at least one of the plurality of color tone information 207a previously stored through the first artificial intelligence algorithm 209 that matches the skin tone 205a of the identified user. One piece of color tone information can be determined as customized color tone information tailored to the user's skin tone. The customized color tone information determination unit 207 may identify the series of the identified user's skin tone 205a through a pre-stored first artificial intelligence algorithm 209.

According to one embodiment, the skin tone series can be divided into spring warm tone, summer cool tone, autumn warm tone, and winter cool tone, and as a detailed series, spring warm tone can be composed of light series, bright series, and vivid series, Summer cool tones can be composed of light, cool-mute and soft tones, fall warm tones can be composed of warm-mute, soft and deep tones, and winter cool tones can be composed of deep, clear and bright tones. You can.

Accordingly, the customized tone information determination unit 207 selects at least one tone information corresponding to a series and detailed series corresponding to the user's skin tone among the plurality of pre-stored tone information 207a for the user's skin tone. This can be decided with customized color tone information. Skin color information according to the series and detailed series may be matched to each of the plurality of color tone information.

Accordingly, the customized color tone information determination unit 207 may determine at least one color tone information corresponding to a series and a detailed series corresponding to the user's skin tone as customized color tone information for the user's skin tone. The customized color tone information may be information containing a color suitable for the user's skin tone.

According to one embodiment, the pre-stored first artificial intelligence algorithm 209 determines the correlation between the plurality of pre-stored skin color information stored in the pre-stored skin color data table 205a and the pre-stored plurality of color tone information 207a. It may be an algorithm for confirmation. Additionally, the pre-stored first artificial intelligence algorithm 209 may be an algorithm for identifying the user's skin type by analyzing overlapping images.

Referring to FIG. 3, a virtual experience device that recommends a customized style to a user (e.g., a virtual experience device that recommends a customized style to a user) implemented in a computing device including one or more processors and one or more memories that store instructions executable by the processor The virtual experience device 100 (hereinafter referred to as a virtual experience device) may include a skin image acquisition unit 300 (eg, the skin image acquisition unit 201 of FIG. 2).

According to one embodiment, when the first camera captures the user's facial skin, the skin image acquisition unit 300 controls the lighting module located in one area of the first camera to detect the outer layer of the facial skin. First image information, which is image information, and second image information, which is image information about the basal layer of the skin, can be obtained.

According to one embodiment, the skin image acquisition unit 300 may include a light quantity control unit 301 and a second image acquisition unit 303 as detailed components for performing the above-described functions.

According to one embodiment, when the first camera photographs the user's facial skin, the light quantity control unit 301 controls a lighting module located in one area of the first camera to increase the amount of light irradiated to the facial skin, The first camera may be configured to image the basal layer 305b located below the outer layer 305a of the facial skin.

According to one embodiment, when the first camera photographs the user's facial skin, the light quantity control unit 301 controls the lighting module located in one area of the first camera to detect sebum using the light irradiated on the facial skin. You can change the light as much as possible. Accordingly, the first camera may acquire image information 305c showing sebum formed on the user's facial skin. The image information on the sebum formation may be information used to distinguish the user's skin type.

In relation to the above, the light quantity control unit 301 may control the lighting module to adjust the amount of light irradiated to the user's skin, thereby allowing the first camera to acquire data capturing the user's skin. Accordingly, the virtual experience device (e.g., the virtual experience device 100 in FIG. 1) identifies the tone of the user's skin through data acquired through the first camera and determines what type of skin the user has. can be identified.

According to one embodiment, the second image acquisition unit 303 captures the hair and basal layer of the facial skin by using the first camera to photograph the basal layer of the facial skin while the light quantity is increased by the light quantity control unit 301. When obtaining third image information including this, hair on the facial skin can be removed from the image based on the third image information to obtain second image information including only the basal layer.

More specifically, when the first camera acquires the third image information, the second image acquisition unit 303 may remove an image object corresponding to hair from an image based on the third image information.

Referring to FIG. 4, a virtual experience device that recommends a customized style to a user (e.g., a virtual experience device that recommends a customized style to a user) implemented in a computing device including one or more processors and one or more memories that store instructions executable by the processor The virtual experience device 100 (hereinafter referred to as a virtual experience device) may include a face object generator 400 (eg, the face object generator 103 in FIG. 1 ).

According to one embodiment, the face object creation unit 400 uses a second camera located in one area of the main body when the function of the user skin analysis unit (e.g., the user skin analysis unit 101 in FIG. 1) is completed. When acquiring model data, which is 3D scan data, by photographing the user's head, a first facial object, which is a 3D stereoscopic model of the user's head, is created based on the acquired model data and identified by the user skin analysis unit. The skin tone may be reflected in the first facial object.

According to one embodiment, the face object creation unit 400 may include an object modeling unit 401 and a second face object creation unit 403 as detailed components for performing the above-described functions.

According to one embodiment, when the second camera acquires model data, the object modeling unit 401 starts a modeling process and creates a virtual object corresponding to the shape of the user's head based on the acquired model data. The first face object 401a, which is a 3D model, can be created.

In relation to the above, the object modeling unit 401 may implement the first facial object 401a corresponding to the shape of the user's head in a virtual space based on the model data. At this time, the first facial object 401a may be implemented in a form that corresponds to the shape and position of the user's facial features, face shape, and head shape.

According to one embodiment, when the second face object creation unit 403 completes the creation of the first face object 401a, the user's skin tone identified by the user skin analysis unit is converted into the first face object. It can be reflected in (401a). Accordingly, a skin tone of the same color as the user's skin color may be reflected in the first facial object 401a.

In relation to the above, when the reflection of the skin tone on the first face object 401a is completed, the second face object creation unit 403 identifies the user skin analysis unit through a pre-stored first artificial intelligence algorithm. A type object based on the user's skin type may be reflected in the first face object 401a.

According to one embodiment, the user's skin type is confirmed by the user's skin analysis unit analyzing the overlapping image through the pre-stored first artificial intelligence algorithm, and is divided into normal type, dry type, oily type, and sensitive type. , pigmentation type, atopic type, dermatitis type, and sebum type.

According to one embodiment, the second face object generator 403 may reflect a type object based on the user's skin type to the first face object 401a. The type object is formed in a form corresponding to dry trouble, oily trouble, sensitive trouble, pigmentation trouble, atopic trouble, dermatitis trouble, and sebum trouble formed on the user's facial skin based on the overlapping image, and is the first facial object. It may be a virtual object reflected in .

For example, if there is sebum based on sebum type in the overlapping image, the second face object generator 403 generates a type object corresponding to the location and shape of the sebum to create the first face object ( 401a).

Accordingly, the second face object generator 403 can complete the creation of the second face object 403a by reflecting the type object based on the skin type to the first face object 401a.

Referring to FIG. 5, a virtual experience device that recommends a customized style to a user (e.g., a virtual experience device that recommends a customized style to a user) implemented in a computing device including one or more processors and one or more memories that store instructions executable by the processor The virtual experience device 100 (hereinafter referred to as a virtual experience device) may include a styling information acquisition unit 500 (eg, the styling information acquisition unit 105 of FIG. 1 ).

According to one embodiment, when the user's skin tone is reflected in the first face object and the creation of the second face object 503a is completed, the styling information acquisition unit 500 uses a pre-stored second artificial intelligence algorithm. By comparing the second face object 503a with a reference face object based on a plurality of stored reference shape information, reference shape information with a similarity rate greater than a specified value can be confirmed, and styling information corresponding to the confirmed reference shape information can be obtained. there is.

According to one embodiment, the styling information acquisition unit 500 has a detailed configuration for performing the above-described functions, and includes a comparative analysis process start unit 501, a similarity rate check unit 503, and a styling information identification unit 505. may include.

According to one embodiment, when the comparison and analysis process start unit 501 completes the creation of the second face object 503a, the plurality of reference shape information previously stored through the second artificial intelligence algorithm 507 ( 503b) By generating reference face objects based on each of the reference face objects, a comparative analysis process may be started for each of the generated reference face objects and the second face object 503a.

According to one embodiment, the comparative analysis process is a process for comparing the generated second facial object 503a with reference facial objects based on each of the plurality of pre-stored reference formation information 503b, and more precisely, The shape and position of the eyebrows, eyes, nose, ears, face shape, and lips included in the user's head based on the second face object 503a, and the shape of the head (or hair) are based on the reference face object. , it may be a process to check how similar the shape and position of the ears, face shape, and lips are to the shape of the head (or hair).

According to one embodiment, when the comparative analysis process starts, the similarity rate checker 503 compares each of the reference face objects with the second face object 503a, and compares the second face object 503a with each of the reference face objects. 2 You can check whether there is a reference face object whose similarity rate with the face object is more than a specified value.

According to one embodiment, the plurality of pre-stored reference shape information 503b is source information used to implement a facial object that is a 3D three-dimensional model corresponding to the head of a celebrity or other user, and each piece of information Styling information may be in a matched state. However, the plurality of previously stored reference shape information 503b may include skin color based on the skin tone of the celebrity or other user.

According to one embodiment, the similarity rate check unit 503 compares each of the reference face objects with the second face object 503a, and the shape and position of eyebrows, eyes, nose, ears, face shape, and lips. You can check the similarity rate based on the shape of the head. In other words, the similarity rate confirmation unit 503 can be used to compare not only the shape and position but also the formation angles of eyebrows, eyes, nose, ears, face shape, and lips when checking the similarity rate.

In more detail, the similarity rate check unit 503 implements the reference face objects and the second face object 503a in a virtual space, and arranges or overlaps them to include eyebrows, eyes, nose, ears, face shape, and lips. You can check the similarity rate for the shape and location of and the shape of the head. However, the similarity rate check unit 503 only selects the reference face object having the same series (or detailed series) as the skin tone series (or detailed series) reflected in the second face object 503a among the reference face objects. You can select the comparison target and check the similarity rate.

According to one embodiment, the specified value is calculated based on the shape and position of the eyebrows, eyes, nose, ears, face shape, and lips of each of the reference face objects, and the shape of the head of the eyebrows, eyes, and eyes of the second face object 503a. , a standard value for identifying how similar the shape and position of the nose, ears, face, and lips are to the shape and position of the head; the shape and position of the eyebrows, eyes, nose, ears, face, and lips; and the shape of the head. A specified value for each, or an average value of the specified values for each of the shape and position of eyebrows, eyes, nose, ears, face shape, and lips, and the shape of the head may be set.

According to one embodiment, the styling information identification unit 505 determines that if there is a reference face object whose similarity rate with the second face object 503a is more than a specified value among the reference face objects, the similarity rate is more than the specified value. Styling information matched to reference shape information corresponding to the reference face object can be identified.

According to one embodiment, the styling information matched to the reference shape information may mean style information of a celebrity or another user corresponding to a reference face object based on the reference shape information. More specifically, the styling information may include hairstyle information and makeup information.

In relation to the above, the hair style information may include recommended hair salon information, hair style cost information, hair style name information, hair style care information, hair style price information, and recommended dyeing information. In addition, the hair style information may include a hair styling object. The hair styling object may be a virtual object to reflect the same hairstyle as that of another user in the second face object 503a.

Additionally, the makeup information may include makeup name information, makeup guide (eg, guide video) information, and makeup product information. In addition, the makeup style information may include a makeup styling object. The makeup styling object may be a virtual object for reflecting the same makeup style as that of another user on the second face object 503a.

According to one embodiment, the pre-stored second artificial intelligence algorithm 507 performs machine learning on the correlation between the plurality of pre-stored reference shape information 503b and styling information, and determines the pre-stored plurality of criteria in an external database. By receiving new styling information for each piece of shape information, the matching relationship for the plurality of previously stored reference shape information can be updated. The styling information may already be matched to the plurality of pre-stored reference shape information 503b or may be information for newly matching.

Referring to FIG. 6, a virtual experience device that recommends a customized style to a user (e.g., a virtual experience device that recommends a customized style to a user) implemented in a computing device including one or more processors and one or more memories that store instructions executable by the processor The virtual experience device 100 (hereinafter referred to as a virtual experience device) may include a style recommendation unit 600 (eg, the style recommendation unit 107 in FIG. 1 ).

According to one embodiment, when the style recommendation unit 600 completes the acquisition of the customized color tone information and styling information, the style based on the customized color tone information and the styling information is reflected on the second face object 601a to create a third face object 601a. By creating a face object 601b, the generated third face object 601b can be output through a display located in one area of the main body to recommend a customized style to the user.

According to one embodiment, the style recommendation unit 600 may include a styling object reflection unit 601 and a guide information output unit 603 as detailed components for performing the above-described functions.

According to one embodiment, when acquisition of styling information is completed, the styling object reflection unit 601 may reflect a hair styling object and a makeup styling object based on the styling information on the second face object 601a.

In relation to the above, the hair styling object is a component included in the hairstyle information included in the styling information, and is a virtual object for reflecting a hairstyle based on the hairstyle information in the second face object 601a. It can be. Additionally, the makeup object may be a configuration included in the makeup information included in the styling information and may be a virtual object for reflecting a makeup style based on the makeup information on the second face object 601a. there is.

According to another embodiment, the styling object reflection unit 601 displays the hair styling object and the makeup styling object based on the styling information on the second face object 601a before reflecting it on the second face object 601a. You can check your skin type.

In relation to the above, the styling object reflection unit 601 may check the location and shape of the type object located in the second face object 601a in order to confirm the skin type of the second face object 601a. there is. The styling object reflection unit 601 confirms the location and shape of the type object located in the second face object 601a, modifies the shape of the makeup styling object, or custom color tone information reflected in the makeup styling object. can be changed.

For example, the styling object reflection unit 601 may determine that the skin type of the second face object 601a is “pigmentation type” and the type object corresponding to “pigmentation type” is the second face object 601a. ), change some of the makeup styling objects reflected on the nose to a form that can cover the "pigmentation" type object, or change the color of the deposition area based on the "pigmentation" type object to the nearby skin. You can change it to the same hue as the color.

At this time, the styling object reflection unit 601 may check the skin type of the second face object through a pre-stored first artificial intelligence algorithm and identify a type object based on the identified skin type. The pre-stored first artificial intelligence algorithm is an algorithm that identifies face objects, and at the same time identifies face objects based on shape information of other users and celebrities, identifies skin tone and skin type, and identifies the identified skin tone, skin type, and color tone. It may be an algorithm that can analyze and learn the correlation of information.

According to one embodiment, when the function of the styling object reflection unit 601 is completed, the guide information output unit 603 reflects the color based on the customized color tone information to the makeup styling object to create a third face object ( 601b), output the third face object 601b through the display, recommend a customized style to the user, and recommend a makeup method corresponding to the makeup styling object reflected in the second face object 601a. Make-up guide information 603a for guidance can also be output.

According to one embodiment, the makeup guide information 603a is information about makeup methods for a user to perform makeup corresponding to the makeup styling object, including the order of makeup methods, products used for makeup methods, and when performing makeup methods. Information may include precautions (e.g., prohibiting use of a product for certain skin diseases, darker shades for certain facial areas), etc.

FIG. 7 illustrates an example of the internal configuration of a computing device according to an embodiment of the present invention. In the following description, descriptions of unnecessary embodiments that overlap with the description of FIGS. 1 to 6 described above will be omitted. Do this.

As shown in FIG. 7, the computing device 10000 includes at least one processor 11100, a memory 11200, a peripheral interface 11300, and an input/output subsystem ( It may include at least an I/O subsystem (11400), a power circuit (11500), and a communication circuit (11600). At this time, the computing device 10000 may correspond to a user terminal (A) connected to a tactile interface device or the computing device (B) described above.

The memory 11200 may include, for example, high-speed random access memory, magnetic disk, SRAM, DRAM, ROM, flash memory, or non-volatile memory. there is. The memory 11200 may include software modules, instruction sets, or various other data necessary for the operation of the computing device 10000.

At this time, access to the memory 11200 from other components, such as the processor 11000 or the peripheral device interface 11300, may be controlled by the processor 11000.

The peripheral interface 11300 may couple input and/or output peripherals of the computing device 10000 to the processor 11000 and memory 11200. The processor 11000 may execute a software module or set of instructions stored in the memory 11200 to perform various functions for the computing device 10000 and process data.

The input/output subsystem 11400 can couple various input/output peripheral devices to the peripheral interface 11300. For example, the input/output subsystem 11400 may include a controller for coupling peripheral devices such as a monitor, keyboard, mouse, printer, or, if necessary, a touch screen or sensor to the peripheral device interface 11300. According to another aspect, input/output peripheral devices may be coupled to the peripheral interface 11300 without going through the input/output subsystem 11400.

Power circuit 11500 may supply power to all or some of the terminal's components. For example, power circuit 11500 may include a power management system, one or more power sources such as batteries or alternating current (AC), a charging system, a power failure detection circuit, a power converter or inverter, a power status indicator, or a power source. It may contain arbitrary other components for creation, management, and distribution.

The communication circuit 11600 may enable communication with another computing device using at least one external port.

Alternatively, as described above, if necessary, the communication circuit 11600 may include an RF circuit to transmit and receive RF signals, also known as electromagnetic signals, to enable communication with other computing devices.

This embodiment of FIG. 7 is only an example of the computing device 10000, and the computing device 10000 may omit some components shown in FIG. 7, further include additional components not shown in FIG. 7, or 2. It may have a configuration or arrangement that combines more than one component. For example, a computing device for a communication terminal in a mobile environment may further include a touch screen or a sensor in addition to the components shown in FIG. 7, and the communication circuit 11600 may be equipped with various communication methods (WiFi, 3G, LTE). , Bluetooth, NFC, Zigbee, etc.) may also include a circuit for RF communication. Components that may be included in the computing device 10000 may be implemented as hardware, software, or a combination of both hardware and software, including one or more signal processing or application-specific integrated circuits.

Methods according to embodiments of the present invention may be implemented in the form of program instructions that can be executed through various computing devices and recorded on a computer-readable medium. In particular, the program according to this embodiment may be composed of a PC-based program or a mobile terminal-specific application. The application to which the present invention is applied can be installed on a user terminal through a file provided by a file distribution system. As an example, the file distribution system may include a file transmission unit (not shown) that transmits the file according to a request from the user terminal.

The device described above may be implemented with hardware components, software components, and/or a combination of hardware components and software components. For example, devices and components described in embodiments may include, for example, a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable gate array (FPGA), It may be implemented using one or more general-purpose or special-purpose computers, such as a programmable logic unit (PLU), microprocessor, or any other device capable of executing and responding to instructions. A processing device may execute an operating system (OS) and one or more software applications that run on the operating system. Additionally, a processing device may access, store, manipulate, process, and generate data in response to the execution of software. For ease of understanding, a single processing device may be described as being used; however, those skilled in the art will understand that a processing device may include multiple processing elements and/or multiple types of processing elements. It can be seen that it may include. For example, a processing device may include a plurality of processors or one processor and one controller. Additionally, other processing configurations, such as parallel processors, are possible.

Software may include a computer program, code, instructions, or a combination of one or more of these, which may configure a processing unit to operate as desired, or may be processed independently or collectively. You can command the device. Software and/or data may be used by any type of machine, component, physical device, virtual equipment, computer storage medium or device to be interpreted by or to provide instructions or data to a processing device. It can be embodied permanently or temporarily. Software may be distributed over networked computing devices and stored or executed in a distributed manner. Software and data may be stored on one or more computer-readable recording media.

The method according to the embodiment may be implemented in the form of program instructions that can be executed through various computer means and recorded on a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, etc., singly or in combination. Program instructions recorded on the medium may be specially designed and configured for the embodiment or may be known and available to those skilled in the art of computer software. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical media such as CD-ROMs and DVDs, and magnetic media such as floptical disks. -Includes optical media (magneto-optical media) and hardware devices specifically configured to store and execute program instructions, such as ROM, RAM, flash memory, etc. Examples of program instructions include machine language code, such as that produced by a compiler, as well as high-level language code that can be executed by a computer using an interpreter, etc. The hardware devices described above may be configured to operate as one or more software modules to perform the operations of the embodiments, and vice versa.

As described above, although the embodiments have been described with limited examples and drawings, various modifications and variations can be made by those skilled in the art from the above description. For example, the described techniques are performed in a different order than the described method, and/or components of the described system, structure, device, circuit, etc. are combined or combined in a different form than the described method, or other components are used. Alternatively, appropriate results may be achieved even if substituted or substituted by an equivalent. Therefore, other implementations, other embodiments, and equivalents to the claims also fall within the scope of the claims described below.

Claims

In the virtual experience device for recommending a customized style to a user implemented in a computing device including one or more processors and one or more memories storing instructions executable by the processor,

When the first camera located in one area of the main body captures the user's facial skin and obtains skin image information reflecting the user's skin condition, the skin image information is analyzed through a pre-stored first artificial intelligence algorithm to determine the user's skin condition. a user skin analysis unit that identifies the tone and obtains customized color tone information corresponding to the identified skin tone;

When the function of the user's skin analysis unit is completed and the second camera located in one area of the main body captures the user's head and obtains model data, which is 3D scan data, the user's skin is analyzed based on the obtained model data. a face object generator that generates a first face object that is a 3D model of the head and reflects the identified skin tone to the first face object;

When the skin tone is reflected in the first face object and the creation of the second face object is completed, a reference face object and the second face object based on a plurality of pre-stored reference shape information are created through a pre-stored second artificial intelligence algorithm. a styling information acquisition unit that compares and confirms reference shape information whose similarity rate is greater than or equal to a specified value, and obtains styling information corresponding to the confirmed reference shape information; and

When the acquisition of the customized color tone information and the styling information is completed, a third face object is created by reflecting the style based on the customized color tone information and the styling information in the second face object, and the generated third face object is A virtual experience device that recommends a customized style to a user, comprising a style recommendation unit that recommends a customized style to the user by outputting the output through a display located in one area of the main body.
According to paragraph 1,

The user skin analysis unit,

When the first camera captures the user's facial skin, the lighting module located in one area of the first camera is controlled to provide first image information, which is image information for the outer layer of the facial skin, and the basal layer of the skin. a skin image acquisition unit that acquires second image information, which is image information for the skin;

When the acquisition of the first image information and the second image information is completed, an analysis process that starts a skin condition analysis process of analyzing the first image information and the second image information through the pre-stored first artificial intelligence algorithm. beginning;

When the skin condition analysis process starts, a skin type identification unit that overlaps an image based on the first image information and an image based on the second image information and identifies the user's skin type through the overlapped image; and

While performing the function of the skin type identification unit, the skin color corresponding to the average value of the first skin color based on the first image information and the second skin color based on the second image information is identified as the user's skin tone. Thus, it includes a customized color tone information determination unit that determines at least one color tone information that matches the user's skin tone among the plurality of pieces of color information previously stored as customized color information customized to the user's skin tone,

The user's skin type is,

A virtual experience device that recommends customized styles to users, including normal type, dry type, oily type, sensitive type, pigmentation type, atopic type, dermatitis type, and sebum type.
According to paragraph 2,

The skin image acquisition unit,

When the first camera photographs the user's facial skin, the lighting module is controlled to increase the amount of light irradiated to the facial skin, allowing the first camera to photograph the basal layer located below the outer layer of the facial skin. A light quantity control unit that allows; and

When the first camera acquires third image information including hair and the basal layer of the facial skin by photographing the basal layer of the facial skin while the light quantity is increased by the light quantity control unit, the third image A virtual experience device that recommends a customized style to a user, comprising a second image acquisition unit that removes hair from the facial skin from the information-based image to obtain the second image information including only the basal layer.
According to paragraph 3,

The face object creation unit,

When the second camera acquires the model data, an object that starts a modeling process and generates the first facial object, which is a virtual 3D stereoscopic model corresponding to the shape of the user's head, based on the acquired model data modeling department; and

When the creation of the first face object is completed, the user's skin tone identified by the user skin analysis unit is reflected in the first face object, and then a type object based on the user's skin type is created based on the overlapping image. A virtual experience device that recommends a customized style to a user, comprising a second face object generator that reflects the first face object to complete the creation of the second face object.
According to paragraph 4,

The type object is,

The virtual skin is formed in a shape corresponding to dry skin problems, oily skin problems, sensitive skin problems, pigmentation problems, atopic skin problems, dermatitis problems, and sebum problems formed on the user's facial skin based on the overlapping image, and is reflected in the first facial object. A virtual experience device that recommends a customized style to a user, characterized in that it is an object of.
According to clause 5,

The styling information acquisition unit,

When the creation of the second face object is completed, reference face objects are generated based on each of a plurality of pre-stored reference shape information through a pre-stored second artificial intelligence algorithm, and each of the generated reference face objects and the second face object are generated. Comparative analysis process beginning, which starts the comparative analysis process for;

When the comparative analysis process starts, each of the reference face objects is compared with the second face object to determine whether there is a reference face object among the reference face objects whose similarity rate with the second face object is greater than or equal to a specified value. a similarity rate confirmation unit; and

If there is a reference face object among the reference face objects whose similarity rate with the second face object is more than a specified value, identifying styling information matched to the reference shape information corresponding to the reference face object whose similarity rate is more than the specified value. A virtual experience device that recommends a customized style to a user, comprising a styling information identification unit.
According to clause 6,

The plurality of previously stored reference shape information is,

It is source information used to implement facial objects, which are 3D three-dimensional models corresponding to the heads of celebrities and other users, and is a virtual product that recommends a customized style to the user, characterized by matching styling information to each piece of information. Experience device.
In clause 7,

The pre-stored second artificial intelligence algorithm is,

Machine learning the correlation between the plurality of pre-stored reference shape information and the styling information matched to each of the pre-stored plurality of reference shape information, and receiving new styling information for each of the plurality of pre-stored reference shape information from an external database. A virtual experience device that recommends a customized style to a user, characterized in that the matching relationship for the plurality of previously stored reference shape information is updated.
According to clause 8,

The styling information is,

A configuration that matches each of the plurality of pre-stored reference styling information, and includes a hair styling object and a makeup styling object for changing the hairstyle and makeup style of the second face object,

A virtual experience device that recommends a customized style to a user, comprising guide information for guiding a makeup method corresponding to the makeup styling object.
According to clause 9,

In the style recommendation section,

a styling object reflection unit that reflects a hair styling object and a makeup styling object based on the styling information to the second face object when the acquisition of the styling information is completed; and

When the styling object reflection unit completes its function, the color based on the customized color tone information is reflected in the makeup styling object to create a third face object, and the third face object is output through the display to the user. A guide information output unit that recommends a customized style and outputs makeup guide information for guiding a makeup method corresponding to the makeup styling object reflected in the second face object. Recommended virtual experience device.