WO2018147625A1

WO2018147625A1 - Apparatus and method for searching for make-up product

Info

Publication number: WO2018147625A1
Application number: PCT/KR2018/001623
Authority: WO
Inventors: 박용재; 전희찬; 양영준
Original assignee: (주)아모레퍼시픽
Priority date: 2017-02-08
Filing date: 2018-02-07
Publication date: 2018-08-16
Also published as: KR20180092159A

Abstract

A product search method for a product search apparatus is provided. The product search apparatus analyzes a make-up area extracted from a color image and determines a red-green-blue (RGB) value and a texture degree. The product search apparatus primarily searches for, among a plurality of make-up products, at least one make-up product having a color difference from the determined RGB value, which has a first threshold value or less. Thereafter, the product search apparatus searches for at least one first make-up product corresponding to the determined texture degree among the at least one make-up product that has been primarily found.

Description

Makeup product search device and method

The present invention relates to an apparatus and a method for searching for a makeup product.

Makeup products are used to conceal the flaws of the face and take advantage of them to shape the image in the desired style of each individual. Such makeup products may be foundations, powders, eyebrows, eyeshadows, lipsticks, ball touches, eyeliners, mascaras and the like.

On the other hand, with the recent development of communication technology, a huge amount of image data is accumulated on the Internet. There are various search functions based on such data, and most search functions receive a search keyword in text form from a user and provide an image including the input search keyword as tag information as a search result. Therefore, when a user wants to search for a product in a picture, information that the user can visually check from the corresponding image should be input in a text format.

There is a need for technology that makes it easy and accurate to find makeup products in images (eg photographs).

It is an object of the present invention to provide an apparatus and method for accurately searching and providing a makeup product in an image (eg, a photo).

According to an embodiment of the present invention, a product searching method of a product searching apparatus is provided. The product search method of the product search device may include determining a red-green-blue (RGB) value and a texture degree by analyzing a makeup region extracted from a color image; Searching for at least one makeup product among a plurality of makeup products, wherein the color difference with the determined RGB value is equal to or less than a first threshold value; And searching for at least one first makeup product corresponding to the determined texture degree among the at least one makeup product searched for first.

The determined texture degree may include a glossy value representing a degree of gloss and a pearl value representing a degree of glitter.

The retrieving of the at least one first makeup product comprises: retrieving at least one makeup product having a gloss value equal to a gloss value of the determined texture degree among the at least one makeup product retrieved primarily. ; And searching for the at least one first makeup product having a pearl value equal to a pearl value of the determined texture degree among the at least one makeup product searched for secondary.

When the at least one first makeup product is a product applied to the lips, the makeup area may be a lip area.

In the case where the at least one first makeup product is a fire product, the makeup area may be a cheek area.

If the at least one first makeup product is a product that is applied around the eyes, the makeup area may be an eye area.

The product searching method of the product searching apparatus may include, among the plurality of makeup products, a color difference between an RGB value of the at least one first makeup product or less and a second threshold value, and a texture of the at least one first makeup product. The method may further include searching for at least one second makeup product having a texture degree different from the degree.

According to another embodiment of the present invention, a product searching apparatus is provided. The product search apparatus analyzes a makeup region extracted from a color image to determine a red-green-blue (RGB) value, a glossy value indicating the degree of gloss, and a pearl value indicating the degree of glitter. An analysis unit to determine; And among the plurality of makeup products, first search for at least one makeup product whose color difference with the determined RGB value is equal to or less than a first threshold value, and to the determined glossy value and pearl value among the first searched makeup products. And a search unit for searching for at least one first makeup product.

According to yet another embodiment of the present invention, a user device is provided. The user device comprises a memory; And a processor that controls the memory and extracts a makeup region from a color image and transmits the makeup region to a product search apparatus.

The processor may display the at least one first makeup product when receiving information about the at least one first makeup product searched by the product search apparatus from the product search apparatus.

The at least one first makeup product may be searched by the product search apparatus according to an analysis value extracted from the makeup area.

The analysis value may include a red-green-blue (RGB) value, a glossy value indicating a degree of gloss, and a pearl value indicating a degree of glitter.

According to an embodiment of the present invention, by searching for and providing a makeup product in an image (eg, a photo), a user may conveniently provide a desired makeup product. Through this, the user can easily find the makeup product he / she wants, can easily purchase the product through e-commerce (eg, M-commerce), and can receive customized counseling for the user in the store.

In addition, according to an embodiment of the present invention, by searching for a make-up product in an image (eg, a photo) using a plurality of parameter values (eg, red-green-blue, pearl, glossy), the accuracy of the search can be improved. Can be.

1 is a diagram illustrating a product search system according to an embodiment of the present invention.

2 is a diagram illustrating a configuration of a product searching apparatus according to an embodiment of the present invention.

3 illustrates a lipstick product search of a product search system, in accordance with an embodiment of the invention.

4 is a diagram illustrating a method for a product search system to provide a variation lipstick product for a retrieved lipstick product, according to an embodiment of the invention.

5 is a diagram illustrating a method for a product search system to provide sales information for a selected lipstick product according to an embodiment of the present invention.

6 is a diagram illustrating a store connection service provided by a product search system according to an exemplary embodiment of the present invention.

7 is a diagram illustrating a store visit reservation service provided by a product search system according to an exemplary embodiment of the present invention.

8 is a diagram illustrating a product history service provided by a product retrieval system according to an embodiment of the present invention.

9 illustrates a computing device, in accordance with an embodiment of the invention.

DETAILED DESCRIPTION Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those skilled in the art may easily implement the present invention. As those skilled in the art would realize, the described embodiments may be modified in various different ways, all without departing from the spirit or scope of the present invention. In the drawings, parts irrelevant to the description are omitted in order to clearly describe the present invention, and like reference numerals designate like parts throughout the specification.

In this specification, duplicate descriptions of the same components are omitted.

Also, in the present specification, when a component is referred to as being 'connected' or 'connected' to another component, the component may be directly connected to or connected to the other component, but in between It will be understood that may exist. On the other hand, in the present specification, when a component is referred to as 'directly connected' or 'directly connected' to another component, it should be understood that there is no other component in between.

Also, the terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention.

Also, in this specification, the singular forms may include the plural forms unless the context clearly indicates otherwise.

Also, as used herein, the term 'comprises' or 'having' is only intended to designate that there is a feature, number, step, operation, component, part, or combination thereof described in the specification, and one or more. It is to be understood that it does not exclude in advance the possibility of the presence or addition of other features, numbers, steps, actions, components, parts or combinations thereof.

Also in this specification, the term 'and / or' includes any combination of the plurality of listed items or any of the plurality of listed items. In the present specification, 'A or B' may include 'A', 'B', or 'both A and B'.

Hereinafter, a method of easily searching for a makeup product used in an image (eg, a photo) will be described. In the present specification, makeup products include lip products (eg, lipsticks, tintons, etc.) applied to the lips, ball products (eg, blushers, foundations, powders, cushions, etc.) applied to the cheeks, and eye products (eg, eyes applied around the eyes) Shadows, eyeliners, etc.). Hereinafter, for convenience of description, an embodiment of the present invention will be described taking the case where the makeup product is a lipstick as an example. However, this is only an example, and embodiments of the present invention may be applied to other makeup products other than lipstick.

The product search system according to an exemplary embodiment of the present invention analyzes the color of the lips in the input color image (eg, color photograph), compares the analyzed value with a value previously stored in a product database (DB), and compares the Outputs a lipstick (information about this) that is the same as or similar to the lipstick corresponding to the lip color in the color image (eg, the color picture) based on. In addition, the product search system according to an embodiment of the present invention may provide sales information (eg, e-commerce (eg, M-commerce) information, store information, etc.) for the found lipstick.

In more detail, the product search system may extract a lip region from an input color image (eg, a color photograph). In addition, the product search system analyzes the color of the lips in the extracted lip region to distinguish color groups (e.g., color series (e.g. pink red series)), color RGB numerical values, and texture distribution (e.g. pearl). Degree, degree of glossy) can be analyzed (or determined). Here, the degree of pearl (or pearl value) indicates the degree of glitter, and the degree of gloss (or the value of glossy) indicates the degree of richness and gloss. The product search system compares the analyzed information (e.g., color group, RGB value, texture distribution) with the values previously stored in the product database, and analyzes the information (e.g., color group, RGB value, The lipstick (s) having the most similar value to the texture distribution can be output in order according to the degree of similarity. Outputting a lipstick herein may include outputting information about the lipstick. For example, the product retrieval system may output an image of the retrieved lipstick (s).

And if one of the output image (s) is selected by the user device, the product retrieval system may output lipstick (s) having the same color family and the same color RGB values but different texture distributions as the selected lipstick. have. Here, the user device is a device possessed or used by the user, and may be a smart phone, a personal computer (PC), a tablet PC, a kiosk installed in a store, or the like.

And the product retrieval system may provide sales information for the selected lipstick when at least one of the output lipstick (s) is selected by the user device.

The product search system 1000 may include a user device 100 and a product search device 200.

The user device 100 extracts a lip area using lipstick from a color image (eg, a picture input by the user), and transmits the extracted lip area to the product search apparatus 200 (S10). On the other hand, if the make-up product is a ball product, the user device 100 may extract the ball area in which the ball product (eg, blusher, foundation, powder, cushion, etc.) is used in the color image. If the makeup product is an eye product, it is possible to extract the eye area in which the eye product (eg, eyeshadow, eyeliner, etc.) is used in the color image. That is, the extracted makeup area (eg, lips area, cheek area, eye area, etc.) may vary depending on the makeup product.

The product retrieval apparatus 200 analyzes the lip region received from the user apparatus 100 and generates analysis information (eg, color group, RGB value, texture distribution map). The product search apparatus 100 compares the analysis information (eg, color group, RGB value, texture distribution) with the information stored in the product database, and searches for lipstick (s) having the same or similar information as the analysis information. The product search apparatus 100 transmits the information about the found lipstick (s) to the user device 100 (S20).

Table 1 below shows information stored in the product database.

제품명(또는 제품 ID)Product name (or product ID)	컬러군Color	RGBRGB	글로시 정도Glossy level	펄 정도Pearl degree
AA	PINK RED 계열PINK RED Series	247 183 492247 183 492	GLOSSY 1단계GLOSSY Stage 1	PEARL 1단계PEARL Stage 1
BB	PINK 계열PINK Series	231 175 412231 175 412	GLOSSY 1단계GLOSSY Stage 1	PEARL 2단계PEARL Stage 2
......	......	......	......	......

In Table 1, lipsticks can be divided into GLOSSY stage 1, GLOSSY stage 2, and GLOSSY stage 3, depending on the degree of glossiness. For example, GLOSSY level 3 may have the highest glossiness and GLOSSY level 1 may have the lowest gloss.

In Table 1, the lipstick can be divided into PEARL stage 1, PEARL stage 2, and PEARL stage 3, depending on the degree of pearl. For example, the PEARL stage 3 may have the highest pearl and the PEARL stage 1 may have the lowest pearl.

In addition, although Table 1 contains the information about a color group, the information about a color group may be abbreviate | omitted.

The product search apparatus 200 may include an analyzer 210, a searcher 220, and a transmitter 230.

The analyzer 210 analyzes the lip region received from the user device 100 and generates analysis information (eg, color group, RGB value, texture distribution map).

The searcher 220 searches for the lipstick by using the analysis information generated by the analyzer 210. In detail, the searcher 220 may search for lipstick (s) having a color difference (eg, ΔE) below the threshold V _THR1 (eg, 5) among the lipsticks stored in the product database. Here, the color difference (eg, ΔE) represents a distance between two points (ie, two colors) present in the RGB color space. That is, the color difference (eg, ΔE) between the RGB value of the lipstick (s) primarily searched by the searcher 220 and the RGB value of the analysis information may be equal to or less than the threshold V _THR1 (eg, 5).

The searcher 220 may perform filtering based on a texture distribution (or texture degree) on the first filtered lipstick (s) (hereinafter, referred to as 'first order filtered lipsticks') based on the RGB value. In detail, the search unit 220 may search for the lipstick (s) having the same or similar glossiness as that of the analysis information among the first filtered lipsticks. For example, when the glossiness level of the analysis information is GLOSSY step 1, the search unit 220 may search for lipstick (s) belonging to GLOSSY step 1 among the firstly filtered lipsticks.

The searcher 220 may perform filtering based on the degree of pearl on the lipstick (s) (hereinafter referred to as “secondary filtered lipsticks”) filtered based on the degree of glossy. In detail, the searcher 220 may search for lipstick (s) having a pearl degree equal to or similar to the pearl level of the analysis information among the secondary filtered lipsticks. For example, when the pearl level of the analysis information is PEARL stage 2, the searcher 220 may search for lipstick (s) belonging to PEARL stage 2 of the secondary filtered lipsticks. That is, the searcher 220 may primarily perform filtering based on the RGB value, secondly perform filtering based on the degree of glossiness, and thirdly perform filtering based on the degree of pearl. Meanwhile, the filtering order may be changed. For example, the searcher 220 may perform filtering based on the degree of Perl prior to filtering based on the degree of gloss.

On the other hand, the search unit 220 of the lipstick stored in the product database, the color difference (eg, ΔE) with the RGB value of the lipstick (s) finally retrieved is less than the threshold value V _THR2 and finally retrieved lipstick (s) Branches may be searched for lipstick (s) having a texture distribution (eg, glossy, pearl level) and a texture distribution (eg, glossy level, pearl level). The lipstick (s) retrieved here can be used for providing the variation lipstick illustrated in FIG. 4.

The transmitter 230 transmits the lipstick (s) (eg, information about this) found by the searcher 220 to the user device 100. In more detail, the transmitter 230 may transmit information about the retrieved lipstick (s) to the user device 100 based on the RGB value, the degree of glossiness, and the degree of pearl.

The user device 100 may display the received information on the screen of the user device 100 when receiving the information about the retrieved lipstick (s) from the product search device 200. For example, the user device 100 may display lipstick image (s) corresponding to the received information on the screen of the user device 100.

3 illustrates a lipstick product search of a product search system 1000, in accordance with an embodiment of the present invention.

The user device 100 extracts a lip region from an original image (eg, a color picture) and transmits the lip area to the product search apparatus 200. As illustrated in FIG. 3, the user device 100 may extract a lip region from a lipstick colorcut in which the lipstick is actually applied to the lips. To this end, color vision technology and deep learning technology may be used.

The product search apparatus 200 analyzes the lip region to generate (or extract) analysis information (eg, color group, RGB value, texture distribution), and search for a lipstick product using the analysis information. 3 illustrates a case where three lipstick products are found. The product searching apparatus 200 transmits the information about the found lipstick product to the user device 100.

The user device 100 displays a lipstick product image and product information (eg, color group, color RGB value, texture distribution, product name) corresponding to the information received from the product search apparatus 200 on the screen. For example, one of the three lipstick products retrieved has a color family of 'PINK RED series', a color RGB value of '247 183 492', and a texture distribution of 'PEARL stage 1 + GLOSSY stage 1'.

Meanwhile, as illustrated in FIG. 3, the user device 100 may further display the similarity (eg, 98%, 93%, 90%) of the retrieved lipstick product. For example, the color difference (eg, ΔE) between the RGB value of the lipstick product having a 98% similarity among the retrieved lipstick products and the RGB value of the analysis information may be smaller than the first reference value. As another example, the color difference (eg, ΔE) between the RGB value of the lipstick product having 93% similarity among the retrieved lipstick products and the RGB value of the analysis information may be smaller than the second reference value. Here, the second reference value is larger than the first reference value. As another example, the color difference (eg, ΔE) between the RGB value of the lipstick product having a 90% similarity among the retrieved lipstick products and the RGB value of the analysis information may be smaller than the third reference value. Here, the third reference value is larger than the second reference value.

4 is a diagram illustrating a method for a product retrieval system 1000 to provide a variation lipstick product having a texture distribution different from that of a retrieved lipstick product according to an embodiment of the present invention.

One of the lipstick product (s) displayed by the user device 100 is selected and a user input for the selected lipstick product (eg, a user gesture that pushes the screen from the A position to the B position on the screen of the user device 100). If present, the user device 100 has a color that is the same or similar to the color of the selected lipstick product (eg, the same or similar RGB value) but different from the texture distribution (eg, degree of glossy, pearl level) of the selected lipstick product. The change lipstick product (s) having a texture distribution can be displayed on the screen of the user device 100. That is, the color difference (e.g. ΔE) between the RGB value of the selected lipstick product and the RGB value of the change lipstick product is less than or equal to the threshold V _THR2 , and the texture distribution (e.g. glossiness, pearl level) of the selected lipstick product and the change of lipstick product. Texture distributions (eg glossy, pearl) are different.

Meanwhile, the user device 100 may receive the information about the change lipstick product (s) from the product search apparatus 200 in the above-described S20 process. For example, as illustrated in FIG. 4, if a lipstick product having a similarity of 98% among the lipstick product (s) displayed on the screen is selected, the user input (eg, the user device 100 for the selected lipstick product) is selected. ), The user device 100 changes the lipstick product for the selected lipstick product using information received from the product search apparatus 200 in step S20. (S) can be displayed on the screen.

5 is a diagram illustrating a method in which a product search system 1000 provides sales information for a selected lipstick product, according to an embodiment of the present invention.

If at least one of the lipstick product (s) displayed on the screen by the user device 100 is selected, the user device 100 may provide sales information for the selected lipstick product. Here, the sales information may include M-commerce information and store information. If one of the M-commerce information and the store information is selected by the user, the user device 100 may perform an operation according to the selected information.

For example, as illustrated in FIG. 5, when a lipstick product having a similarity of 98% among the lipstick product (s) displayed on the screen is selected by the user, the user device 100 sells the selected lipstick product. Information about the M-commerce and the store (eg, store location information) may be displayed on the screen. When the M-commerce is selected by the user, the user device 100 may access an internet shopping mall selling the selected lipstick product or perform its own commerce function included in the user device 100. This allows the user to purchase a favorite lipstick product directly through M-Commerce or go to a nearby store.

Meanwhile, the user device 100 may store such sales information or may receive the product information from the product search apparatus 200. For example, the user device 100 may receive such sales information from the product search apparatus 200 in step S20.

6 is a diagram illustrating a store connection service provided by a product search system 1000 according to an exemplary embodiment of the present invention.

As illustrated in FIG. 6, the user device 100 may display location information of a store selling a selected lipstick product on a screen.

In FIG. 6, the current position means the position of the user device 100, but may be separately designated.

If a specific store is more than a predetermined distance (for example, 1 km) from the current location, the user device 100 may display the distance between the current location and the corresponding store on the screen without displaying the corresponding store on a map.

In addition, the product search system 1000 may provide a visit reservation service for a store. This will be described with reference to FIG. 7.

7 is a diagram illustrating a store visit reservation service provided by the product search system 1000 according to an exemplary embodiment of the present invention.

If a visit reservation for at least one of the store (s) displayed on the screen by the user device 100 is selected (or entered) by the user (ie, a request for a store visit reservation exists), the user The device 100 may transmit information for booking a store visit (hereinafter, 'reservation information') to a server, and the server may transmit the reservation information to a computing device (hereinafter, referred to as a 'store device') installed in the corresponding store. Here, the server may be the product search apparatus 200.

The reservation information may include information about the selected store, information about the selected lipstick product, customer information, and visit date information. The reservation information may further include customer skin information, customer favorite color information, and customer preferred product information.

The product search system 1000 may provide a customized counseling service and a product recommendation service based on the reservation information. Store staff can provide customized counseling and product recommendations based on reservation information to customers who have booked and visited the store.

8 is a diagram illustrating a product history service provided by the product retrieval system 1000 according to an embodiment of the present invention.

The user device 100 has a history of a picture entered by the user for a predetermined period of time (eg, to date), the lipstick product (s) corresponding to the lip color in the picture, and the lipstick product (s) selected by the user. Can be displayed on the screen.

In addition, the user device 100 may provide discount information on the product (s) of interest through the notification service. If at least one of these product of interest (s) is selected by the user, the user device 100 can connect to the M-commerce or store for the selected product of interest.

This allows the user to check back at any time the products of interest in which the user was interested.

Meanwhile, the user device 100 may store such product history information or may receive it from the product search apparatus 200.

Meanwhile, some or all of the functions of the product search apparatus 200 may be implemented (or performed) by the user apparatus 100. Similarly, some or all of the functions of the user device 100 may be implemented (or performed) by the product retrieval device 200.

The computing device TN100 of FIG. 9 may be the user device 100, the product searching device 200, the store device, or the like described herein.

In the embodiment of FIG. 9, the computing device TN100 may include at least one processor TN110, a transceiver TN120 connected to a network to perform communication, and a memory TN130. In addition, the computing device TN100 may further include a storage device TN140, an input interface device TN150, an output interface device TN160, and the like. Components included in the computing device TN100 may be connected by a bus TN170 to communicate with each other.

The processor TN110 may execute a program command stored in at least one of the memory TN130 and the storage device TN140. The processor TN110 may refer to a central processing unit (CPU), a graphics processing unit (GPU), or a dedicated processor on which methods according to an embodiment of the present invention are performed. Processor TN110 may be configured to implement the procedures, functions, and methods described in connection with embodiments of the present invention. The processor TN110 may control each component of the computing device TN100.

Each of the memory TN130 and the storage device TN140 may store various information related to an operation of the processor TN110. Each of the memory TN130 and the storage device TN140 may be configured of at least one of a volatile storage medium and a nonvolatile storage medium. For example, the memory TN130 may be configured as at least one of a read only memory (ROM) and a random access memory (RAM).

The transceiver TN120 may transmit or receive a wired signal or a wireless signal.

On the other hand, the embodiment of the present invention is not implemented only through the apparatus and / or method described so far, but may be implemented through a program that realizes a function corresponding to the configuration of the embodiment of the present invention or a recording medium on which the program is recorded. Such implementations can be readily implemented by those skilled in the art from the description of the above-described embodiments.

Methods according to embodiments of the present invention may be implemented in the form of program instructions that may be executed by various computer means, and may be recorded on a computer readable medium. Computer-readable media may include, alone or in combination with the program instructions, data files, data structures, and the like. The program instructions recorded on the computer readable medium may be those specially designed and configured for the present invention, or may be known and available to those skilled in computer software.

Examples of computer readable media may include hardware devices specifically configured to store and execute program instructions, such as ROM, RAM, flash memory, and the like. Examples of program instructions may include not only machine code such as produced by a compiler, but also high-level language code that can be executed by a computer using an interpreter or the like. The hardware device described above may be configured to operate with at least one software module to perform the operations of the present invention, and vice versa.

Although the embodiments of the present invention have been described in detail above, the scope of the present invention is not limited thereto, and various modifications and improvements of those skilled in the art using the basic concepts of the present invention defined in the following claims are also provided. It belongs to the scope of rights.

Claims

A product search method of a product search device,

Analyzing the makeup region extracted from the color image to determine a red-green-blue (RGB) value and texture degree;

Searching for at least one makeup product among a plurality of makeup products, wherein the color difference with the determined RGB value is equal to or less than a first threshold value; And

Searching for at least one first makeup product corresponding to the determined texture degree among the first searched makeup products

Product search method of a product search device comprising a.
The method of claim 1,

The determined texture degree is,

Contains a glossy value for the degree of gloss and a pearl value for the amount of glitter

Product Search Method for product search on the device.
The method of claim 2,

Searching for the at least one first makeup product includes:

Secondly searching for at least one makeup product having the same gloss value as the glossy value of the determined texture degree among the at least one makeup product retrieved; And

Searching for the at least one first makeup product having a pearl value equal to a pearl value of the determined texture degree among the at least one makeup product retrieved secondly;

Product Search Method for product search on the device.
The method of claim 1,

If the at least one first makeup product is a product applied to the lips, the makeup area is a lip area,

If the at least one first makeup product is a fire product, the makeup area is a cheek area,

If the at least one first makeup product is a product that is applied around the eyes, the makeup area is an eye area

Product Search Method for product search on the device.
The method of claim 1,

At least one of the plurality of makeup products, the color difference with the RGB value of the at least one first makeup product is less than a second threshold value and has a texture degree different from the texture degree of the at least one first makeup product. Steps to search for a second makeup product

Product search method of a product search device further comprising.
An analysis unit for analyzing a make-up region extracted from a color image and determining a red-green-blue (RGB) value, a glossy value representing a degree of gloss, and a pearl value representing a degree of glitter; And

Among the plurality of makeup products, at least one makeup product whose color difference with the determined RGB value is equal to or less than a first threshold value is first searched, and corresponding to the determined glossy value and pearl value among the first searched makeup products. Search unit for searching for at least one first makeup product

Product search device comprising a.
The method of claim 6,

The search unit,

Secondly searching for at least one makeup product having the same gloss value as the determined gloss value among the at least one makeup product retrieved primarily;

Searching for the at least one first makeup product having a pearl value equal to the determined pearl value among the at least one makeup product retrieved secondly

Product Search Device.
The method of claim 6,

The search unit,

Searching for at least one second makeup product having a value different from at least one of a glossy value and a pearl value of the at least one first makeup product, among the plurality of makeup products,

The color difference between the RGB value of the at least one second makeup product and the RGB value of the at least one first makeup product is equal to or less than a second threshold value.

Product Search Device.
Memory; And

A processor which controls the memory and extracts a makeup area from a color image and transmits the makeup area to a product search apparatus;

The processor,

When receiving information about the at least one first makeup product retrieved by the product retrieval device from the product retrieval device, displaying the at least one first makeup product,

The at least one first makeup product is retrieved by the product search device according to an analysis value extracted from the makeup area,

The analysis value includes a red-green-blue (RGB) value, a glossy value indicating the degree of gloss, and a pearl value indicating the degree of glitter.

User device.
The method of claim 9,

The processor,

When there is a request for a visit reservation of a first store selling the at least one first makeup product, information for the visit reservation is transmitted to a server.

User device.
The method of claim 9,

The processor,

If one of the at least one first makeup product is selected and there is a user input for the selected first makeup product, it has a value different from at least one of a glossy value and a pearl value of the selected first makeup product. Display at least one second makeup product,

The color difference between the RGB value of the at least one second makeup product and the RGB value of the selected first makeup product is equal to or less than a threshold value.

User device.