WO2023026891A1 - Eyebrow makeup guide method, device, program, and system - Google Patents

Eyebrow makeup guide method, device, program, and system Download PDF

Info

Publication number
WO2023026891A1
WO2023026891A1 PCT/JP2022/030897 JP2022030897W WO2023026891A1 WO 2023026891 A1 WO2023026891 A1 WO 2023026891A1 JP 2022030897 W JP2022030897 W JP 2022030897W WO 2023026891 A1 WO2023026891 A1 WO 2023026891A1
Authority
WO
WIPO (PCT)
Prior art keywords
eyebrow
eyebrows
feature amount
predetermined
makeup guide
Prior art date
Application number
PCT/JP2022/030897
Other languages
French (fr)
Japanese (ja)
Inventor
典子 長谷川
成人 豊田
武尊 大南
智洋 坂口
聖子 森
Original Assignee
株式会社資生堂
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 株式会社資生堂 filed Critical 株式会社資生堂
Priority to JP2023543820A priority Critical patent/JPWO2023026891A1/ja
Publication of WO2023026891A1 publication Critical patent/WO2023026891A1/en

Links

Images

Classifications

    • AHUMAN NECESSITIES
    • A45HAND OR TRAVELLING ARTICLES
    • A45DHAIRDRESSING OR SHAVING EQUIPMENT; EQUIPMENT FOR COSMETICS OR COSMETIC TREATMENTS, e.g. FOR MANICURING OR PEDICURING
    • A45D44/00Other cosmetic or toiletry articles, e.g. for hairdressers' rooms
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T1/00General purpose image data processing

Definitions

  • the present invention relates to an eyebrow makeup guide method, device, program, and system.
  • Patent Document 1 discloses that a user's face image is displayed on a display in real time, and template eyebrows selected from the eyebrows of models and talents are synthesized and displayed on the face image. An eyebrow drawing assist device is described.
  • the eyebrow drawing assist device of Patent Document 1 clearly indicates the difference area between the user's actual eyebrow area and the eyebrow area of the template, displays the area where the eyebrows should be drawn in red, and displays the area where the eyebrows should be shaved in blue. .
  • actual eyebrows the shape and density of a human's actual eyebrows (hereinafter also referred to as actual eyebrows) are complex, and it is not possible to simply specify an area for drawing eyebrows and an area for shaving eyebrows using a template, as in the conventional method. was inadequate. There has been a demand for facilitating eyebrow makeup according to detailed features of the actual eyebrows.
  • an object of the present invention is to facilitate eyebrow makeup.
  • a method includes the steps of acquiring an image of an eyebrow, calculating a feature amount of the eyebrow, and shaping the eyebrow into a predetermined eyebrow based on the feature amount of the eyebrow. and presenting an eyebrow makeup guide for doing.
  • eyebrow makeup can be facilitated.
  • FIG. 1 is a diagram showing functional blocks of an eyebrow makeup guide device according to an embodiment of the present invention
  • FIG. 4 is a flowchart showing the flow of eyebrow makeup guide processing according to one embodiment of the present invention.
  • 4 is a flowchart showing the flow of eyebrow feature quantity calculation processing according to an embodiment of the present invention.
  • FIG. 4 is a diagram for explaining a position (example 1) indicating the center of gravity of eyebrows according to one embodiment of the present invention
  • FIG. 10 is a diagram for explaining a position (example 2) indicating the center of gravity of eyebrows according to one embodiment of the present invention
  • FIG. 4 is a diagram for explaining the features of the outer edge of the eyebrow according to one embodiment of the present invention;
  • FIG. 1 is a diagram showing functional blocks of an eyebrow makeup guide device according to an embodiment of the present invention
  • FIG. 4 is a flowchart showing the flow of eyebrow makeup guide processing according to one embodiment of the present invention.
  • 4 is a flowchart showing the flow of eyebrow feature quantity calculation processing according to
  • FIG. 4 is a diagram for explaining features of the inner eyebrow according to one embodiment of the present invention.
  • FIG. 4 is a diagram for explaining the density of eyebrows according to one embodiment of the present invention.
  • FIG. 4 is a diagram for explaining the thickness of eyebrows according to one embodiment of the present invention;
  • FIG. 4 is a diagram for explaining eyebrow classification (example 1) according to an embodiment of the present invention;
  • FIG. 10 is a diagram for explaining eyebrow classification (example 2) according to an embodiment of the present invention;
  • FIG. 4 is a diagram for explaining an eyebrow makeup guide according to an embodiment of the present invention;
  • 1 is a diagram showing the hardware configuration of an eyebrow makeup guide device according to an embodiment of the present invention;
  • FIG. 1 is a diagram showing the overall configuration according to one embodiment of the present invention.
  • the eyebrow makeup guide device 10 presents an eyebrow makeup guide for shaping the eyebrows of the user 20 into predetermined eyebrows based on the features of the eyebrows of the user 20 .
  • the eyebrow makeup guide device 10 is a smartphone or the like having a camera function.
  • the eyebrow makeup guide device 10 will be described in detail later with reference to FIG.
  • the eyebrow makeup guide device 10 is one device (for example, a smartphone having a camera function, etc.) will be described. device and a digital camera). Also, a device (server or the like) other than eyebrow makeup guide device 10 may perform a part of the processing performed by eyebrow makeup guide device 10 described herein.
  • FIG. 2 is a diagram showing functional blocks of the eyebrow makeup guide device 10 according to one embodiment of the present invention.
  • the eyebrow makeup guide device 10 can include an image acquisition unit 101 , a feature quantity calculation unit 102 , an eyebrow classification unit 103 and a presentation unit 104 . Further, the eyebrow makeup guide device 10 can function as an image acquisition unit 101, a feature amount calculation unit 102, an eyebrow classification unit 103, and a presentation unit 104 by executing programs. Each of these will be described below.
  • the image acquisition unit 101 acquires an image of the eyebrows. Specifically, the image acquiring unit 101 acquires an image of the eyebrows of the user 20 captured by the camera function of the eyebrow makeup guide device 10 or the like.
  • the image in which the eyebrows are photographed may be an image in which the eyebrows and other than the eyebrows are photographed (for example, an image in which the entire face is photographed), or an image in which only the eyebrows are photographed (for example, the eyebrow makeup guide device 10 image captured so that the area of the eyebrows of the user 20 fits within a predetermined area displayed on the display device).
  • the feature quantity calculation unit 102 calculates the feature quantity of the eyebrows (details will be described later). Specifically, the feature amount calculation unit 102 calculates the feature amount of the eyebrows of the user 20 from the captured image of the eyebrows acquired by the image acquisition unit 101 .
  • the eyebrow classification unit 103 classifies eyebrows (for example, into categories indicating the shape of eyebrows such as straight eyebrows, upturned eyebrows, and downturned eyebrows) based on eyebrow feature amounts. Specifically, the eyebrow classification unit 103 classifies the eyebrows of the user 20 based on the eyebrow feature amount calculated by the feature amount calculation unit 102 .
  • the presentation unit 104 presents an eyebrow makeup guide for making the eyebrows into predetermined eyebrows based on the eyebrow classification results. Specifically, the presentation unit 104 presents an eyebrow makeup guide for making the eyebrows of the user 20 into predetermined eyebrows based on the eyebrow classification result by the eyebrow classification unit 103 (for example, the eyebrow makeup guide device 10 indicate.
  • the presentation unit 104 provides cosmetics and tools to be used to make the eyebrows of the user 20 into predetermined eyebrows, and drawing of eyebrows to make the eyebrows of the user 20 into predetermined eyebrows (in this specification , how the user 20 draws the eyebrows (referred to as "drawing"), the drawing area, the drawing order, the use of cosmetics and tools.
  • the predetermined eyebrows may be eyebrows selected from a plurality of eyebrows.
  • the eyebrow makeup guide includes cosmetics and tools to be used to make the eyebrows of the user 20 into the predetermined eyebrows, and the eyebrow drawing method, the drawing area, the drawing order, Including the use of cosmetics and tools.
  • cosmetics and tools are eyebrow pencils, eyebrow powder, eyebrow mascara, brushes, combs, and the like.
  • cosmetics and tools are determined according to the state of user's 20 natural eyebrows (user's 20 eyebrows before makeup) and predetermined eyebrows (that is, user's 20 desired eyebrows). For example, if a user 20 whose natural eyebrows are thin desires firm eyebrows, an eyebrow powder that changes the overall darkness is used. Also, for example, eyebrow powder is used when the original eyebrows are thin, eyebrow powder is used to balance the eyebrows when the eyebrows are thick but thick, and eyebrow pencil is used when the eyebrows are thick but sparse. is used, and eyebrow mascara, concealer, and eyebrow scissors may be used where the eyebrows are thick.
  • the method of drawing eyebrows, the drawing area, the order of drawing, the use of cosmetics and tools indicate the order in which areas to apply makeup and how to move the hands. For example, if your natural eyebrows are thin, draw them softly with eyebrow powder that blends well with your skin. Also, for example, if there is a difference between dark and thin eyebrows, the dark brown is added to the ungrown portion. Also, for example, if the natural eyebrows are dark, draw with an eyebrow pencil so as to fill the gaps. For sparse areas, finish by adding eyebrows one by one. Finally, use eyebrow mascara and apply it so that the hair flow is adjusted from the inner eyebrow to the outer eyebrow.
  • the predetermined eyebrows are eyebrows selected by the user 20 or the like from a plurality of eyebrows.
  • the predetermined eyebrows may be eyebrows that match the image desired by the user 20 .
  • the predetermined eyebrows are predetermined eyebrows.
  • the predetermined eyebrows may be trendy eyebrows selected by the eyebrow makeup guide device 10, "basic eyebrows", “eyebrows with desired impression (cute, fresh, cool, elegant, etc.) (feature map ( (from the four quadrants of a map classifying features),” desired eyebrows (neat eyebrows, soft eyebrows, parallel eyebrows, etc.)", and "eyebrows matching the scene", or determined from the facial features of the user 20 It may be a sculpted eyebrow.
  • the eyebrows of the user 20 are raised eyebrows and the user 20 wants the eyebrows to have a gentle impression (when the image desired by the user 20 is a "gentle impression")
  • an eyebrow powder that gives a gentle and soft impression is applied to the upper part of the eyebrow tip and the eyebrow peak.
  • gently blur with a screw brush so that the inner corners of the eyebrows do not become strong.
  • an eyebrow pencil that gives a proper feeling is used to adjust the position of the eyebrow. Take it slightly higher and draw from the peak of the eyebrow to the end of the eyebrow so that it gradually becomes thinner. Next, draw the part from Mt. Bizan to the inner part of the eyebrow. Finally, add a darker shade to the center of the eyebrows to give it a three-dimensional look.
  • FIG. 3 is a flowchart showing the flow of eyebrow makeup guide processing according to one embodiment of the present invention.
  • step 1 (S1) the image acquisition unit 101 acquires an image of the eyebrows. Specifically, the image acquiring unit 101 acquires an image of the eyebrows of the user 20 captured by the camera function of the eyebrow makeup guide device 10 or the like.
  • the feature quantity calculation unit 102 calculates the feature quantity of the eyebrows. Specifically, the feature amount calculation unit 102 calculates the feature amount of the eyebrows of the user 20 from the captured image of the eyebrows acquired in S1.
  • Facial features include eyebrow density, eyebrow thickness, eyebrow angle, eyebrow length, eye shape (straight or curved), eye angle, eye size, distance between eyes, Distance between eyes and eyebrows, nose shape (straight or curved), mouth shape (straight or curved), mouth width, cheek shape (straight or curved), cheek length , contour shape (straight or curvilinear), and face length.
  • step 3 the eyebrow classification unit 103 classifies the eyebrows based on the eyebrow feature amount. Specifically, the eyebrow classification unit 103 classifies the eyebrows of the user 20 based on the eyebrow feature amount calculated in S2.
  • step 4 (S4) the presentation unit 104 presents an eyebrow makeup guide for making the eyebrows into a predetermined eyebrow based on the eyebrow classification result.
  • the presentation unit 104 presents (for example, displays on the eyebrow makeup guide device 10) an eyebrow makeup guide for making the eyebrows of the user 20 into predetermined eyebrows based on the eyebrow classification result of S3.
  • the presenting unit 104 provides cosmetics and tools to be used to make eyebrows into predetermined eyebrows, eyebrow drawing method, drawing area, drawing order, how to use cosmetics and tools to make eyebrows into predetermined eyebrows. can be presented (for example, displayed on the eyebrow makeup guide device 10).
  • FIG. 4 is a flow chart showing the flow of the eyebrow feature amount calculation process (S2 in FIG. 3) according to one embodiment of the present invention.
  • the feature amount calculation unit 102 extracts the eyebrow area.
  • the feature amount calculation unit 102 extracts an eyebrow region using the eyebrows of the user 20 and feature points around the eyebrows in the image of the eyebrows of the user 20 (the image acquired in S1 in FIG. 3). can do.
  • the feature amount calculation unit 102 calculates feature points representing features of the eyebrows of the user 20 (for example, an eyebrow head, an eyebrow tail, an eye , temples, and nose).
  • the feature amount calculation unit 102 extracts an eyebrow region from the image of the eyebrows of the user 20 (the image acquired in S1 of FIG. 3).
  • the feature amount calculation unit 102 calculates the feature points based on the feature points representing the features of the eyebrows of the user 20 extracted in S11 (for example, at least three feature points of the inner and outer ends of the eyebrows, the eyes, the temples, and the nose). , to extract the eyebrow region.
  • the feature amount calculation unit 102 is not limited to the method of extracting the eyebrow region based on the feature points as described above.
  • the information may be used to extract the eyebrow region.
  • the feature amount calculation unit 102 may extract the eyebrow region using a learned model generated by machine learning.
  • the image in which the eyebrows are photographed is an image in which only the eyebrows are photographed (for example, an image in which the eyebrows of the user 20 are photographed so as to fit within a predetermined region displayed on the display device of the eyebrow makeup guide device 10).
  • image the image in which only the eyebrows are photographed is used as it is (that is, S11 may be omitted).
  • step 12 (S12) the feature amount calculation unit 102 reduces the number of gradations of the image of the eyebrow region extracted in S11 (for example, binarizes).
  • the feature amount calculation unit 102 uses at least one of luminance, lightness, RGB Blue, and RGB Green to reduce the number of gradations of the image of the eyebrow region. Note that S12 may be omitted.
  • step 13 (S13) the feature amount calculation unit 102 extracts the amount of change in the pixel value of the image of the eyebrow region extracted in S11 (the image with the number of gradations lowered when S12 is executed). do. Specifically, the feature amount calculation unit 102 extracts changes in pixel values in a certain direction (changes in pixel values in at least one direction from the top to the bottom of the eyebrow and from the head to the tail of the eyebrow). do.
  • the feature quantity calculation unit 102 calculates the feature quantity of the eyebrows based on the amount of change in the pixel value extracted at S13. For example, the feature amount calculation unit 102 calculates feature amounts of eyebrow shape and eyebrow density.
  • the eyebrow feature amount indicates the shape and density of the eyebrow.
  • the eyebrow feature amount is one of the position indicating the center of gravity of the eyebrow, the features of the eyebrow head and eyebrow tail, the eyebrow density, the eyebrow thickness, and the overall angle of the eyebrow. including at least one.
  • ⁇ Position indicating the center of gravity of the eyebrow>> Two examples of the position indicating the center of gravity of the eyebrow, which is an example of the feature amount of the eyebrow, will be described with reference to FIGS. 5 and 6.
  • FIG. the position indicating the center of gravity of the eyebrow is the centroid of the area covered with eyebrows at a predetermined density or more, or the line that bisects the area covered most with eyebrows.
  • FIG. 5 is a diagram for explaining the position (example 1) indicating the center of gravity of the eyebrows according to one embodiment of the present invention.
  • the feature amount calculation unit 102 divides the image in which the eyebrows are captured into a plurality of grid-like regions (upper portion of FIG. 5).
  • the feature amount calculation unit 102 calculates the sum of pixel values (for example, at least one of luminance, brightness, RGB blue, and RGB green) in each grid area.
  • the feature amount calculation unit 102 determines a grid-like region in which the sum of pixel values is equal to or greater than the threshold as the position indicating the center of gravity of the eyebrow (lower part of FIG. 5).
  • four grid regions are determined as positions indicating the center of gravity of ⁇ eyebrow 1>, and six grid regions are determined as positions indicating the center of gravity of ⁇ eyebrow 2>. has been determined.
  • FIG. 6 is a diagram for explaining the position (example 2) indicating the center of gravity of the eyebrows according to one embodiment of the present invention.
  • the feature amount calculation unit 102 divides the image of the eyebrows into a plurality of regions along a plurality of axes parallel to the Y axis (an axis parallel to the X axis may also be used) (upper portion of FIG. 6).
  • the feature amount calculation unit 102 calculates the sum of pixel values (for example, at least one of luminance, brightness, RGB Blue, and RGB Green) in each region.
  • the feature amount calculation unit 102 determines the region where the sum of the pixel values peaks as the position indicating the center of gravity of the eyebrow (lower part of FIG. 6).
  • the eyebrow head and eyebrow tail which are an example of eyebrow feature amounts, will be described with reference to FIGS. 7 and 8.
  • FIG. the feature of the eyebrow head and the eyebrow tail is the angle of the eyebrow head and the eyebrow tail, or the change in the pixel value of the eyebrow head and the eyebrow tail.
  • FIG. 7 is a diagram for explaining the features of the outer corner of the eyebrow according to one embodiment of the present invention.
  • the axis perpendicular to the midline of the face is the X-axis
  • the axis parallel to the midline of the face is the Y-axis.
  • the feature amount calculation unit 102 divides the feature points (specifically, the point A at the beginning of the eyebrow, the point D at the end of the eyebrow, and the distance between the point A and the point D in the X-axis direction in an image in which the eyebrow is photographed). Extract point B and point C) on the eyebrows where the eyebrows are (upper part of FIG.
  • FIG. 8 is a diagram for explaining the features of the inner eyebrow according to one embodiment of the present invention.
  • the axis perpendicular to the midline of the face is the X-axis
  • the axis parallel to the midline of the face is the Y-axis.
  • the feature amount calculation unit 102 divides the feature points (specifically, the point A at the beginning of the eyebrow, the point D at the end of the eyebrow, and the distance between the point A and the point D in the X-axis direction in an image in which the eyebrow is photographed). Extract points B and C) on the eyebrows where the eyebrows are located (upper part of FIG. 8).
  • the feature amount calculation unit 102 divides the image in which the eyebrow is captured into a plurality of regions, as described in ⁇ Position indicating the center of gravity of the eyebrow>>, and calculates pixels for each region in the eyebrow head and eyebrow tail regions.
  • the sum of values or the change in pixel values may be determined as features of the inner and outer ends of the eyebrows.
  • eyebrow density indicates the density of each region within the eyebrow.
  • FIG. 9 is a diagram for explaining the density of eyebrows according to one embodiment of the present invention.
  • the feature amount calculation unit 102 sets an area for calculating the density of the eyebrows. For example, the feature amount calculation unit 102 sets regions (for example, three regions in FIG. 9) for calculating the density of eyebrows using the position information of the inner and outer corners of the eyes, the iris, and the nose.
  • the feature amount calculation unit 102 calculates the sum of pixel values (for example, at least one of luminance, brightness, RGB Blue, and RGB Green) in each region.
  • the feature amount calculation unit 102 determines the level of darkness based on the threshold set for each area (right part of FIG. 9).
  • ⁇ thickness of eyebrows>> The thickness of the eyebrows, which is an example of the feature amount of the eyebrows, will be described with reference to FIG.
  • eyebrow thickness indicates the thickness of each region within the eyebrow.
  • FIG. 10 is a diagram for explaining the thickness of eyebrows according to one embodiment of the present invention.
  • the feature amount calculation unit 102 sets an area for calculating the thickness of the eyebrows. For example, the feature amount calculation unit 102 sets regions (for example, three regions in FIG. 10) for calculating the thickness of eyebrows using the position information of the inner and outer corners of the eye, the iris, and the nose.
  • the feature amount calculation unit 102 calculates the sum of pixel values (for example, at least one of luminance, brightness, RGB Blue, and RGB Green) in each region.
  • the feature amount calculation unit 102 determines the thickness level based on the threshold value set for each area (right part of FIG. 10).
  • the eyebrow feature amount may be the angle of the entire eyebrow.
  • the feature amount of the eyebrows may be the position of the eyebrows on the face.
  • the eyebrow position includes at least one of an eyebrow-to-eye distance and left and right eyebrow positions.
  • the eyebrow feature amount may be the width of the eyebrow.
  • the eyebrow feature amount may be the arch of the eyebrow.
  • Classification of eyebrows for example, classification into categories indicating shapes of eyebrows
  • FIG. 11 is a diagram for explaining eyebrow classification (example 1) according to an embodiment of the present invention.
  • the area within the dotted line in FIG. 11 is an area for drawing eyebrows, and the manner of drawing, cosmetics, and tools differ depending on the thickness of the eyebrows (an area other than the dotted line may be used as an additional area for drawing eyebrows).
  • the area within the solid line in FIG. 11 is the area to be blurred or trimmed with the concealer.
  • the eyebrow classification unit 103 classifies the eyebrow into one of a plurality of categories based on the eyebrow feature amounts “the position indicating the center of gravity of the eyebrow” and “the thickness of the eyebrow”. be able to. Specifically, the eyebrow classification unit 103 determines whether the "position indicating the center of gravity of the eyebrow” is lowered or raised, and whether the "thickness of the eyebrow” is thin or thick. They can be classified into categories such as B1, B2, B3, C1, C2, D1 and D2. Note that when the position indicating the center of gravity of the eyebrow is a predetermined value (eg, a), a predetermined guide (eg, B1 guide) can be presented without considering the thickness of the eyebrow.
  • a predetermined guide eg, B1 guide
  • FIG. 12 is a diagram for explaining eyebrow classification (example 2) according to an embodiment of the present invention.
  • the eyebrow classification unit 103 classifies the eyebrow into one of a plurality of categories based on the eyebrow feature quantity “the position indicating the center of gravity of the eyebrow” and “the angle of the entire eyebrow”. be able to. Specifically, the eyebrow classification unit 103 classifies, for example, A and B in FIG. , C, D, and E. Note that even when classified between a plurality of categories (for example, between D and E), a guide (for example, "add the upper side of the eyebrow and the lower side from the mountain to the end of the eyebrow. Using the horizontal line as a guide, If it's thin, add thickness with a brush or eyebrow pencil.If it's thick, trim it with eyebrow mascara.”
  • a guide for example, "add the upper side of the eyebrow and the lower side from the mountain to the end of the eyebrow. Using the horizontal line as a guide, If it's thin, add thickness with a brush or eyebrow pencil.If it's thick, trim it with eyebrow mascara.”
  • FIG. 13 is a diagram for explaining an eyebrow makeup guide according to an embodiment of the present invention.
  • the presentation unit 104 displays an image of the extracted real eyebrows (an image of the extracted hair part) or an illustration of the real eyebrows, cosmetics and tools to be used, eyebrow drawing method, drawing area, drawing order, cosmetics and Show how to use tools.
  • the presentation unit 104 presents an eyebrow makeup guide for making the eyebrows into predetermined eyebrows based on the eyebrow classification results.
  • the presentation unit 104 selects and presents a guide of a category into which the eyebrows of the user 20 are classified, from the guides defined for each category.
  • the presentation unit 104 presents a guide that combines the guides of each of the multiple categories.
  • the presentation unit 104 may present a guide for eyebrow makeup based on the eyebrow classification result (that is, category), or may present an eyebrow makeup guide based on the eyebrow classification result (that is, category) and the density of the eyebrows. You may present a guide to In addition to these classified drawing methods for eyebrows, a guide is displayed as if adding a brush to an area where the density is partially light at the end of the eyebrow, such as the eyebrow 2 in FIG.
  • the eyebrows of the user 20 predetermined eyebrows (for example, straight eyebrows)
  • a predetermined eyebrow for example, straight eyebrows
  • the thickness and angle are adjusted by adding from the top of the eyebrow and around the mountain to the bottom of the eyebrow, and the horizontal line from the eyebrow is used as a guide. Then, a guide is presented indicating that the lower part of the inner eyebrow and the outer part of the eyebrow should not be drawn.
  • the user uses the cosmetics and tools suggested in the eyebrow makeup guide to make the user's eyebrows as specified in the eyebrow makeup guide.
  • Eyebrow makeup can be easily performed according to the eyebrow drawing method, drawing area, drawing order, and usage of cosmetics and tools.
  • FIG. 14 is a diagram showing the hardware configuration of the eyebrow makeup guide device 10 according to one embodiment of the present invention.
  • the eyebrow makeup guide device 10 has a CPU (Central Processing Unit) 1001 , a ROM (Read Only Memory) 1002 and a RAM (Random Access Memory) 1003 .
  • the CPU 1001, ROM 1002, and RAM 1003 form a so-called computer.
  • the eyebrow makeup guide device can have an auxiliary storage device 1004 , a display device 1005 , an operation device 1006 , an I/F (Interface) device 1007 and a drive device 1008 .
  • Each piece of hardware of the eyebrow makeup guide device 10 is interconnected via a bus B.
  • the CPU 1001 is an arithmetic device that executes various programs installed in the auxiliary storage device 1004 .
  • the ROM 1002 is a non-volatile memory.
  • the ROM 1002 functions as a main storage device that stores various programs, data, etc. necessary for the CPU 1001 to execute various programs installed in the auxiliary storage device 1004 .
  • the ROM 1002 functions as a main storage device that stores boot programs such as BIOS (Basic Input/Output System) and EFI (Extensible Firmware Interface).
  • BIOS Basic Input/Output System
  • EFI Extensible Firmware Interface
  • the RAM 1003 is a volatile memory such as DRAM (Dynamic Random Access Memory) or SRAM (Static Random Access Memory).
  • the RAM 1003 functions as a main storage device that provides a work area that is developed when various programs installed in the auxiliary storage device 1004 are executed by the CPU 1001 .
  • the auxiliary storage device 1004 is an auxiliary storage device that stores various programs and information used when various programs are executed.
  • the display device 1005 is a display device that displays the internal state of the eyebrow makeup guide device 10 and the like.
  • the operation device 1006 is an input device through which a person who operates the eyebrow makeup guide device 10 inputs various instructions to the eyebrow makeup guide device 10 .
  • the I/F device 1007 is a communication device for connecting to a network and communicating with other devices.
  • a drive device 1008 is a device for setting a storage medium 1009 .
  • the storage medium 1009 here includes media such as CD-ROMs, flexible disks, magneto-optical disks, etc., which record information optically, electrically or magnetically.
  • the storage medium 1009 may also include a semiconductor memory that electrically records information such as an EPROM (Erasable Programmable Read Only Memory), a flash memory, or the like.
  • auxiliary storage device 1004 Various programs to be installed in the auxiliary storage device 1004 are installed by, for example, setting the distributed storage medium 1009 in the drive device 1008 and reading the various programs recorded in the storage medium 1009 by the drive device 1008. be done. Alternatively, various programs installed in the auxiliary storage device 1004 may be installed by being downloaded from the network via the I/F device 1007 .
  • the eyebrow makeup guide device 10 has an imaging device 1010 . Eyebrow makeup guide device 10 photographs user 20 .
  • eyebrow makeup guide device 20 user 101 image acquisition unit 102 feature quantity calculation unit 103 eyebrow classification unit 104 presentation unit 1001 CPU 1002 ROMs 1003 RAM 1004 auxiliary storage device 1005 display device 1006 operation device 1007 I/F device 1008 drive device 1009 storage medium 1010 imaging device

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Image Processing (AREA)

Abstract

The present invention facilitates eyebrow makeup. The method according to the one embodiment of the present invention includes a step for acquiring an image obtained by capturing the eyebrow, a step for calculating a feature amount of the eyebrow, and a step for providing an eyebrow makeup guide for changing the eyebrow to a prescribed eyebrow on the basis of the feature amount of the eyebrow.

Description

眉メイクガイド方法、装置、プログラム、およびシステムEyebrow Makeup Guide Method, Apparatus, Program, and System
 本発明は、眉メイクガイド方法、装置、プログラム、およびシステムに関する。 The present invention relates to an eyebrow makeup guide method, device, program, and system.
 従来、眉毛をアイブロウで補い眉の形を整える、眉のメイクアップが知られている。眉のメイクアップをアシストする技術として、特許文献1には、利用者の顔画像をリアルタイムでディスプレイに表示させ、その顔画像にモデルやタレントの眉毛から選択されたテンプレートの眉毛を合成表示させる、眉毛描画アシスト装置が記載されている。特許文献1の眉毛描画アシスト装置は、利用者の実際の眉毛領域とテンプレートの眉毛領域の差分領域を明示し、眉毛を描画すべき領域を赤色で表示し、眉毛を剃る領域を青色で表示する。 Conventionally, eyebrow make-up is known, in which the eyebrows are supplemented with eyebrows to shape the eyebrows. As a technique for assisting eyebrow makeup, Patent Document 1 discloses that a user's face image is displayed on a display in real time, and template eyebrows selected from the eyebrows of models and talents are synthesized and displayed on the face image. An eyebrow drawing assist device is described. The eyebrow drawing assist device of Patent Document 1 clearly indicates the difference area between the user's actual eyebrow area and the eyebrow area of the template, displays the area where the eyebrows should be drawn in red, and displays the area where the eyebrows should be shaved in blue. .
特開2007-293649号公報JP 2007-293649 A
 しかしながら、人間の実際の眉(以下、実眉ともいう)の形状や濃さは複雑であり、従来の手法のように、テンプレートにより眉毛を描画する領域と眉毛を剃る領域とを明示するだけでは不十分であった。実眉の詳細な特徴に応じた眉のメイクアップを容易にできることが求められていた。 However, the shape and density of a human's actual eyebrows (hereinafter also referred to as actual eyebrows) are complex, and it is not possible to simply specify an area for drawing eyebrows and an area for shaving eyebrows using a template, as in the conventional method. was inadequate. There has been a demand for facilitating eyebrow makeup according to detailed features of the actual eyebrows.
 そこで、本発明では、眉のメイクアップを容易にすることを目的とする。 Therefore, an object of the present invention is to facilitate eyebrow makeup.
 本発明の一実施形態に係る方法は、眉が撮影された画像を取得するステップと、前記眉の特徴量を算出するステップと、前記眉の特徴量に基づいて、前記眉を所定の眉にするための眉メイクのガイドを提示するステップと、を含む。 A method according to an embodiment of the present invention includes the steps of acquiring an image of an eyebrow, calculating a feature amount of the eyebrow, and shaping the eyebrow into a predetermined eyebrow based on the feature amount of the eyebrow. and presenting an eyebrow makeup guide for doing.
 本発明では、眉のメイクアップを容易にすることができる。 With the present invention, eyebrow makeup can be facilitated.
本発明の一実施形態に係る全体の構成を示す図である。It is a figure showing the whole composition concerning one embodiment of the present invention. 本発明の一実施形態に係る眉メイクガイド装置の機能ブロックを示す図である。1 is a diagram showing functional blocks of an eyebrow makeup guide device according to an embodiment of the present invention; FIG. 本発明の一実施形態に係る眉メイクガイド処理の流れを示すフローチャートである。4 is a flowchart showing the flow of eyebrow makeup guide processing according to one embodiment of the present invention. 本発明の一実施形態に係る眉特徴量算出処理の流れを示すフローチャートである。4 is a flowchart showing the flow of eyebrow feature quantity calculation processing according to an embodiment of the present invention. 本発明の一実施形態に係る眉の重心を示す位置(例1)について説明するための図である。FIG. 4 is a diagram for explaining a position (example 1) indicating the center of gravity of eyebrows according to one embodiment of the present invention; 本発明の一実施形態に係る眉の重心を示す位置(例2)について説明するための図である。FIG. 10 is a diagram for explaining a position (example 2) indicating the center of gravity of eyebrows according to one embodiment of the present invention; 本発明の一実施形態に係る眉尻の特徴について説明するための図である。FIG. 4 is a diagram for explaining the features of the outer edge of the eyebrow according to one embodiment of the present invention; 本発明の一実施形態に係る眉頭の特徴について説明するための図である。FIG. 4 is a diagram for explaining features of the inner eyebrow according to one embodiment of the present invention; 本発明の一実施形態に係る眉の濃さについて説明するための図である。FIG. 4 is a diagram for explaining the density of eyebrows according to one embodiment of the present invention; 本発明の一実施形態に係る眉の太さについて説明するための図である。FIG. 4 is a diagram for explaining the thickness of eyebrows according to one embodiment of the present invention; 本発明の一実施形態に係る眉の分類(例1)について説明するための図である。FIG. 4 is a diagram for explaining eyebrow classification (example 1) according to an embodiment of the present invention; 本発明の一実施形態に係る眉の分類(例2)について説明するための図である。FIG. 10 is a diagram for explaining eyebrow classification (example 2) according to an embodiment of the present invention; 本発明の一実施形態に係る眉メイクのガイドについて説明するための図である。FIG. 4 is a diagram for explaining an eyebrow makeup guide according to an embodiment of the present invention; 本発明の一実施形態に係る眉メイクガイド装置のハードウェア構成を示す図である。1 is a diagram showing the hardware configuration of an eyebrow makeup guide device according to an embodiment of the present invention; FIG.
 以下、各実施形態について添付の図面を参照しながら説明する。なお、本明細書および図面において、実質的に同一の機能構成を有する構成要素については、同一の符号を付することにより重複した説明を省略する。 Each embodiment will be described below with reference to the attached drawings. In the present specification and drawings, constituent elements having substantially the same functional configuration are denoted by the same reference numerals, thereby omitting redundant description.
<全体構成>
 図1は、本発明の一実施形態に係る全体の構成を示す図である。眉メイクガイド装置10は、ユーザ20の眉の特徴から、ユーザ20の眉を所定の眉にするための眉メイクのガイドを提示する。例えば、眉メイクガイド装置10は、カメラ機能を有するスマートフォン等である。後段で、図2を参照しながら、眉メイクガイド装置10について詳細に説明する。
<Overall composition>
FIG. 1 is a diagram showing the overall configuration according to one embodiment of the present invention. The eyebrow makeup guide device 10 presents an eyebrow makeup guide for shaping the eyebrows of the user 20 into predetermined eyebrows based on the features of the eyebrows of the user 20 . For example, the eyebrow makeup guide device 10 is a smartphone or the like having a camera function. The eyebrow makeup guide device 10 will be described in detail later with reference to FIG.
 なお、本明細書では、眉メイクガイド装置10が1つの機器(例えば、カメラ機能を有するスマートフォン等)である場合を説明するが、眉メイクガイド装置10が複数の機器(例えば、カメラ機能を有さない機器とデジタルカメラ)から構成されてもよい。また、眉メイクガイド装置10以外の装置(サーバ等)が、本明細書で説明する眉メイクガイド装置10が実行する処理のうちの一部の処理を実行するようにしてもよい。 In this specification, a case where the eyebrow makeup guide device 10 is one device (for example, a smartphone having a camera function, etc.) will be described. device and a digital camera). Also, a device (server or the like) other than eyebrow makeup guide device 10 may perform a part of the processing performed by eyebrow makeup guide device 10 described herein.
<眉メイクガイド装置10の機能ブロック>
 図2は、本発明の一実施形態に係る眉メイクガイド装置10の機能ブロックを示す図である。眉メイクガイド装置10は、画像取得部101と、特徴量算出部102と、眉分類部103と、提示部104と、を備えることができる。また、眉メイクガイド装置10は、プログラムを実行することで、画像取得部101、特徴量算出部102、眉分類部103、提示部104、として機能することができる。以下、それぞれについて説明する。
<Functional Blocks of Eyebrow Makeup Guide Device 10>
FIG. 2 is a diagram showing functional blocks of the eyebrow makeup guide device 10 according to one embodiment of the present invention. The eyebrow makeup guide device 10 can include an image acquisition unit 101 , a feature quantity calculation unit 102 , an eyebrow classification unit 103 and a presentation unit 104 . Further, the eyebrow makeup guide device 10 can function as an image acquisition unit 101, a feature amount calculation unit 102, an eyebrow classification unit 103, and a presentation unit 104 by executing programs. Each of these will be described below.
 画像取得部101は、眉が撮影された画像を取得する。具体的には、画像取得部101は、眉メイクガイド装置10等のカメラ機能によってユーザ20の眉が撮影された画像を取得する。 The image acquisition unit 101 acquires an image of the eyebrows. Specifically, the image acquiring unit 101 acquires an image of the eyebrows of the user 20 captured by the camera function of the eyebrow makeup guide device 10 or the like.
 なお、眉が撮影された画像は、眉と眉以外とが撮影された画像(例えば、顔全体が撮影された画像)でもよいし、眉のみが撮影された画像(例えば、眉メイクガイド装置10の表示装置に表示された所定の領域内にユーザ20の眉の領域がおさまるように撮影された画像)でもよい。 Note that the image in which the eyebrows are photographed may be an image in which the eyebrows and other than the eyebrows are photographed (for example, an image in which the entire face is photographed), or an image in which only the eyebrows are photographed (for example, the eyebrow makeup guide device 10 image captured so that the area of the eyebrows of the user 20 fits within a predetermined area displayed on the display device).
 特徴量算出部102は、眉の特徴量(詳細については後述する)を算出する。具体的には、特徴量算出部102は、画像取得部101が取得した眉が撮影された画像から、ユーザ20の眉の特徴量を算出する。 The feature quantity calculation unit 102 calculates the feature quantity of the eyebrows (details will be described later). Specifically, the feature amount calculation unit 102 calculates the feature amount of the eyebrows of the user 20 from the captured image of the eyebrows acquired by the image acquisition unit 101 .
 眉分類部103は、眉の特徴量に基づいて、眉を分類(例えば、ストレート眉、上り眉、下がり眉等の眉の形状を示すカテゴリに分類)する。具体的には、眉分類部103は、特徴量算出部102が算出した眉の特徴量に基づいて、ユーザ20の眉を分類する。 The eyebrow classification unit 103 classifies eyebrows (for example, into categories indicating the shape of eyebrows such as straight eyebrows, upturned eyebrows, and downturned eyebrows) based on eyebrow feature amounts. Specifically, the eyebrow classification unit 103 classifies the eyebrows of the user 20 based on the eyebrow feature amount calculated by the feature amount calculation unit 102 .
 提示部104は、眉の分類結果に基づいて、眉を所定の眉にするための眉メイクのガイドを提示する。具体的には、提示部104は、眉分類部103による眉の分類結果に基づいて、ユーザ20の眉を所定の眉にするための眉メイクのガイドを提示(例えば、眉メイクガイド装置10に表示)する。例えば、提示部104は、ユーザ20の眉を所定の眉にするために使用すべき化粧品および用具、および、ユーザ20の眉を所定の眉にするための眉の描画(なお、本明細書において、ユーザ20が眉を描くことを"描画"という)方法、描画領域、描画順序、化粧品および用具の使い方を提示することができる。なお、所定の眉は、複数の眉から選択された眉であってもよい。 The presentation unit 104 presents an eyebrow makeup guide for making the eyebrows into predetermined eyebrows based on the eyebrow classification results. Specifically, the presentation unit 104 presents an eyebrow makeup guide for making the eyebrows of the user 20 into predetermined eyebrows based on the eyebrow classification result by the eyebrow classification unit 103 (for example, the eyebrow makeup guide device 10 indicate. For example, the presentation unit 104 provides cosmetics and tools to be used to make the eyebrows of the user 20 into predetermined eyebrows, and drawing of eyebrows to make the eyebrows of the user 20 into predetermined eyebrows (in this specification , how the user 20 draws the eyebrows (referred to as "drawing"), the drawing area, the drawing order, the use of cosmetics and tools. Note that the predetermined eyebrows may be eyebrows selected from a plurality of eyebrows.
 ここで、眉メイクのガイドについて詳細に説明する。眉メイクのガイドは、ユーザ20の眉を所定の眉にするために使用すべき化粧品および用具、および、ユーザ20の眉を所定の眉にするための眉の描画方法、描画領域、描画順序、化粧品および用具の使い方を含む。 Here, I will explain the eyebrow makeup guide in detail. The eyebrow makeup guide includes cosmetics and tools to be used to make the eyebrows of the user 20 into the predetermined eyebrows, and the eyebrow drawing method, the drawing area, the drawing order, Including the use of cosmetics and tools.
 例えば、化粧品および用具は、アイブロウペンシル、アイブロウパウダー、アイブロウマスカラ、ブラシ、コーム等である。 For example, cosmetics and tools are eyebrow pencils, eyebrow powder, eyebrow mascara, brushes, combs, and the like.
 例えば、化粧品および用具は、ユーザ20の素の眉(ユーザ20のメイクアップ前の眉)と所定の眉(つまり、ユーザ20が望む眉)の状態に応じて決定される。例えば、素の眉が薄い状態であるユーザ20がしっかりした眉を望む場合には、全体的な濃さを変化させるアイブロウパウダーが用いられる。また、例えば、素の眉が薄い場合にはアイブロウパウダーが用いられ、眉尻が無く眉頭が濃い場合にはバランスを整えるためにアイブロウパウダーが用いられ、眉が濃いがまばらな場合にはアイブロウペンシルが用いられ、眉が濃い場所にはアイブロウマスカラや、コンシーラー、アイブローシザーズが用いられてもよい。 For example, cosmetics and tools are determined according to the state of user's 20 natural eyebrows (user's 20 eyebrows before makeup) and predetermined eyebrows (that is, user's 20 desired eyebrows). For example, if a user 20 whose natural eyebrows are thin desires firm eyebrows, an eyebrow powder that changes the overall darkness is used. Also, for example, eyebrow powder is used when the original eyebrows are thin, eyebrow powder is used to balance the eyebrows when the eyebrows are thick but thick, and eyebrow pencil is used when the eyebrows are thick but sparse. is used, and eyebrow mascara, concealer, and eyebrow scissors may be used where the eyebrows are thick.
 眉の描画方法、描画領域、描画順序、化粧品および用具の使い方は、どのような順序でどの領域をどのような手の動かし方で化粧をするかを示す。例えば、素の眉が薄い場合には、肌なじみのよいアイブロウパウダーでソフトに描く。また、例えば、眉毛の濃い部分と薄い部分の差がある場合には、生えていない部分を濃いめのブラウンで描き足す。また、例えば、素の眉が濃い場合には隙間を埋めるように、アイブロウペンシルで描く。まばらな部分は1本1本眉毛を描き足すように仕上げる。最後に、アイブロウマスカラを使い、眉頭から眉尻に向かって毛流れを整えるように塗布する。 The method of drawing eyebrows, the drawing area, the order of drawing, the use of cosmetics and tools indicate the order in which areas to apply makeup and how to move the hands. For example, if your natural eyebrows are thin, draw them softly with eyebrow powder that blends well with your skin. Also, for example, if there is a difference between dark and thin eyebrows, the dark brown is added to the ungrown portion. Also, for example, if the natural eyebrows are dark, draw with an eyebrow pencil so as to fill the gaps. For sparse areas, finish by adding eyebrows one by one. Finally, use eyebrow mascara and apply it so that the hair flow is adjusted from the inner eyebrow to the outer eyebrow.
 例えば、所定の眉は、複数の眉からユーザ20等によって選択された眉である。例えば、所定の眉は、ユーザ20が望むイメージに合わせた眉であってもよい。また、例えば、所定の眉は、事前に決められた眉である。例えば、所定の眉は、眉メイクガイド装置10が選択した流行の眉であってもよいし、「基本的な眉」、「なりたい印象の眉(キュート・フレッシュ・クール・エレガントなど(顔立ちマップ(顔立ちを分類したマップ)の4象限より)」、「なりたい眉(きちんと眉・ふんわり眉・平行眉など)」、「シーンに合わせた眉」であってもよいし、ユーザ20の顔特徴から決められた眉であってもよい。 For example, the predetermined eyebrows are eyebrows selected by the user 20 or the like from a plurality of eyebrows. For example, the predetermined eyebrows may be eyebrows that match the image desired by the user 20 . Also, for example, the predetermined eyebrows are predetermined eyebrows. For example, the predetermined eyebrows may be trendy eyebrows selected by the eyebrow makeup guide device 10, "basic eyebrows", "eyebrows with desired impression (cute, fresh, cool, elegant, etc.) (feature map ( (from the four quadrants of a map classifying features)," desired eyebrows (neat eyebrows, soft eyebrows, parallel eyebrows, etc.)", and "eyebrows matching the scene", or determined from the facial features of the user 20 It may be a sculpted eyebrow.
 例えば、ユーザ20の眉が上がり眉で、やさしい印象の眉になりたい場合(ユーザ20が望むイメージが"やさしい印象"の場合)には、やさしいソフトな印象に描けるアイブロウパウダーで、眉頭の上側と眉山の下側を描き足し、眉の角度をなだらかにする。眉山は角をつけすぎずになだらかにし眉尻はだんだん細くなるように描く。まばらな部分がある場合には、ヌケを埋めるように描き足す。最後に、眉頭が強くならないようにスクリューブラシでやさしくぼかし仕上げる。 For example, when the eyebrows of the user 20 are raised eyebrows and the user 20 wants the eyebrows to have a gentle impression (when the image desired by the user 20 is a "gentle impression"), an eyebrow powder that gives a gentle and soft impression is applied to the upper part of the eyebrow tip and the eyebrow peak. Draw the lower part of the , and make the angle of the eyebrows gentle. Draw the peak of the eyebrow gently without making it too sharp, and gradually taper the tail of the eyebrow. If there are sparse parts, draw to fill in the gaps. Finally, gently blur with a screw brush so that the inner corners of the eyebrows do not become strong.
 例えば、ユーザ20の眉が下がり眉で、きちんとした印象の眉になりたい場合(ユーザ20が望むイメージが"きちんとした印象"の場合)には、きちんとした感じを出せるアイブロウペンシルで、眉山の位置をやや高めにとり、眉山から眉尻をだんだん細くなるように描く。次に、眉山から眉頭の部分を描き、まばらな部分がある場合は、ヌケを埋めるように描き足す。最後に、眉の中心部分に濃さを出すように描き足し、立体感をつけるように仕上げる。 For example, when the eyebrows of the user 20 are lowered and the user 20 wants to have a proper eyebrow (when the image desired by the user 20 is a "precise impression"), an eyebrow pencil that gives a proper feeling is used to adjust the position of the eyebrow. Take it slightly higher and draw from the peak of the eyebrow to the end of the eyebrow so that it gradually becomes thinner. Next, draw the part from Mt. Bizan to the inner part of the eyebrow. Finally, add a darker shade to the center of the eyebrows to give it a three-dimensional look.
 <処理方法>
 図3は、本発明の一実施形態に係る眉メイクガイド処理の流れを示すフローチャートである。
<Processing method>
FIG. 3 is a flowchart showing the flow of eyebrow makeup guide processing according to one embodiment of the present invention.
 ステップ1(S1)において、画像取得部101は、眉が撮影された画像を取得する。具体的には、画像取得部101は、眉メイクガイド装置10等のカメラ機能によってユーザ20の眉が撮影された画像を取得する。 In step 1 (S1), the image acquisition unit 101 acquires an image of the eyebrows. Specifically, the image acquiring unit 101 acquires an image of the eyebrows of the user 20 captured by the camera function of the eyebrow makeup guide device 10 or the like.
 ステップ2(S2)において、特徴量算出部102は、眉の特徴量を算出する。具体的には、特徴量算出部102は、S1で取得された眉が撮影された画像から、ユーザ20の眉の特徴量を算出する。顔特徴は、眉の濃さ・眉の太さ・眉の角度・眉の長さ、目の形状(直線的か曲線的か)・目の角度・目の大きさ、目と目の距離、目と眉の距離、鼻の形状(直線的か曲線的か)、口の形状(直線的か曲線的か)・口の横幅、頬の形状(直線的か曲線的か)・頬の長さ、輪郭の形状(直線的か曲線的か)、顔の長さを使用して算出される。 In step 2 (S2), the feature quantity calculation unit 102 calculates the feature quantity of the eyebrows. Specifically, the feature amount calculation unit 102 calculates the feature amount of the eyebrows of the user 20 from the captured image of the eyebrows acquired in S1. Facial features include eyebrow density, eyebrow thickness, eyebrow angle, eyebrow length, eye shape (straight or curved), eye angle, eye size, distance between eyes, Distance between eyes and eyebrows, nose shape (straight or curved), mouth shape (straight or curved), mouth width, cheek shape (straight or curved), cheek length , contour shape (straight or curvilinear), and face length.
 ステップ3(S3)において、眉分類部103は、眉の特徴量に基づいて、眉を分類する。具体的には、眉分類部103は、S2で算出された眉の特徴量に基づいて、ユーザ20の眉を分類する。 In step 3 (S3), the eyebrow classification unit 103 classifies the eyebrows based on the eyebrow feature amount. Specifically, the eyebrow classification unit 103 classifies the eyebrows of the user 20 based on the eyebrow feature amount calculated in S2.
 ステップ4(S4)において、提示部104は、眉の分類結果に基づいて、眉を所定の眉にするための眉メイクのガイドを提示する。具体的には、提示部104は、S3の眉の分類結果に基づいて、ユーザ20の眉を所定の眉にするための眉メイクのガイドを提示(例えば、眉メイクガイド装置10に表示)する。例えば、提示部104は、眉を所定の眉にするために使用すべき化粧品および用具、および、眉を所定の眉にするための眉の描画方法、描画領域、描画順序、化粧品および用具の使い方を提示(例えば、眉メイクガイド装置10に表示)することができる。 In step 4 (S4), the presentation unit 104 presents an eyebrow makeup guide for making the eyebrows into a predetermined eyebrow based on the eyebrow classification result. Specifically, the presentation unit 104 presents (for example, displays on the eyebrow makeup guide device 10) an eyebrow makeup guide for making the eyebrows of the user 20 into predetermined eyebrows based on the eyebrow classification result of S3. . For example, the presenting unit 104 provides cosmetics and tools to be used to make eyebrows into predetermined eyebrows, eyebrow drawing method, drawing area, drawing order, how to use cosmetics and tools to make eyebrows into predetermined eyebrows. can be presented (for example, displayed on the eyebrow makeup guide device 10).
 図4は、本発明の一実施形態に係る眉特徴量算出処理(図3のS2)の処理の流れを示すフローチャートである。 FIG. 4 is a flow chart showing the flow of the eyebrow feature amount calculation process (S2 in FIG. 3) according to one embodiment of the present invention.
 ステップ11(S11)において、特徴量算出部102は、眉の領域を抽出する。 At step 11 (S11), the feature amount calculation unit 102 extracts the eyebrow area.
 例えば、特徴量算出部102は、ユーザ20の眉が撮影された画像(図3のS1で取得された画像)において、ユーザ20の眉および眉周辺の特徴点を用いて、眉の領域を抽出することができる。例えば、特徴量算出部102は、ユーザ20の眉が撮影された画像(図3のS1で取得された画像)において、ユーザ20の眉の特徴を表す特徴点(例えば、眉頭、眉尻、目、こめかみ、鼻の少なくとも3つの特徴点)を抽出する。次に、特徴量算出部102は、ユーザ20の眉が撮影された画像(図3のS1で取得された画像)において、眉の領域を抽出する。具体的には、特徴量算出部102は、S11で抽出されたユーザ20の眉の特徴を表す特徴点(例えば、眉頭、眉尻、目、こめかみ、鼻の少なくとも3つの特徴点)に基づいて、眉の領域を抽出する。 For example, the feature amount calculation unit 102 extracts an eyebrow region using the eyebrows of the user 20 and feature points around the eyebrows in the image of the eyebrows of the user 20 (the image acquired in S1 in FIG. 3). can do. For example, the feature amount calculation unit 102 calculates feature points representing features of the eyebrows of the user 20 (for example, an eyebrow head, an eyebrow tail, an eye , temples, and nose). Next, the feature amount calculation unit 102 extracts an eyebrow region from the image of the eyebrows of the user 20 (the image acquired in S1 of FIG. 3). Specifically, the feature amount calculation unit 102 calculates the feature points based on the feature points representing the features of the eyebrows of the user 20 extracted in S11 (for example, at least three feature points of the inner and outer ends of the eyebrows, the eyes, the temples, and the nose). , to extract the eyebrow region.
 なお、上記のように特徴点に基づいて眉の領域を抽出する手法に限られず、特徴量算出部102は、眉毛の色味(濃淡)や顔との相対位置(例えば、目の上)といった情報を用いて、眉の領域を抽出してもよい。また、特徴量算出部102は、機械学習により生成された学習済みモデルを用いて、眉の領域を抽出してもよい。 It should be noted that the feature amount calculation unit 102 is not limited to the method of extracting the eyebrow region based on the feature points as described above. The information may be used to extract the eyebrow region. Further, the feature amount calculation unit 102 may extract the eyebrow region using a learned model generated by machine learning.
 なお、眉が撮影された画像が、眉のみが撮影された画像(例えば、眉メイクガイド装置10の表示装置に表示された所定の領域内にユーザ20の眉の領域がおさまるように撮影された画像)である場合には、眉のみが撮影された画像がそのまま用いられる(つまり、S11が省略されてもよい)。 Note that the image in which the eyebrows are photographed is an image in which only the eyebrows are photographed (for example, an image in which the eyebrows of the user 20 are photographed so as to fit within a predetermined region displayed on the display device of the eyebrow makeup guide device 10). image), the image in which only the eyebrows are photographed is used as it is (that is, S11 may be omitted).
 ステップ12(S12)において、特徴量算出部102は、S11で抽出された眉の領域の画像の階調数を下げる(例えば、2値化する)。例えば、特徴量算出部102は、輝度と、明度と、RGBのBlueと、RGBのGreenと、のうちの少なくとも1つを用いて、眉の領域の画像の階調数を下げる。なお、S12は、省略されうる。 In step 12 (S12), the feature amount calculation unit 102 reduces the number of gradations of the image of the eyebrow region extracted in S11 (for example, binarizes). For example, the feature amount calculation unit 102 uses at least one of luminance, lightness, RGB Blue, and RGB Green to reduce the number of gradations of the image of the eyebrow region. Note that S12 may be omitted.
 ステップ13(S13)において、特徴量算出部102は、S11で抽出された眉の領域の画像(S12が実行された場合には階調数を下げられた画像)の画素値の変化量を抽出する。具体的には、特徴量算出部102は、ある方向での画素の値の変化(眉の上部から下部にかけて、眉の眉頭から眉尻にかけての少なくとも1つにおける、画素の値の変化)を抽出する。 In step 13 (S13), the feature amount calculation unit 102 extracts the amount of change in the pixel value of the image of the eyebrow region extracted in S11 (the image with the number of gradations lowered when S12 is executed). do. Specifically, the feature amount calculation unit 102 extracts changes in pixel values in a certain direction (changes in pixel values in at least one direction from the top to the bottom of the eyebrow and from the head to the tail of the eyebrow). do.
 ステップ14(S14)において、特徴量算出部102は、S13で抽出された画素値の変化量に基づいて、眉の特徴量を算出する。例えば、特徴量算出部102は、眉の形状および眉の濃さの特徴量を算出する。 At step 14 (S14), the feature quantity calculation unit 102 calculates the feature quantity of the eyebrows based on the amount of change in the pixel value extracted at S13. For example, the feature amount calculation unit 102 calculates feature amounts of eyebrow shape and eyebrow density.
<眉の特徴量>
 以下、眉の特徴量について説明する。例えば、眉の特徴量は、眉の形状および眉の濃さを示す。また、例えば、眉の特徴量は、眉の重心を示す位置と、眉の眉頭および眉の眉尻の特徴と、眉の濃さと、眉の太さと、眉の全体の角度と、のうちの少なくとも1つを含む。
<Eyebrow feature amount>
The feature amount of eyebrows will be described below. For example, the eyebrow feature amount indicates the shape and density of the eyebrow. Also, for example, the eyebrow feature amount is one of the position indicating the center of gravity of the eyebrow, the features of the eyebrow head and eyebrow tail, the eyebrow density, the eyebrow thickness, and the overall angle of the eyebrow. including at least one.
<<眉の重心を示す位置>>
 図5および図6を参照しながら、眉の特徴量の一例である、眉の重心を示す位置の2つの例について説明する。例えば、眉の重心を示す位置は、所定の密度以上に眉毛に覆われている領域の図心、または、最も眉毛に覆われている領域を二等分する線である。
<<Position indicating the center of gravity of the eyebrow>>
Two examples of the position indicating the center of gravity of the eyebrow, which is an example of the feature amount of the eyebrow, will be described with reference to FIGS. 5 and 6. FIG. For example, the position indicating the center of gravity of the eyebrow is the centroid of the area covered with eyebrows at a predetermined density or more, or the line that bisects the area covered most with eyebrows.
 図5は、本発明の一実施形態に係る眉の重心を示す位置(例1)について説明するための図である。まず、特徴量算出部102は、眉が撮影された画像を複数の格子状の領域に分ける(図5の上部)。次に、特徴量算出部102は、各格子状の領域における画素値(例えば、輝度と、明度と、RGBのBlueと、RGBのGreenと、のうちの少なくとも1つ)の合計を算出する。次に、特徴量算出部102は、画素値の合計が閾値以上である格子状の領域を、眉の重心を示す位置として決定する(図5の下部)。なお、図5の例では、<眉1>の眉の重心を示す位置として4つの格子状の領域が決定されており、<眉2>の眉の重心を示す位置として6つの格子状の領域が決定されている。 FIG. 5 is a diagram for explaining the position (example 1) indicating the center of gravity of the eyebrows according to one embodiment of the present invention. First, the feature amount calculation unit 102 divides the image in which the eyebrows are captured into a plurality of grid-like regions (upper portion of FIG. 5). Next, the feature amount calculation unit 102 calculates the sum of pixel values (for example, at least one of luminance, brightness, RGB blue, and RGB green) in each grid area. Next, the feature amount calculation unit 102 determines a grid-like region in which the sum of pixel values is equal to or greater than the threshold as the position indicating the center of gravity of the eyebrow (lower part of FIG. 5). In the example of FIG. 5, four grid regions are determined as positions indicating the center of gravity of <eyebrow 1>, and six grid regions are determined as positions indicating the center of gravity of <eyebrow 2>. has been determined.
 図6は、本発明の一実施形態に係る眉の重心を示す位置(例2)について説明するための図である。まず、特徴量算出部102は、眉が撮影された画像をY軸と平行な複数の軸(なお、X軸と平行な軸でもよい)で複数の領域に分ける(図6の上部)。次に、特徴量算出部102は、各領域における画素値(例えば、輝度と、明度と、RGBのBlueと、RGBのGreenと、のうちの少なくとも1つ)の合計を算出する。次に、特徴量算出部102は、画素値の合計がピークとなる領域を、眉の重心を示す位置として決定する(図6の下部)。 FIG. 6 is a diagram for explaining the position (example 2) indicating the center of gravity of the eyebrows according to one embodiment of the present invention. First, the feature amount calculation unit 102 divides the image of the eyebrows into a plurality of regions along a plurality of axes parallel to the Y axis (an axis parallel to the X axis may also be used) (upper portion of FIG. 6). Next, the feature amount calculation unit 102 calculates the sum of pixel values (for example, at least one of luminance, brightness, RGB Blue, and RGB Green) in each region. Next, the feature amount calculation unit 102 determines the region where the sum of the pixel values peaks as the position indicating the center of gravity of the eyebrow (lower part of FIG. 6).
<<眉頭および眉尻の特徴>>
 図7および図8を参照しながら、眉の特徴量の一例である、眉頭および眉尻について説明する。例えば、眉の眉頭および眉の眉尻の特徴は、眉頭および眉尻の角度、あるいは、眉頭および眉尻の画素値の変化である。
<<Features of the inner and outer ends of the eyebrows>>
The eyebrow head and eyebrow tail, which are an example of eyebrow feature amounts, will be described with reference to FIGS. 7 and 8. FIG. For example, the feature of the eyebrow head and the eyebrow tail is the angle of the eyebrow head and the eyebrow tail, or the change in the pixel value of the eyebrow head and the eyebrow tail.
 図7は、本発明の一実施形態に係る眉尻の特徴について説明するための図である。なお、顔の正中線と垂直な軸をX軸、顔の正中線と平行な軸をY軸とする。まず、特徴量算出部102は、眉が撮影された画像において、特徴点(具体的には、眉頭の点A、眉尻の点D、点Aと点DのX軸方向の距離を等分する眉上の点Bおよび点C)を抽出する(図7の上部)。次に、特徴量算出部102は、CDの角度(図7のθ=atan(b/a))を算出し、該CDの角度を眉尻の特徴として決定する(図7の下部)。 FIG. 7 is a diagram for explaining the features of the outer corner of the eyebrow according to one embodiment of the present invention. The axis perpendicular to the midline of the face is the X-axis, and the axis parallel to the midline of the face is the Y-axis. First, the feature amount calculation unit 102 divides the feature points (specifically, the point A at the beginning of the eyebrow, the point D at the end of the eyebrow, and the distance between the point A and the point D in the X-axis direction in an image in which the eyebrow is photographed). Extract point B and point C) on the eyebrows where the eyebrows are (upper part of FIG. Next, the feature amount calculation unit 102 calculates the CD angle (θ=atan(b/a) in FIG. 7) and determines the CD angle as the feature of the eyebrow corner (lower part of FIG. 7).
 図8は、本発明の一実施形態に係る眉頭の特徴について説明するための図である。なお、顔の正中線と垂直な軸をX軸、顔の正中線と平行な軸をY軸とする。まず、特徴量算出部102は、眉が撮影された画像において、特徴点(具体的には、眉頭の点A、眉尻の点D、点Aと点DのX軸方向の距離を等分する眉上の点Bおよび点C)を抽出する(図8の上部)。次に、特徴量算出部102は、ABの角度(図8のθ=atan(b/a))を算出し、該ABの角度を眉頭の特徴として決定する(図8の下部)。 FIG. 8 is a diagram for explaining the features of the inner eyebrow according to one embodiment of the present invention. The axis perpendicular to the midline of the face is the X-axis, and the axis parallel to the midline of the face is the Y-axis. First, the feature amount calculation unit 102 divides the feature points (specifically, the point A at the beginning of the eyebrow, the point D at the end of the eyebrow, and the distance between the point A and the point D in the X-axis direction in an image in which the eyebrow is photographed). Extract points B and C) on the eyebrows where the eyebrows are located (upper part of FIG. 8). Next, the feature amount calculation unit 102 calculates the angle AB (θ=atan(b/a) in FIG. 8) and determines the angle AB as the feature of the inner eyebrow (lower part of FIG. 8).
 なお、特徴量算出部102は、<<眉の重心を示す位置>>で説明したように、眉が撮影された画像を複数の領域に分けて、眉頭および眉尻の領域における領域ごとの画素値の合計または画素の値の変化を、眉頭および眉尻の特徴として決定してもよい。 Note that the feature amount calculation unit 102 divides the image in which the eyebrow is captured into a plurality of regions, as described in <<Position indicating the center of gravity of the eyebrow>>, and calculates pixels for each region in the eyebrow head and eyebrow tail regions. The sum of values or the change in pixel values may be determined as features of the inner and outer ends of the eyebrows.
<<眉の濃さ>>
 図9を参照しながら、眉の特徴量の一例である、眉の濃さについて説明する。例えば、眉の濃さは、眉内の各領域の濃さを示す。
<< Darkness of eyebrows >>
The density of the eyebrows, which is an example of the feature amount of the eyebrows, will be described with reference to FIG. For example, eyebrow density indicates the density of each region within the eyebrow.
 図9は、本発明の一実施形態に係る眉の濃さについて説明するための図である。まず、特徴量算出部102は、眉の濃さを算出する領域を設定する。例えば、特徴量算出部102は、目頭、目尻、虹彩、鼻の位置情報を用いて、眉の濃さを算出する領域(例えば、図9の3つの領域)を設定する。次に、特徴量算出部102は、各領域における画素値(例えば、輝度と、明度と、RGBのBlueと、RGBのGreenと、のうちの少なくとも1つ)の合計を算出する。次に、特徴量算出部102は、各領域に設定された閾値に基づいて、濃さのレベルを判定する(図9の右部)。 FIG. 9 is a diagram for explaining the density of eyebrows according to one embodiment of the present invention. First, the feature amount calculation unit 102 sets an area for calculating the density of the eyebrows. For example, the feature amount calculation unit 102 sets regions (for example, three regions in FIG. 9) for calculating the density of eyebrows using the position information of the inner and outer corners of the eyes, the iris, and the nose. Next, the feature amount calculation unit 102 calculates the sum of pixel values (for example, at least one of luminance, brightness, RGB Blue, and RGB Green) in each region. Next, the feature amount calculation unit 102 determines the level of darkness based on the threshold set for each area (right part of FIG. 9).
<<眉の太さ>>
 図10を参照しながら、眉の特徴量の一例である、眉の太さについて説明する。例えば、眉の太さは、眉内の各領域の太さを示す。
<<thickness of eyebrows>>
The thickness of the eyebrows, which is an example of the feature amount of the eyebrows, will be described with reference to FIG. For example, eyebrow thickness indicates the thickness of each region within the eyebrow.
 図10は、本発明の一実施形態に係る眉の太さについて説明するための図である。まず、特徴量算出部102は、眉の太さを算出する領域を設定する。例えば、特徴量算出部102は、目頭、目尻、虹彩、鼻の位置情報を用いて、眉の太さを算出する領域(例えば、図10の3つの領域)を設定する。次に、特徴量算出部102は、各領域における画素値(例えば、輝度と、明度と、RGBのBlueと、RGBのGreenと、のうちの少なくとも1つ)の合計を算出する。次に、特徴量算出部102は、各領域に設定された閾値に基づいて、太さのレベルを判定する(図10の右部)。 FIG. 10 is a diagram for explaining the thickness of eyebrows according to one embodiment of the present invention. First, the feature amount calculation unit 102 sets an area for calculating the thickness of the eyebrows. For example, the feature amount calculation unit 102 sets regions (for example, three regions in FIG. 10) for calculating the thickness of eyebrows using the position information of the inner and outer corners of the eye, the iris, and the nose. Next, the feature amount calculation unit 102 calculates the sum of pixel values (for example, at least one of luminance, brightness, RGB Blue, and RGB Green) in each region. Next, the feature amount calculation unit 102 determines the thickness level based on the threshold value set for each area (right part of FIG. 10).
<<その他の眉の特徴量>>
 例えば、眉の特徴量は、眉の全体の角度であってもよい。また、例えば、眉の特徴量は、顔における眉の位置であってもよい。例えば、眉の位置は、眉と目の距離と、左右の眉の位置と、のうちの少なくとも1つを含む。また、例えば、眉の特徴量は、眉の幅であってもよい。また、例えば、眉の特徴量は、眉のアーチであってもよい。
<<Other features of eyebrows>>
For example, the eyebrow feature amount may be the angle of the entire eyebrow. Further, for example, the feature amount of the eyebrows may be the position of the eyebrows on the face. For example, the eyebrow position includes at least one of an eyebrow-to-eye distance and left and right eyebrow positions. Further, for example, the eyebrow feature amount may be the width of the eyebrow. Also, for example, the eyebrow feature amount may be the arch of the eyebrow.
<眉の分類>
 図11および図12を参照しながら、眉の分類(例えば、眉の形状を示すカテゴリへの分類)について説明する。
<Classification of eyebrows>
Classification of eyebrows (for example, classification into categories indicating shapes of eyebrows) will be described with reference to FIGS. 11 and 12 .
 図11は、本発明の一実施形態に係る眉の分類(例1)について説明するための図である。なお、図11の点線内は、眉を描く領域であり、その描き方や化粧品、用具は、眉の太さにより異なる(なお、点線内以外の領域を眉を描き足す領域としてもよい)。また、図11の実線内は、コンシーラーでぼかしたりまたは整える領域である。 FIG. 11 is a diagram for explaining eyebrow classification (example 1) according to an embodiment of the present invention. The area within the dotted line in FIG. 11 is an area for drawing eyebrows, and the manner of drawing, cosmetics, and tools differ depending on the thickness of the eyebrows (an area other than the dotted line may be used as an additional area for drawing eyebrows). Also, the area within the solid line in FIG. 11 is the area to be blurred or trimmed with the concealer.
 図11の例では、眉分類部103は、眉の特徴量である「眉の重心を示す位置」および「眉の太さ」に基づいて、眉を複数のカテゴリのうちのいずれかに分類することができる。具体的には、眉分類部103は、「眉の重心を示す位置」が下がっているか上がっているか、「眉の太さ」が細いか太いかに基づいて、例えば、図11のA1、A2、B1、B2、B3、C1、C2、D1、D2といったカテゴリに分類することができる。なお、眉の重心を示す位置が所定の値(例えば、a)の場合に、眉の太さを考慮せずに所定のガイド(例えば、B1のガイド)を提示することができる。 In the example of FIG. 11 , the eyebrow classification unit 103 classifies the eyebrow into one of a plurality of categories based on the eyebrow feature amounts “the position indicating the center of gravity of the eyebrow” and “the thickness of the eyebrow”. be able to. Specifically, the eyebrow classification unit 103 determines whether the "position indicating the center of gravity of the eyebrow" is lowered or raised, and whether the "thickness of the eyebrow" is thin or thick. They can be classified into categories such as B1, B2, B3, C1, C2, D1 and D2. Note that when the position indicating the center of gravity of the eyebrow is a predetermined value (eg, a), a predetermined guide (eg, B1 guide) can be presented without considering the thickness of the eyebrow.
 図12は、本発明の一実施形態に係る眉の分類(例2)について説明するための図である。 FIG. 12 is a diagram for explaining eyebrow classification (example 2) according to an embodiment of the present invention.
 図12の例では、眉分類部103は、眉の特徴量である「眉の重心を示す位置」および「眉全体の角度」に基づいて、眉を複数のカテゴリのうちのいずれかに分類することができる。具体的には、眉分類部103は、「眉の重心を示す位置」が下がっているか上がっているか、「眉全体の角度」が小さいか大きいかに基づいて、例えば、図12のA、B、C、D、Eといったカテゴリに分類することができる。なお、複数のカテゴリの間(例えば、DとEの間)に分類された場合にも、ガイド(例えば、"眉頭上側と眉山から眉尻までの下側を書き足す。水平ラインを目安に、はみ出る部分は描かないようにする。細い場合、ブラシまたはアイブロウペンシルで太さを足す。太い場合、アイブロウマスカラで毛並みを整える"といったガイド)を提示することができる。 In the example of FIG. 12 , the eyebrow classification unit 103 classifies the eyebrow into one of a plurality of categories based on the eyebrow feature quantity “the position indicating the center of gravity of the eyebrow” and “the angle of the entire eyebrow”. be able to. Specifically, the eyebrow classification unit 103 classifies, for example, A and B in FIG. , C, D, and E. Note that even when classified between a plurality of categories (for example, between D and E), a guide (for example, "add the upper side of the eyebrow and the lower side from the mountain to the end of the eyebrow. Using the horizontal line as a guide, If it's thin, add thickness with a brush or eyebrow pencil.If it's thick, trim it with eyebrow mascara."
<眉メイクのガイド>
 図13を参照しながら、眉メイクのガイドについて説明する。図13は、本発明の一実施形態に係る眉メイクのガイドについて説明するための図である。例えば、提示部104は、実眉を抽出した画像(毛部分を抽出した画像)または実眉のイラストを表示し、使用すべき化粧品および用具と眉の描画方法、描画領域、描画順序、化粧品および用具の使い方を表示する。
<Guide to eyebrow makeup>
A guide for eyebrow makeup will be described with reference to FIG. FIG. 13 is a diagram for explaining an eyebrow makeup guide according to an embodiment of the present invention. For example, the presentation unit 104 displays an image of the extracted real eyebrows (an image of the extracted hair part) or an illustration of the real eyebrows, cosmetics and tools to be used, eyebrow drawing method, drawing area, drawing order, cosmetics and Show how to use tools.
 提示部104は、眉の分類結果に基づいて、眉を所定の眉にするための眉メイクのガイドを提示する。つまり、提示部104は、カテゴリごとに定められているガイドのなかから、ユーザ20の眉が分類されたカテゴリのガイドを選択して、提示する。なお、提示部104は、ユーザ20の眉がカテゴリ間の境界である(つまり、複数のカテゴリにまたがる)場合には、複数のカテゴリの各カテゴリのガイドを併せたガイドを提示する。なお、提示部104は、眉の分類結果(つまり、カテゴリ)に基づいて眉メイクのガイドを提示してもよいし、眉の分類結果(つまり、カテゴリ)と眉の濃さに基づいて眉メイクのガイドを提示してもよい。これらの分類した眉の描画方法に加えて、図5の眉2のように、眉尻部分で部分的に濃さが薄い領域は、ブラシで書き足すようにガイドを表示する。 The presentation unit 104 presents an eyebrow makeup guide for making the eyebrows into predetermined eyebrows based on the eyebrow classification results. In other words, the presentation unit 104 selects and presents a guide of a category into which the eyebrows of the user 20 are classified, from the guides defined for each category. In addition, when the eyebrows of the user 20 are the boundaries between categories (that is, they span multiple categories), the presentation unit 104 presents a guide that combines the guides of each of the multiple categories. Note that the presentation unit 104 may present a guide for eyebrow makeup based on the eyebrow classification result (that is, category), or may present an eyebrow makeup guide based on the eyebrow classification result (that is, category) and the density of the eyebrows. You may present a guide to In addition to these classified drawing methods for eyebrows, a guide is displayed as if adding a brush to an area where the density is partially light at the end of the eyebrow, such as the eyebrow 2 in FIG.
 例えば、ユーザ20の眉が、図13の左側に示されるように、形状が下がり眉(Slanted)であり、眉尻がレベル1であり、眉の濃さが(眉位置A、B、C、D)=(3、3、1、1)であったとする。この場合、ユーザ20の眉を所定の眉(例えば、ストレート眉)にするために、眉を眉の下側に太さを出し、眉頭よりも下がっている眉尻部分は描かないよう示すガイドが提示される。 For example, as shown on the left side of FIG. 13 , the eyebrows of the user 20 are slanted in shape, the tail is level 1, and the depth of the eyebrows is (eyebrow positions A, B, C, D)=(3, 3, 1, 1). In this case, in order to make the eyebrows of the user 20 predetermined eyebrows (for example, straight eyebrows), there is a guide indicating that the eyebrows should be thickened at the lower side of the eyebrows and not drawn at the end of the eyebrow that is lower than the head of the eyebrow. Presented.
 例えば、ユーザ20の眉が、図13の右側に示されるように、形状が上り眉(Upward)であり、眉尻がレベル2であり、眉の濃さが(眉位置A、B、C、D)=(1、2、2、2)であったとする。この場合、ユーザ20の眉を所定の眉(例えば、ストレート眉)にするために、眉頭上と眉山周辺~眉尻の下側に足して太さと角度を調整し、眉頭からの水平ラインを目安に眉頭の下側と眉尻の部分は描かないよう示すガイドが提示される。 For example, as shown on the right side of FIG. 13 , the eyebrows of the user 20 have a shape of Upward, an eyebrow tail of level 2, and an eyebrow density of (eyebrow positions A, B, C, D)=(1, 2, 2, 2). In this case, in order to make the eyebrows of the user 20 a predetermined eyebrow (for example, straight eyebrows), the thickness and angle are adjusted by adding from the top of the eyebrow and around the mountain to the bottom of the eyebrow, and the horizontal line from the eyebrow is used as a guide. Then, a guide is presented indicating that the lower part of the inner eyebrow and the outer part of the eyebrow should not be drawn.
<効果>
 このように、本発明の一実施形態では、ユーザは、眉メイクのガイドで提示された化粧品および用具を使用して、眉メイクのガイドで提示されたユーザの眉を所定の眉にするための眉の描画方法、描画領域、描画順序、化粧品および用具の使い方にしたがって、眉メイクを容易に行うことができる。
<effect>
Thus, in one embodiment of the present invention, the user uses the cosmetics and tools suggested in the eyebrow makeup guide to make the user's eyebrows as specified in the eyebrow makeup guide. Eyebrow makeup can be easily performed according to the eyebrow drawing method, drawing area, drawing order, and usage of cosmetics and tools.
<ハードウェア構成>
 図14は、本発明の一実施形態に係る眉メイクガイド装置10のハードウェア構成を示す図である。眉メイクガイド装置10は、CPU(Central Processing Unit)1001、ROM(Read Only Memory)1002、RAM(Random Access Memory)1003を有する。CPU1001、ROM1002、RAM1003は、いわゆるコンピュータを形成する。
<Hardware configuration>
FIG. 14 is a diagram showing the hardware configuration of the eyebrow makeup guide device 10 according to one embodiment of the present invention. The eyebrow makeup guide device 10 has a CPU (Central Processing Unit) 1001 , a ROM (Read Only Memory) 1002 and a RAM (Random Access Memory) 1003 . The CPU 1001, ROM 1002, and RAM 1003 form a so-called computer.
 また、眉メイクガイド装置は、補助記憶装置1004、表示装置1005、操作装置1006、I/F(Interface)装置1007、ドライブ装置1008を有することができる。 Also, the eyebrow makeup guide device can have an auxiliary storage device 1004 , a display device 1005 , an operation device 1006 , an I/F (Interface) device 1007 and a drive device 1008 .
 なお、眉メイクガイド装置10の各ハードウェアは、バスBを介して相互に接続されている。 Each piece of hardware of the eyebrow makeup guide device 10 is interconnected via a bus B.
 CPU1001は、補助記憶装置1004にインストールされている各種プログラムを実行する演算デバイスである。 The CPU 1001 is an arithmetic device that executes various programs installed in the auxiliary storage device 1004 .
 ROM1002は、不揮発性メモリである。ROM1002は、補助記憶装置1004にインストールされている各種プログラムをCPU1001が実行するために必要な各種プログラム、データ等を格納する主記憶デバイスとして機能する。具体的には、ROM1002は、BIOS(Basic Input/Output System)やEFI(Extensible Firmware Interface)等のブートプログラム等を格納する、主記憶デバイスとして機能する。 The ROM 1002 is a non-volatile memory. The ROM 1002 functions as a main storage device that stores various programs, data, etc. necessary for the CPU 1001 to execute various programs installed in the auxiliary storage device 1004 . Specifically, the ROM 1002 functions as a main storage device that stores boot programs such as BIOS (Basic Input/Output System) and EFI (Extensible Firmware Interface).
 RAM1003は、DRAM(Dynamic Random Access Memory)やSRAM(Static Random Access Memory)等の揮発性メモリである。RAM1003は、補助記憶装置1004にインストールされている各種プログラムがCPU1001によって実行される際に展開される作業領域を提供する、主記憶デバイスとして機能する。 The RAM 1003 is a volatile memory such as DRAM (Dynamic Random Access Memory) or SRAM (Static Random Access Memory). The RAM 1003 functions as a main storage device that provides a work area that is developed when various programs installed in the auxiliary storage device 1004 are executed by the CPU 1001 .
 補助記憶装置1004は、各種プログラムや、各種プログラムが実行される際に用いられる情報を格納する補助記憶デバイスである。 The auxiliary storage device 1004 is an auxiliary storage device that stores various programs and information used when various programs are executed.
 表示装置1005は、眉メイクガイド装置10の内部状態等を表示する表示デバイスである。 The display device 1005 is a display device that displays the internal state of the eyebrow makeup guide device 10 and the like.
 操作装置1006は、眉メイクガイド装置10を操作する者が眉メイクガイド装置10に対して各種指示を入力する入力デバイスである。 The operation device 1006 is an input device through which a person who operates the eyebrow makeup guide device 10 inputs various instructions to the eyebrow makeup guide device 10 .
 I/F装置1007は、ネットワークに接続し、他の装置と通信を行うための通信デバイスである。 The I/F device 1007 is a communication device for connecting to a network and communicating with other devices.
 ドライブ装置1008は記憶媒体1009をセットするためのデバイスである。ここでいう記憶媒体1009には、CD-ROM、フレキシブルディスク、光磁気ディスク等のように情報を光学的、電気的あるいは磁気的に記録する媒体が含まれる。また、記憶媒体1009には、EPROM (Erasable Programmable Read Only Memory)、フラッシュメモリ等のように情報を電気的に記録する半導体メモリ等が含まれていてもよい。 A drive device 1008 is a device for setting a storage medium 1009 . The storage medium 1009 here includes media such as CD-ROMs, flexible disks, magneto-optical disks, etc., which record information optically, electrically or magnetically. The storage medium 1009 may also include a semiconductor memory that electrically records information such as an EPROM (Erasable Programmable Read Only Memory), a flash memory, or the like.
 なお、補助記憶装置1004にインストールされる各種プログラムは、例えば、配布された記憶媒体1009がドライブ装置1008にセットされ、該記憶媒体1009に記録された各種プログラムがドライブ装置1008により読み出されることでインストールされる。あるいは、補助記憶装置1004にインストールされる各種プログラムは、I/F装置1007を介して、ネットワークよりダウンロードされることでインストールされてもよい。 Various programs to be installed in the auxiliary storage device 1004 are installed by, for example, setting the distributed storage medium 1009 in the drive device 1008 and reading the various programs recorded in the storage medium 1009 by the drive device 1008. be done. Alternatively, various programs installed in the auxiliary storage device 1004 may be installed by being downloaded from the network via the I/F device 1007 .
 眉メイクガイド装置10は、撮影装置1010を有する。眉メイクガイド装置10は、ユーザ20を撮影する。 The eyebrow makeup guide device 10 has an imaging device 1010 . Eyebrow makeup guide device 10 photographs user 20 .
 以上、本発明の実施例について詳述したが、本発明は上述した特定の実施形態に限定されるものではなく、特許請求の範囲に記載された本発明の要旨の範囲内において、種々の変形・変更が可能である。 Although the embodiments of the present invention have been described in detail above, the present invention is not limited to the specific embodiments described above, and various modifications can be made within the scope of the gist of the present invention described in the claims.・Changes are possible.
 本国際出願は2021年8月27日に出願された日本国特許出願2021-139419号に基づく優先権を主張するものであり、2021-139419号の全内容をここに本国際出願に援用する。 This international application claims priority based on Japanese Patent Application No. 2021-139419 filed on August 27, 2021, and the entire contents of No. 2021-139419 are hereby incorporated into this international application.
10 眉メイクガイド装置
20 ユーザ
101 画像取得部
102 特徴量算出部
103 眉分類部
104 提示部
1001 CPU
1002 ROM
1003 RAM
1004 補助記憶装置
1005 表示装置
1006 操作装置
1007 I/F装置
1008 ドライブ装置
1009 記憶媒体
1010 撮影装置
10 eyebrow makeup guide device 20 user 101 image acquisition unit 102 feature quantity calculation unit 103 eyebrow classification unit 104 presentation unit 1001 CPU
1002 ROMs
1003 RAM
1004 auxiliary storage device 1005 display device 1006 operation device 1007 I/F device 1008 drive device 1009 storage medium 1010 imaging device

Claims (15)

  1.  眉が撮影された画像を取得するステップと、
     前記眉の特徴量を算出するステップと、
     前記眉の特徴量に基づいて、前記眉を所定の眉にするための眉メイクのガイドを提示するステップと
     を含む方法。
    obtaining an image of the eyebrows;
    a step of calculating the feature amount of the eyebrow;
    and presenting an eyebrow makeup guide for making the eyebrows into predetermined eyebrows based on the eyebrow feature amount.
  2.  前記眉の特徴量に基づいて、前記眉を分類するステップをさらに含み、
     前記眉を所定の眉にするための眉メイクのガイドは、前記眉の分類結果に基づいて決定される、請求項1に記載の方法。
    further comprising classifying the eyebrows based on the feature amount of the eyebrows;
    2. The method of claim 1, wherein an eyebrow makeup guide for shaping the eyebrows into a predetermined eyebrow is determined based on the eyebrow classification results.
  3.  前記眉メイクのガイドを提示するステップは、前記眉を前記所定の眉にするために使用すべき化粧品および用具、および、前記眉を前記所定の眉にするための眉の描画方法、描画領域、描画順序、前記化粧品および前記用具の使い方を提示することを含む請求項1または2に記載の方法。 The step of presenting the eyebrow makeup guide includes cosmetics and tools to be used to make the eyebrows into the predetermined eyebrows, an eyebrow drawing method for making the eyebrows into the predetermined eyebrows, a drawing area, 3. A method according to claim 1 or 2, comprising suggesting a drawing order, how to use said cosmetics and said utensils.
  4.  前記眉の特徴量は、前記眉の形状および前記眉の濃さを示す、請求項1から3のいずれか一項に記載の方法。 The method according to any one of claims 1 to 3, wherein the eyebrow feature amount indicates the shape and density of the eyebrow.
  5.  前記眉の特徴量は、前記眉の重心を示す位置と、前記眉の眉頭および前記眉の眉尻の特徴と、前記眉の濃さと、前記眉の太さと、前記眉の全体の角度と、のうちの少なくとも1つを含む請求項1から3のいずれか一項に記載の方法。 The feature amount of the eyebrow includes the position indicating the center of gravity of the eyebrow, the features of the beginning and end of the eyebrow, the density of the eyebrow, the thickness of the eyebrow, and the overall angle of the eyebrow, 4. The method of any one of claims 1-3, comprising at least one of
  6.  前記眉の重心を示す位置は、所定の密度以上に眉毛に覆われている領域の図心、または、最も眉毛に覆われている領域を二等分する線である、請求項5に記載の方法。 6. The position indicating the center of gravity of the eyebrow is the centroid of the area covered with eyebrows at a predetermined density or more, or the line that bisects the area covered most with eyebrows. Method.
  7.  前記眉の眉頭および前記眉の眉尻の特徴は、眉頭および眉尻の角度、あるいは、眉頭および眉尻の画素値の変化である、請求項5に記載の方法。 The method according to claim 5, wherein the features of the eyebrow head and eyebrow tail are angles of the eyebrow head and eyebrow tail, or changes in pixel values of the eyebrow head and eyebrow tail.
  8.  前記眉の濃さは、前記眉内の各領域の濃さを示す、請求項5に記載の方法。 The method according to claim 5, wherein the eyebrow density indicates the density of each region within the eyebrow.
  9.  前記眉の太さは、前記眉内の各領域の太さを示す、請求項5に記載の方法。 The method according to claim 5, wherein the eyebrow thickness indicates the thickness of each region within the eyebrow.
  10.  前記眉の特徴量は、顔における前記眉の位置である、請求項1から3のいずれか一項に記載の方法。 The method according to any one of claims 1 to 3, wherein the feature quantity of the eyebrows is the position of the eyebrows on the face.
  11.  前記眉の位置は、前記眉と目の距離と、左右の前記眉の位置と、のうちの少なくとも1つを含む、請求項10に記載の方法。 11. The method according to claim 10, wherein the eyebrow position includes at least one of the distance between the eyebrow and the eye and the left and right eyebrow positions.
  12.  前記所定の眉は、複数の眉から選択された眉である、請求項1から11のいずれか一項に記載の方法。 The method according to any one of claims 1 to 11, wherein said predetermined eyebrow is an eyebrow selected from a plurality of eyebrows.
  13.  眉が撮影された画像を取得する画像取得部と、
     前記眉の特徴量を算出する特徴量算出部と、
     前記眉の特徴量に基づいて、前記眉を所定の眉にするための眉メイクのガイドを提示する提示部と
     を備えた眉メイクガイド装置。
    an image acquisition unit that acquires an image of the eyebrows;
    a feature amount calculation unit that calculates the feature amount of the eyebrow;
    an eyebrow makeup guide device, comprising: a presentation unit that presents an eyebrow makeup guide for making the eyebrows into predetermined eyebrows based on the eyebrow feature amount.
  14.  コンピュータを
     眉が撮影された画像を取得する画像取得部、
     前記眉の特徴量を算出する特徴量算出部、
     前記眉の特徴量に基づいて、前記眉を所定の眉にするための眉メイクのガイドを提示する提示部
     として機能させるためのプログラム。
    an image acquisition unit for acquiring a photographed image of the eyebrows;
    a feature amount calculation unit that calculates the feature amount of the eyebrow;
    A program for functioning as a presentation unit that presents an eyebrow makeup guide for making the eyebrows into predetermined eyebrows based on the eyebrow feature amount.
  15.  眉メイクガイド装置とサーバとを含むシステムであって、
     眉が撮影された画像を取得する画像取得部と、
     前記眉の特徴量を算出する特徴量算出部と、
     前記眉の特徴量に基づいて、前記眉を所定の眉にするための眉メイクのガイドを提示する提示部と
     を備えたシステム。
    A system including an eyebrow makeup guide device and a server,
    an image acquisition unit that acquires an image of the eyebrows;
    a feature amount calculation unit that calculates the feature amount of the eyebrow;
    and a presenting unit that presents an eyebrow makeup guide for making the eyebrows into predetermined eyebrows based on the feature amount of the eyebrows.
PCT/JP2022/030897 2021-08-27 2022-08-15 Eyebrow makeup guide method, device, program, and system WO2023026891A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2023543820A JPWO2023026891A1 (en) 2021-08-27 2022-08-15

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2021139419 2021-08-27
JP2021-139419 2021-08-27

Publications (1)

Publication Number Publication Date
WO2023026891A1 true WO2023026891A1 (en) 2023-03-02

Family

ID=85321939

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2022/030897 WO2023026891A1 (en) 2021-08-27 2022-08-15 Eyebrow makeup guide method, device, program, and system

Country Status (2)

Country Link
JP (1) JPWO2023026891A1 (en)
WO (1) WO2023026891A1 (en)

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2007293649A (en) * 2006-04-26 2007-11-08 Megachips Lsi Solutions Inc Makeup assist device and eyebrow drawing assist device
JP2018192230A (en) * 2017-05-16 2018-12-06 麗寶大數據股▲フン▼有限公司 Eyebrow shape guide device and method therefor

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2007293649A (en) * 2006-04-26 2007-11-08 Megachips Lsi Solutions Inc Makeup assist device and eyebrow drawing assist device
JP2018192230A (en) * 2017-05-16 2018-12-06 麗寶大數據股▲フン▼有限公司 Eyebrow shape guide device and method therefor

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
FUTURE CO., LTD.: "Orbis News Release: Providing machine learning and image recognition technology to ORBIS app content "AI eyebrow simulator" - AI analyzes and proposes the ideal eyebrow shape that best suits men and women -", PR TIMES, ORBIS INC., JP, JP, XP009543828, Retrieved from the Internet <URL:https://prtimes.jp/main/html/rd/p/000000419.000004374.html> *

Also Published As

Publication number Publication date
JPWO2023026891A1 (en) 2023-03-02

Similar Documents

Publication Publication Date Title
CN110390632B (en) Image processing method and device based on dressing template, storage medium and terminal
US8064648B2 (en) Eye form classifying method, form classification map, and eye cosmetic treatment method
CN101779218B (en) Makeup simulation system, makeup simulation apparatus, makeup simulation method, and makeup simulation program
KR101259662B1 (en) Face classifying method face classifying device classification map face classifying program recording medium where this program is recorded
US20100189357A1 (en) Method and device for the virtual simulation of a sequence of video images
US11562536B2 (en) Methods and systems for personalized 3D head model deformation
JP2004094917A (en) Virtual makeup device and method therefor
US11587288B2 (en) Methods and systems for constructing facial position map
TW200946167A (en) Makeup method, makeup simulation device, and makeup simulation program
US20220292774A1 (en) Methods and systems for extracting color from facial image
CN110866139A (en) Cosmetic treatment method, device and equipment
WO2023273247A1 (en) Face image processing method and device, computer readable storage medium, terminal
JP2000151985A (en) Picture processing method and recording medium
US20190254408A1 (en) Information processing apparatus and information processing method, and program
CN117157673A (en) Method and system for forming personalized 3D head and face models
CN108833772A (en) Taking pictures based on depth camera guides system and method
TWI471807B (en) Face classification method, face classification device, classification chart, face classification program and recorded the program of the recording media
WO2023026891A1 (en) Eyebrow makeup guide method, device, program, and system
JP4893968B2 (en) How to compose face images
WO2023210341A1 (en) Method, device, and program for face classification
CN113724366B (en) 3D model generation method, device and equipment
WO2022173055A1 (en) Skeleton estimating method, device, program, system, trained model generating method, and trained model
CN110349202B (en) Hairstyle design method based on face analysis
CN115393924A (en) Method, device, equipment and medium for selecting products based on facial texture information
JP2022064030A (en) Three-dimensional image processor, three-dimensional image processing method and three-dimensional image processing program

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 22861180

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 2023543820

Country of ref document: JP

NENP Non-entry into the national phase

Ref country code: DE