EP2976963A1 - Makeup support device, makeup support method, and makeup support program - Google Patents
Makeup support device, makeup support method, and makeup support program Download PDFInfo
- Publication number
- EP2976963A1 EP2976963A1 EP14767708.2A EP14767708A EP2976963A1 EP 2976963 A1 EP2976963 A1 EP 2976963A1 EP 14767708 A EP14767708 A EP 14767708A EP 2976963 A1 EP2976963 A1 EP 2976963A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- makeup
- sheet
- skin
- face
- section
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- A—HUMAN NECESSITIES
- A45—HAND OR TRAVELLING ARTICLES
- A45D—HAIRDRESSING OR SHAVING EQUIPMENT; EQUIPMENT FOR COSMETICS OR COSMETIC TREATMENTS, e.g. FOR MANICURING OR PEDICURING
- A45D44/00—Other cosmetic or toiletry articles, e.g. for hairdressers' rooms
- A45D44/005—Other cosmetic or toiletry articles, e.g. for hairdressers' rooms for selecting or displaying personal cosmetic colours or hairstyle
-
- A—HUMAN NECESSITIES
- A45—HAND OR TRAVELLING ARTICLES
- A45D—HAIRDRESSING OR SHAVING EQUIPMENT; EQUIPMENT FOR COSMETICS OR COSMETIC TREATMENTS, e.g. FOR MANICURING OR PEDICURING
- A45D40/00—Casings or accessories specially adapted for storing or handling solid or pasty toiletry or cosmetic substances, e.g. shaving soaps or lipsticks
- A45D40/30—Masks for marking lips or eyelashes
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V10/00—Arrangements for image or video recognition or understanding
- G06V10/40—Extraction of image or video features
- G06V10/42—Global feature extraction by analysis of the whole pattern, e.g. using frequency domain transformations or autocorrelation
- G06V10/422—Global feature extraction by analysis of the whole pattern, e.g. using frequency domain transformations or autocorrelation for representing the structure of the pattern or shape of an object therefor
- G06V10/426—Graphical representations
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
- G06V40/16—Human faces, e.g. facial parts, sketches or expressions
- G06V40/168—Feature extraction; Face representation
- G06V40/171—Local features and components; Facial parts ; Occluding parts, e.g. glasses; Geometrical relationships
-
- A—HUMAN NECESSITIES
- A45—HAND OR TRAVELLING ARTICLES
- A45D—HAIRDRESSING OR SHAVING EQUIPMENT; EQUIPMENT FOR COSMETICS OR COSMETIC TREATMENTS, e.g. FOR MANICURING OR PEDICURING
- A45D44/00—Other cosmetic or toiletry articles, e.g. for hairdressers' rooms
- A45D2044/007—Devices for determining the condition of hair or skin or for selecting the appropriate cosmetic or hair treatment
Definitions
- the present invention relates to a makeup assisting apparatus, a makeup assisting method and a makeup assisting program for assisting facial makeup (cosmetic makeup).
- makeup the way of applying makeup to the face (hereinafter, simply referred to as "makeup") has been diversified. Therefore, it has become difficult, particularly for a person who has no sufficient knowledge about makeup to select appropriate makeup from an infinite number of options because it takes an enormous amount of time and effort to actually try, judge and compare various types of makeup.
- PTL 1 and PTL 2 disclose techniques in which makeup that matches the feature of the face is selected, and a simulation image of the face on which the selected makeup is applied is created and presented, for example.
- a captured image of a face hereinafter, simply referred to as "face”
- face a captured image of a face that is subjected to makeup
- the feature of the face is extracted
- makeup that matches the feature of the face is selected based on a selection criteria set in advance.
- an image indicating a state of makeup obtained by applying the selected makeup to the face is superimposed to create and display a simulation image.
- basic cosmetic materials corresponding to skin care selected for each face are printed on a cosmetic delivery sheet whose base material is a felt, paper or water-soluble material or the like.
- the user attaches such a cosmetic delivery sheet to the skin of the face with the printed surface being oriented toward the face, and can thereby hold the basic cosmetic materials applied to the face.
- general cosmetic materials corresponding to the selected makeup may be printed.
- An object of the present invention is to provide a makeup assisting apparatus, a makeup assisting method, and a makeup assisting program capable of appropriately assisting users who do not have enough makeup skill to perform makeup.
- a makeup assisting apparatus includes: a makeup selecting section that selects makeup for each face, the makeup being a way of applying makeup, the face being subjected to the makeup; and a makeup presenting section that causes pigment corresponding to the selected makeup to be held on a surface on a side of a sheet closely attachable to a skin of the face for a long time, the side being opposite to a side of the sheet where the sheet is to be closely attached to the skin.
- a makeup assisting method includes: selecting makeup for each face, the makeup being a way of applying makeup, the face being subjected to the makeup; and causing pigment corresponding to the selected makeup to be held on a surface on a side of a sheet closely attachable to a skin of the face for a long time, the side being opposite to a side of the sheet where the sheet is to be closely attached to the skin.
- a makeup assisting program is a program that causes a computer to execute processing including: selecting makeup for each face, the makeup being a way of applying makeup, the face being subjected to the makeup; and causing pigment corresponding to the selected makeup to be held on a surface on a side of a sheet closely attachable to a skin of the face for a long time, the side being opposite to a side of the sheet where the sheet is to be closely attachable to the skin.
- Embodiment 1 of the present invention is an example of a basic mode of the present invention.
- FIG. 1 is a block diagram illustrating an exemplary configuration of a makeup assisting apparatus according to the present embodiment.
- makeup assisting apparatus 100 is provided with makeup selecting section 250 and makeup presenting section 260.
- Makeup selecting section 250 selects makeup which is the way of applying makeup for each face (hereinafter simply referred to as "face") that is subjected to makeup.
- Makeup presenting section 260 causes pigment corresponding to the selected makeup to be held on the surface on a side of a sheet closely attachable to the skin of the face for a long time, the side being opposite to the side closely attached to the skin.
- Makeup assisting apparatus 100 has, for example, a central processing unit (CPU), a storage medium such as a read-only memory (ROM) having a control program stored therein, and a working memory such as a random access memory (RAM), although these components are not illustrated.
- CPU central processing unit
- ROM read-only memory
- RAM random access memory
- Such makeup assisting apparatus 100 can cause pigment corresponding to the makeup selected for each face to be held on the surface of a side of the sheet closely attachable to the skin of the face for a long time, the side being opposite to the side closely attachable to the skin. This allows the user to attach the sheet to which the selected makeup is applied to the skin of the face, leave the sheet attached, and thereby easily reproduce such makeup. Therefore, makeup assisting apparatus 100 can appropriately assist a user who does not have enough makeup skill to perform makeup.
- Embodiment 2 of the present invention is an example of a specific mode of the present invention.
- Embodiment 2 is an exemplary case where the present invention is applied in an apparatus having a display provided with a touch panel and a digital camera.
- a “facial part” refers to a part characterizing impression of the face, such as eyes, eyebrows, nose, cheekbones, lips and an outline.
- facial part ID refers to identification information of the facial part.
- a “region of the facial part” refers to a region occupied by the facial part on an image or in real space, and includes a position of a feature point of the facial part, such as corners of the eyes.
- a “facial feature value” refers to a value of a predetermined parameter which indicates features of the face.
- the facial feature value is multivariate data including a plurality of values such as a ratio of a length of the face with respect to a width of the face, a ratio of a length of the nose with respect to a distance between both eyes and a ratio of a width of the eye with respect to the width of the face.
- Makeup refers to the way (type) of applying makeup such as eye shadows and lipsticks that corrects impression of features of the facial part to improve aesthetics, and includes at least a color, application concentration and application range of pigment.
- Makeup information refers to information representing makeup contents.
- Makeup type refers to the type of makeup such as “foundation,” “eye shadow,” “lipstick,” and “blush” that are identified by at least the positional relationship with facial parts.
- Makeup ID refers to identification information of makeup.
- FIG 2 is a block diagram illustrating an exemplary configuration of the makeup assisting apparatus according to the present embodiment.
- makeup assisting apparatus 100 includes image capturing section 210, image acquiring section 220, facial part acquiring section 230, makeup table storing section 240, makeup selecting section 250, makeup presenting section 260, display section 270 and printing section 280.
- Image capturing section 210 is, for example, a digital video camera, and captures a moving image of the face. Capturing section 210 outputs the captured moving image to image acquiring section 220.
- the moving image includes a plurality of time-series images (frame images). Note that in the present embodiment, the face subjected to makeup is the face of the user of makeup assisting apparatus 100.
- Image acquiring section 220 sequentially acquires images making up the moving image from the inputted moving image. Image acquiring section 220 outputs the acquired image to facial part acquiring section 230 and makeup presenting section 260.
- Facial part acquiring section 230 acquires a region of the facial part from the inputted image.
- the region of the facial part is acquired, for example, through matching between each partial region of the image and a template image of each facial part prepared in advance (for example, see PTL 4).
- Facial part acquiring section 230 outputs identification information of the acquired facial part and information indicating the region (hereinafter, referred to as "facial part information") to makeup selecting section 250.
- Makeup table storing section 240 stores a makeup table.
- the makeup table is a table describing, in association with a facial feature value acquired, makeup appropriate for the face having the facial feature value.
- principal component analysis is performed in advance on samples of the facial feature value of an unspecified number of faces to which makeup experts have applied makeup in the past. It is assumed that the results of the principal component analysis are grouped in advance using a publicly known principal component grouping method in which it is determined based on a determination criterion such as whether or not a principal component value is 1 ⁇ or higher. Further, it is assumed that in the makeup table, makeup which has been frequently applied in the past to the face belonging to the group is registered for each facial feature value group.
- FIG. 3 is a diagram illustrating an exemplary makeup table.
- makeup table 410 describes a plurality of makeup IDs 412 for each facial feature value group 411.
- two makeup IDs 412 of "FM1 and FM2" are associated with facial feature value group 411 of "FG1.” This indicates that when the facial feature value of the user's face is FG1, the makeup indicated by the makeup ID of "FM1” and the makeup indicated by the makeup ID of "FM2" are appropriate.
- makeup table 410 from a server on the Internet via, for example, a communication circuit (not shown) provided at makeup assisting apparatus 100.
- Makeup table storing section 240 in FIG. 2 stores a makeup information table.
- the makeup information table is a table describing makeup information of the makeup indicated by makeup ID 412 described in makeup table 410 (see FIG. 3 ).
- FIG. 4 is a diagram illustrating an exemplary makeup information table stored in makeup table storing section 240.
- makeup information table 420 describes makeup ID 421, makeup type 422, color 423, concentration 424 and range 425 in association with one another.
- Makeup ID 421 is associated with makeup ID 412 (see FIG. 3 ) of makeup table 410.
- Makeup type 422 which is illustrated in a simplified form, more specifically includes "foundation,” "eye shadow,” “lipstick” and “blush” or the like.
- Color 423 which is illustrated in a simplified form, more specifically includes an RGB value and a gloss value or the like.
- Concentration 424 which is illustrated in a simplified form, more specifically includes a level of transparency when an image is superimposed on the image of the face and the way of applying gradation or the like.
- Range 425 which is illustrated in a simplified form, more specifically includes a set of a relative coordinate group from a feature point, a relative position of a central point with respect to the feature point and a radius, or the like.
- a set of color 423, concentration 424 and range 425 includes at least information necessary for imaging. That is, in the present embodiment, suppose the makeup information includes at least information necessary to generate an image when makeup is applied to the face (information indicating the difference in face color).
- makeup table 410 shown in FIG. 3 and makeup information table 420 shown in FIG. 4 may be integrated into one table.
- Makeup selecting section 250 in FIG. 2 acquires a facial feature value.
- makeup selecting section 250 may acquire a facial feature value from facial part information inputted from facial part acquiring section 230 or acquire a facial feature value from an image by analyzing the image acquired by image acquiring section 220.
- Makeup selecting section 250 selects a makeup candidate which is a candidate for makeup subjected to printing which will be described later for each facial part with reference to makeup table 410 (see FIG. 3 ) based on the acquired facial feature value.
- Makeup selecting section 250 acquires makeup information of the selected makeup candidate from makeup information table 420 (see FIG. 4 ) and outputs the makeup information to makeup presenting section 260.
- makeup table 410 registers makeup ID 412 for each facial feature value group. Therefore, makeup selecting section 250 determines to which of facial feature value groups 411 registered in makeup table 410 the facial feature value acquired from the face belongs and selects makeup ID 412 associated with determined facial feature value group 411. This determination is made, for example, by calculating a distance between the acquired facial feature value and a representative value (centroid) of each group.
- Makeup selecting section 250 receives from the user, an operation of switching between makeup candidates (hereinafter referred to as "display makeup") to be a display target of a simulation image, which will be described later, and an operation of selecting display makeup. These operations are performed via, for example, a touch panel provided in display section 270, which will be described later. Makeup selecting section 250 selects the selected display makeup as the application makeup which is makeup subjected to printing, which will be described later. Makeup selecting section 250 acquires makeup information of the selected application makeup from makeup information table 420 (see FIG. 4 ) and outputs the makeup information to makeup presenting section 260.
- Makeup presenting section 260 causes display section 270, which will be described later, to display a simulation image of the makeup candidate. More specifically, makeup presenting section 260 superimposes an image illustrating a condition of the makeup candidate when the makeup candidate is applied to the face on the image inputted from image acquiring section 220 and generates a simulation image. The superimposing position of the image of the makeup candidate is calculated from, for example, facial part information and a range of makeup included in the makeup information. Makeup presenting section 260 then outputs the image data of the generated simulation image to display section 270.
- the image in the simulation image is superimposed by, for example, a publicly-known image combining process such as an alpha ( ⁇ ) blending process.
- an alpha value ( ⁇ ) is set according to concentration of makeup.
- r 1 , g 1 and b 1 are RGB values of an arbitrary region in the captured image
- r 2 , g 2 and b 2 are RGB values of the makeup
- R, G and B are RGB values of the corresponding region in the simulation image.
- an order of application when makeup is applied to the face in an overlapped manner (hereinafter, referred to as an "application order") is set for each makeup, and an image in a case where the makeup is applied is presented as an image shaded with density according to the concentration.
- the application order defines, for example, blush should be applied after foundation is applied.
- the images may be superimposed on the captured image by makeup presenting section 260 overpainting the image of each makeup in an order according to the application order.
- Makeup presenting section 260 causes pigment corresponding to the selected application makeup to be held on the surface on a side of a predetermined sheet closely attachable to the skin of the face for a long time (hereinafter referred to as "skin-attachment sheet"), the side being opposite to the side closely attached to the skin.
- skin-attachment sheet a predetermined sheet closely attachable to the skin of the face for a long time
- makeup presenting section 260 generates image data of an image illustrating the state of the application makeup when a makeup candidate is applied to the face and outputs the generated image data to printing section 280 which will be described later.
- makeup presenting section 260 causes printing section 280 to print the image corresponding to the application makeup on the surface of the skin-attachment sheet.
- makeup presenting section 260 causes printing section 280. to print the image corresponding to the application makeup on the surface of the skin-attachment sheet with an arrangement corresponding to the arrangement of the plurality of acquired regions for a plurality of facial parts.
- makeup presenting section 260 calculates the shape of the skin-attachment sheet that can be three-dimensionally attached to the face, from the outline of the face, regions of both eyes, region of the nose or the like.
- makeup presenting section 260 also outputs the calculated shape of the skin-attachment sheet and information indicating a positional relationship between the shape and the image corresponding to the application makeup (hereinafter referred to as "sheet shape information") to printing section 280.
- sheet shape information includes at least information indicating the outline of the face, regions of both eyelids when both eyes are closed and region of the nose and information indicating a positional relationship between these regions and the application makeup.
- the regions of both eyelids when both eyes are closed are preferably regions of the eyeholes, and are regions connecting the inner corners of the eyes, lower eyelid, outer corners of the eyes and under eyebrow, for example.
- Display section 270 is, for example, a display part of a display with a touch panel. Display section 270 displays a simulation image based on image data of the inputted simulation image.
- Printing section 280 performs multi-color printing on the surface of the skin-attachment sheet. More specifically, printing section 280 receives the supply of the skin-attachment sheet and the image data of the application makeup, and prints an image corresponding to the application makeup indicated by the image data on the surface on the side of the skin-attachment sheet opposite to the side closely attached to the skin (hereinafter referred to as "outside face"). Printing section 280 cuts the skin-attachment sheet on which the image corresponding to the application makeup is printed based on the inputted sheet shape information.
- the skin-attachment sheet is a biocompatible sheet attached to the skin of the face without any uncomfortable feeling. More specifically, the skin-attachment sheet is a thin film having a thickness of 10 nm to 500 nm containing a layer made of polylactic acid, polyglycolic acid, polycaprolactone, or a copolymer thereof, and a biocompatible polymer such as hyaluronic acid, and chitosan, for example. Since the thin-film available as a skin-attachment sheet is described, for example, in PTL 5, detailed description thereof will be omitted here.
- the skin-attachment sheet has a structure in which a mount is attached to the surface closely attached to the skin (hereinafter referred to as "inside face") and a sheet protection film is attached to the outside face.
- the skin-attachment sheet is supplied to printing section 280 with the sheet protection film peeled off by the user.
- FIG. 5 is a perspective view illustrating an exemplary schematic configuration of printing section 280.
- printing section 280 is constructed of printing head section 282, roll feeding section 283, laser cutter section 284, and sheet hook sections 285, which are arranged in that order on base part 281 on which skin-attachment sheet 300 is placed.
- Printing head section 282 prints an image corresponding to the application makeup based on image data
- Roll feeding section 283 sends skin-attachment sheet 300 whose printing is completed to the laser cutter section 284 side.
- Sheet hook sections 285 regulate the movement of skin-attachment sheet 300 sent to the laser cutter section 284 side.
- Laser cutter section 284 cuts skin-attachment sheet 300 using a laser cutter based on sheet shape information.
- any publicly known technique can be adopted if it is appropriate to image printing of the skin-attachment sheet on the outside face (e.g., see PTL 6 and PTL 7). Note that since printing is performed on the outside face of skin-attachment sheet 300, the ink does not come into close contact with the skin. Therefore, the ink does not require high biocompatibility, and can be selected at a high degree of freedom.
- makeup assisting apparatus 100 in FIG 2 has, for example, a central processing unit (CPU), a storage medium such as a read-only memory (ROM) having a control program stored therein, and a working memory such as a random access memory (RAM), although these components are not illustrated.
- CPU central processing unit
- ROM read-only memory
- RAM random access memory
- Such makeup assisting apparatus 100 can cause pigment corresponding to makeup selected for each face to be held on the surface of the side of the sheet closely attachable to the skin of the face for a long time, the side being opposite to the side closely attached to the skin.
- the user attaches the sheet to which the selected makeup is applied to the skin of the face, leaves the sheet attached, and can thereby easily reproduce makeup.
- FIG. 6 is a flowchart illustrating an exemplary operation of makeup assisting apparatus 100.
- step S1100 image capturing section 210 starts capturing a moving image of the user's face and image acquiring section 220 starts acquiring images that make up the captured moving image.
- Facial part acquiring section 230 starts acquiring facial parts of the face included in the image.
- facial part acquiring section 230 extracts feature points of the face (facial parts) from the image by analyzing the image, for example. Facial part acquiring section 230 acquires a region formed of feature points that make up an identical facial part as a region of the facial part. Facial part acquiring section 230 generates facial part information from the region of the acquired facial part.
- FIG. 7 is a diagram illustrating an exemplary image acquired in step S1100 in FIG. 6 .
- image 510 includes an image of the face of the user (hereinafter, referred to as a "face image") 511.
- face image an image of the face of the user
- the user wears no makeup.
- FIG. 8 is a diagram illustrating an exemplary arrangement of feature points of the face extracted in step S1100 of FIG 6 .
- a plurality of feature points are extracted from face image 511.
- first to fourth feature points 521 to 524 make up the right eye. Therefore, facial part acquiring section 230 acquires region 525 surrounded by first to fourth feature points 521 to 524 as the region of the right eye.
- FIG. 9 is a diagram illustrating exemplary facial part information generated in step S1100 of FIG 6 .
- facial part information 530 describes region 532 and person ID 533 for each facial part ID 531.
- Facial part ID 531 is identification information of the facial part such as the left eye and the upper lip.
- Region 532 which is information indicating a range of the region of the facial part in the image, is a list of coordinate values of a coordinate system set on the image, for example.
- Person ID 533 is identification information of the person. As person ID 533, for example, a value designated by the user through operation to a display with touch panel or the like is set every time capturing is started.
- makeup selecting section 250 acquires the facial feature value.
- the facial feature value is, as described above, multivariate data regarding a predetermined parameter indicating the features of the face.
- Makeup selecting section 250 acquires the facial feature value from one of image 510 (see FIG. 7 ), a group of facial feature points of the face (see FIG. 8 ) and facial part information 530 (see FIG. 9 ), for example.
- Makeup selecting section 250 selects a makeup candidate based on the acquired facial feature value. Here, suppose a plurality of makeup candidates are selected.
- step S1300 makeup selecting section 250 determines one display makeup from among a plurality of makeup candidates. Makeup selecting section 250 outputs makeup information corresponding to the determined display makeup to makeup presenting section 260.
- step S1400 makeup presenting section 260 generates a simulation image based on makeup information relating to the determined display makeup and causes display section 270 to display the simulation image.
- FIG. 10 is a diagram illustrating an exemplary simulation image generated in step S1400 of FIG. 6 .
- simulation image 540 is an image in which makeup images 541 to 545 such as eyebrow, eye shadow, eyeliner, blush, and lipstick are superimposed on face image 511.
- simulation image 540 is also an image in which a foundation color is superimposed on face image 511.
- step S1500 makeup selecting section 250 determines whether or not an operation of selecting the current display makeup as the application makeup is performed. When such an operation is not performed (S1500: NO), makeup selecting section 250 moves the process to step S1600.
- step S1600 makeup selecting section 250 determines whether or not an operation of switching the display makeup to another makeup candidate is performed. When such an operation is not performed (S1600: NO), makeup selecting section 250 moves the process to step S1800, which will be described later. When such an operation is performed (S1600: YES), makeup selecting section 250 moves the process to step S1700.
- step S1700 makeup selecting section 250 changes the display makeup to another makeup candidate, outputs the corresponding makeup information to makeup presenting section 260 and proceeds to step S1800.
- step S1800 image acquiring section 220 determines whether or not input of a moving image is continued.
- image acquiring section 220 returns the process to step S1400 and moves the process to the next image.
- image acquiring section 220 ends a series of processes.
- makeup selecting section 250 moves the process to step S1900.
- step S1900 makeup presenting section 260 uses printing section 280 to print the application makeup on an outside face of the skin-attachment sheet and then cut the skin-attachment sheet, and ends a series of processes.
- FIG. 11 is a diagram illustrating an exemplary skin-attachment sheet (hereinafter referred to as "printed skin-attachment sheet”) generated in step S1900 of FIG. 6 .
- printed skin-attachment sheet hereinafter referred to as "printed skin-attachment sheet"
- printed skin-attachment sheet 550 is made up of overall face sheet 551, right eyelid part sheet 552, left eyelid part sheet 553 and nose part sheet 554.
- Right eyelid part sheet 552 and left eyelid part sheet 553 are associated with the left eyelid part when the left eyelid is closed and the right eyelid part when the right eyelid is closed.
- Overall face sheet 551 includes a plurality of notches on the edge, holes in parts corresponding to both eyes (both eyelids when both eyelids are closed) and a part corresponding to the nose, and a notch in a part corresponding to the mouth.
- Skin-attachment sheet 550 has moderate elasticity.
- skin-attachment sheet 550 can be well attached to the skin of the face which has a three-dimensional shape because skin-attachment sheet 550 has such a shape and elasticity.
- right eyelid part sheet 552 and left eyelid part sheet 553 may not necessarily be separated from overall face sheet 551. In this case, it is preferable to correspond to the state in which the eyelids are closed and provide notches in parts corresponding to the eyes.
- Images 561 to 565 are printed on overall face sheet 551, right eyelid part sheet 552, and left eyelid part sheet 553 in correspondence to makeup images 541 to 545 of simulation image 540.
- colors corresponding to the foundation colors displayed in simulation image 540 are printed on all sheets 551 to 554.
- the user first peels off only the edge of such printed skin-attachment sheet 550 from the mount and attaches the peeled part to the corresponding parts of the skin of the face. While holding the part attached to the skin, the user pulls the mount in parallel with the skin and in a direction toward the part where attachment has not been completed. This allows the user to well attach to the skin, skin-attachment sheet 550 on which makeup images 541 to 545 are printed By leaving skin-attachment sheet 550 attached, it is possible to easily reproduce the selected makeup.
- notches are preferably formed along the eyelid lines and the mouth line. Openings are preferably provided in the regions corresponding to the nose holes.
- makeup assisting apparatus 100 can present to the user, makeup suitable for the user sequentially, following the moving image of the face and in association with the corresponding regions. Therefore, the user can check the makeup effects while changing the orientation of the face and facial expressions, and can experience as if the user were looking at the user's face actually subjected to makeup and reflected on a mirror.
- Makeup assisting apparatus 100 can receive an operation of switching of display makeup from the user at arbitrary timing. This allows the user to appropriately and speedily determine makeup that matches the user's preference from among a plurality of makeup candidates and select it as a target for printing on the outside face of the skin-attachment sheet.
- Skin-attachment sheets with a mount are produced by a manufacturing machine in a factory or the like and distributed and sold to users.
- FIG. 12 is a perspective view illustrating an exemplary schematic configuration of a manufacturing machine of a skin-attachment sheet with a mount.
- roll feeding section 612, first-layer application head section 613, first-layer drying head section 614, second-layer application head section 615, second-layer drying head section 616, and mount pressing roll section 617 are arranged in that order on base part 611 on which sheet protection paper 610 is placed.
- Sheet protection paper 610 is made of, for example, a silicone raw material which can be easily peeled off from a hardened first layer, which will be described later.
- Roll feeding section 612 causes sheet protection paper 610 to pass through first-layer application head section 613 to mount pressing roll section 617 in that order.
- First-layer application head section 613 uniformly applies a liquid-phase substance made of biocompatible polymer such as polylactic acid to the top surface of sheet protection paper 610 as a first layer.
- First-layer drying head section 614 includes, for example, an iron-chromium wire heater, and places the first-layer applied to the top surface of sheet protection paper 610 in an environment of approximately 70 to 110°C for approximately 90 seconds to dry the first-layer and cause the first layer to harden to moderate hardness.
- Second-layer application head section 615 uniformly applies, on the hardened first layer, a liquid-phase substance having a function as a basic cosmetic material containing a moisturizing component such as hyaluronic acid and a function of causing the raw material of a dried second layer, which will be described later, to come into close contact with the skin as a second layer.
- a liquid-phase substance having a function as a basic cosmetic material containing a moisturizing component such as hyaluronic acid and a function of causing the raw material of a dried second layer, which will be described later, to come into close contact with the skin as a second layer.
- Second-layer drying head section 616 includes, for example, an iron-chromium wire heater, places the second layer applied on the top surface of the first layer in an environment of approximately 100 to 110°C for approximately 90 seconds to dry the second layer and cause the second layer to harden to moderate hardness.
- the hardened second layer which is left closely attached to the skin, implements skin care using the basic cosmetic material.
- the total thickness of the hardened first layer and second layer is preferably approximately 10 nm to 500 nm.
- Mount pressing roll section 617 supplies mount 620 to the top surface of the hardened second layer and crimps mount 620 onto the top surface of the second layer.
- Mount 620 is made of, for example, a silicone raw material which can be easily peeled off from the hardened second layer.
- a skin-attachment sheet with a mount is generated in which sheet protection paper 610, the skin-attachment sheet made up of the first layer and the second layer, and mount 620 are attached to one another in that order.
- a cutter for cutting the skin-attachment sheet with a mount to a predetermined length may be provided after manufacturing machine 600.
- the skin-attachment sheet with a mount generated in this way is stripped of sheet protection paper 610, for example, by the user's hand, supplied to base part 281 of printing section 280 (see FIG. 5 ) and subjected to printing of the selected makeup and cutting according to the face.
- makeup assisting apparatus 100 causes pigment corresponding to makeup selected for each face to be held on the outside face of the skin-attachment sheet. This allows the user to attach the sheet on which the selected makeup is applied to the skin of the face, leave the sheet attached, and thereby easily reproduce such makeup. Therefore, makeup assisting apparatus 100 can appropriately assist a user who does not have enough makeup skill to perform makeup.
- Makeup assisting apparatus 100 causes pigment to be held on the skin-attachment sheet through inkjet multi-color printing. This allows makeup assisting apparatus 100 to reproduce a fine pattern, complicated color, and delicate tone of the makeup selected by makeup selecting section 250 with high accuracy.
- Makeup assisting apparatus 100 prints an image corresponding to the makeup on the outside face of the skin-attachment sheet. Since makeup assisting apparatus 100 does not always require high biocompatibility for the ink used for printing in this way, it is possible to improve the degree of freedom of apparatus design and the degree of freedom of makeup selection. Furthermore, makeup assisting apparatus 100 can reduce the possibility of smeared makeup caused by sweat and sebum, and implement makeup which remains stable for a long time.
- Makeup assisting apparatus 100 uses a skin-attachment sheet in which a basic cosmetic material is applied to the inside face. This allows makeup assisting apparatus 100 to reduce the possibility of smeared makeup of the basic cosmetic material caused by sweat and sebum, and maintain the initial distribution state for a long time. Maintaining such a distribution state is suitable for a basic cosmetic material that prevents ultraviolet rays from reaching the skin, having a so-called UV (ultraviolet ray) cutting function.
- UV ultraviolet ray
- Makeup assisting apparatus 100 prints makeup corresponding to a plurality of facial parts on one skin-attachment sheet (or one set of skin-attachment sheets made up of a plurality of sheets). This prevents the makeup from becoming imperfect such as partially missing makeup.
- makeup candidate selection technique is not limited to the above-described example.
- makeup selecting section 250 may select fashionable makeup preferentially irrespective of a facial feature value or select a makeup candidate based on a facial feature value and other information.
- Makeup is selected based on, for example, a skin condition.
- the skin condition is, for example, smear, wrinkle, sebum secretion, hidden smear, water content, blood flow and perspiration or the like of the skin of the face, and acquired, for example, through analysis of an image captured using daily light, ultraviolet rays, infrared light or laser light.
- makeup selecting section 250 selects makeup that applies a concealer to the smeared part and dark circles under the eyes, for example.
- Makeup may also be selected based on a predicted change in the skin condition.
- a change in the skin condition is predicted from the above-described skin condition, environment information, and physical condition information.
- the environment information includes weather, air temperature, season and an amount of solar radiation, for example.
- the physical condition information includes a sleeping time, body temperature, amount of physical activities, eyelid opening, eye blink frequency, time in menstruation cycle and blood pressure, for example.
- makeup selecting section 250 selects makeup that applies a concealer under the eyes assuming that dark circles under the eyes may become darker after a lapse of a certain time.
- Makeup may also be selected based on the user's attribute information such as age or residential region.
- Various kinds of information used to select makeup may be inputted through the user's operation or may be acquired through communication by makeup assisting apparatus 100 from a server on the Internet, or various electric appliances or sensor devices or the like used by the user.
- makeup selecting section 250 may perform color correction of makeup.
- the impression of a color of the face varies depending on colors of surroundings or a scene.
- the face color of a person wearing red-based clothes looks like a color slightly more similar to a turquoise color than the original color.
- the same makeup may be perceived as a fancy tone or quiet tone depending on the scene.
- makeup selecting section 250 acquires a color of clothes, a color of the skin and a color of the hair or the like of the user from the image, selects makeup of an appropriate tone as a makeup candidate based on the acquired color or corrects the selected tone of the makeup candidate to an appropriate tone.
- makeup assisting apparatus 100 can select more appropriate makeup and present it to the user. The user can apply makeup of appropriate tone without judging whether the tone is good or bad by oneself. Such a selection of makeup exhibits a high effect in selecting a foundation color in particular.
- Makeup assisting apparatus 100 may also be configured to select skin care implemented using the skin-attachment sheet for each face.
- the skin-attachment sheet does not always require the above-described first layer and the skin-attachment sheet is supplied to printing section 280, with the inside face thereof attached to a mesh-like mount.
- Makeup selecting section 250 further selects skin care for each face in addition to makeup.
- Printing section 280 further has a function of blowing a basic cosmetic material over the surface of the skin-attachment sheet with a mount on the mount side (that is, inside face of the skin-attachment sheet).
- Makeup presenting section 260 causes printing section 280 to blow the basic cosmetic material corresponding to the selected skin care over the mount.
- the mount is a mesh-like one, the blown basic cosmetic material passes through the mount, reaching the inside face of the skin-attachment sheet.
- the mount is peeled off in this condition, the basic cosmetic material corresponding to the selected skin care is held on the inside face of the skin-attachment sheet.
- Skin care is selected based on the skin condition, for example.
- makeup selecting section 250 selects skin care that applies a basic cosmetic material having a high light scattering effect to smeared parts and selects skin care that applies a basic cosmetic material having a high skin-whitening effect to hidden smeared parts, for example.
- Makeup selecting section 250 selects skin care that applies a basic cosmetic material having high astringent action and sebum adsorption action to parts estimated to have a high degree of aging based on the ellipticity of skin pores.
- Skin care is also selected based on, for example, a change in a predicted skin condition.
- makeup selecting section 250 selects skin care that applies a moisture-retaining beauty lotion by assuming that the drying of the skin will advance.
- Various kinds of information used to select skin care may be inputted through the user's operation or may be acquired through communication by makeup assisting apparatus 100 from a server on the Internet, various electric appliances or sensor devices or the like used by the user.
- printing section 280 need not have any cutting function and makeup presenting section 260 need not output sheet shape information.
- makeup presenting section 260 needs to output information indicating a positional relationship between the shape of the skin-attachment sheet and makeup to printing section 280.
- the skin-attachment sheet may be generated by being separated for each facial part such as eye shadows placed on the eyelids, blushes placed on the cheeks and lipstick placed on the lip.
- the skin-attachment sheet preferably has a raw material and a thickness that allow the skin color to sufficiently pass therethrough in consideration of a case where foundation is not selected.
- makeup presenting section 260 may sequentially generate a guide image for each image that makes up a moving image and display the guide images on display section 270.
- the guide image is an image obtained by superimposing guide information indicating a position of the face at which the skin-attachment sheet is to be closely attached on an image acquired by image acquiring section 220.
- the predetermined shape relative to the region of a facial part is a shape determined by makeup presenting section 260 for each face or a shape based on the above-described general arrangement of facial parts.
- makeup assisting apparatus 100 can access a server on the network in which the above-described tables are stored and can select makeup.
- makeup assisting apparatus 100 may be a distributed arrangement system, for example, a system in which, among functional sections illustrated in FIG. 2 , only capturing section 210 and display section 270 are disposed at a terminal of the user and the other sections of the apparatus are disposed on a server on the network, or the like.
- makeup selecting section 250 may detect outside light and acquire the facial feature value in a state where the influence of external light is reduced from the image.
- makeup to be presented includes the way of applying lip gloss, and the like to be presented.
- Makeup supporting apparatus 100 may present the skin care to the user using a technique different from that of the skin-attachment sheet.
- makeup supporting apparatus 100 may cause display section 270 to display information on the skin care.
- the skin care in this case may include various skin care measures other than basic cosmetic materials such as the way of applying face massage, the way of applying dietary habits.
- a makeup assisting apparatus of the present disclosure includes: a makeup selecting section that selects makeup for each face, the makeup being a way of applying makeup, the face being subjected to the makeup; and a makeup presenting section that causes pigment corresponding to the selected makeup to be held on a surface on a side of a sheet closely attachable to a skin of the face for a long time, the side being opposite to a side of the sheet where the sheet is closely attached to the skin.
- the makeup assisting apparatus further includes a printing section that performs printing on the surface of the sheet, in which the makeup presenting section causes the printing section to print an image corresponding to the selected makeup.
- the makeup assisting apparatus further includes: an image acquiring section that acquires a captured image of the face; a facial part acquiring section that acquires a region of a facial part of the face from the image; and a display section that displays an image, in which the makeup selecting section selects, for each facial part, a makeup candidate which is a candidate for makeup that is subjected to the printing, the makeup presenting section causes the display section to display a simulation image obtained by superimposing on the image, an image indicating a state of the makeup candidate when the makeup candidate is applied to the face, and the makeup selecting section receives a selection operation on the displayed makeup candidate and selects the selected makeup candidate as application makeup which is ma7keup subjected to the printing.
- an image acquiring section that acquires a captured image of the face
- a facial part acquiring section that acquires a region of a facial part of the face from the image
- a display section that displays an image, in which the makeup selecting section selects, for each facial part, a makeup candidate which is a candidate for
- the makeup presenting section causes, when the application makeup is selected for a plurality of the facial parts, the printing section to print an image corresponding to the application makeup with an arrangement corresponding to an arrangement of a plurality of regions acquired for the plurality of facial parts.
- the makeup assisting apparatus further includes an image capturing section that captures a moving image of the face, in which the sheet has a predetermined shape relative to the region of the facial part, the image acquiring section acquires an image that makes up the moving image, and the makeup presenting section sequentially generates guide images obtainable by superimposing on the image, guide information indicating a position on the face at which the sheet is to be closely attached for each image making up the moving image, and causes the display section to display the guide images.
- an image capturing section that captures a moving image of the face, in which the sheet has a predetermined shape relative to the region of the facial part
- the image acquiring section acquires an image that makes up the moving image
- the makeup presenting section sequentially generates guide images obtainable by superimposing on the image, guide information indicating a position on the face at which the sheet is to be closely attached for each image making up the moving image, and causes the display section to display the guide images.
- the makeup selecting section further selects, for each face, skin care which is a way of applying a basic cosmetic
- the makeup presenting section causes a basic cosmetic material corresponding to the selected skin care to be held on the surface on the side of the sheet where the sheet is to be closely attached to the skin.
- the makeup selecting section further selects, for each face, skin care which is a way of applying a basic cosmetic
- the printing section further includes a function of blowing a basic cosmetic material over the surface on the side of the sheet where the sheet is to be closely attached to the skin
- the makeup presenting section causes the printing section to blow the basic cosmetic material corresponding to the selected skin care over the sheet
- the printing section is supplied with the sheet while the surface on the side of the sheet where the sheet is to be closely attached to the skin is attached to a mesh-like mount.
- the sheet is made of a biocompatible polymer.
- the printing section includes a cutter section that cuts the sheet
- the makeup presenting section calculates a shape of the sheet that is three-dimensionally attachable to the face, and causes the cutter section to cut the sheet into the calculated shape.
- the shape of the sheet is such a shape that the shape is for a state in which an eyelid of the face is closed, that notches are formed at parts of the shape corresponding to an eye and a mouth of the face, and that at least a part of the shape corresponding to a nose part of the face is separated.
- the makeup selecting section selects makeup based on a change in a skin condition of the face.
- the makeup selecting section selects the makeup and/or corrects a color of the selected makeup based on at least one of a color of clothes, a color of the skin and a color of the hair of a subject whose face is subjected to the makeup.
- the makeup selecting section selects the skin care based on a change in a skin condition of the face.
- a skin-attachment sheet serving as the sheet used for the makeup assisting apparatus of the present disclosure includes: a protection layer that is provided on a surface on a side of the skin-attachment sheet that is opposite to a side of the skin-attachment sheet where the sheet is to be closely attached to the skin, and that is capable of being peeled off from the surface; and a mount that is provided on the surface on the side of the skin-attachment sheet where the sheet is to be closely attached to the skin, and that is capable of being peeled off from the surface, in which the skin-attachment sheet is supplied to the printing section after the protection layer is peeled off.
- the skin-attachment sheet in which a basic cosmetic material having an ultraviolet-ray cutting function is held on the surface on the side of the skin-attachment sheet where the sheet is to be closely attached to the skin.
- a makeup assisting method of the present disclosure includes: selecting makeup for each face, the makeup being a way of applying makeup, the face being subjected to the makeup; and causing pigment corresponding to the selected makeup to be held on a surface on a side of a sheet closely attachable to a skin of the face for a long time, the side being opposite to a side of the sheet where the sheet is to be closely attached to the skin.
- a makeup assisting program of the present disclosure that causes a computer to execute processing including: selecting makeup for each face, the makeup being a way of applying makeup, the face being subjected to the makeup; and causing pigment corresponding to the selected makeup to be held on a surface on a side of a sheet closely attachable to a skin of the face for a long time, the side being opposite to a side of the sheet where the sheet is to be closely attachable to the skin.
- the program may be recorded in a computer-readable recording medium.
- the recording medium may be a non-transitory recording medium such as a flash memory.
- the present invention is useful as a makeup assisting apparatus, a makeup assisting method and a makeup assisting program which can appropriately assist makeup for users who do not have enough makeup skill.
Landscapes
- Engineering & Computer Science (AREA)
- Health & Medical Sciences (AREA)
- Oral & Maxillofacial Surgery (AREA)
- General Health & Medical Sciences (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Image Processing (AREA)
- Cosmetics (AREA)
Abstract
Description
- The present invention relates to a makeup assisting apparatus, a makeup assisting method and a makeup assisting program for assisting facial makeup (cosmetic makeup).
- In recent years, the way of applying makeup to the face (hereinafter, simply referred to as "makeup") has been diversified. Therefore, it has become difficult, particularly for a person who has no sufficient knowledge about makeup to select appropriate makeup from an infinite number of options because it takes an enormous amount of time and effort to actually try, judge and compare various types of makeup.
- Under such circumstances,
PTL 1 andPTL 2 disclose techniques in which makeup that matches the feature of the face is selected, and a simulation image of the face on which the selected makeup is applied is created and presented, for example. In the techniques disclosed inPTL 1 andPTL 2, a captured image of a face (hereinafter, simply referred to as "face") that is subjected to makeup is acquired, the feature of the face is extracted, and makeup that matches the feature of the face is selected based on a selection criteria set in advance. Then, in the related art, on the acquired image, an image indicating a state of makeup obtained by applying the selected makeup to the face is superimposed to create and display a simulation image. - According to the above-mentioned techniques, it is possible to narrow down targets of simulation image creation as makeup that matches the feature of the face and judge whether the makeup is good or bad without actually performing makeup. That is, it is possible to select appropriate makeup with a less amount of time and effort.
- However, for a user who has not enough makeup application skill, it is difficult to reproduce the makeup even when a makeup simulation image is presented. Thus, the technique relating to basic cosmetics described in PTL 3 may be diverted to makeup.
- According to the technique described in PTL 3, basic cosmetic materials corresponding to skin care selected for each face are printed on a cosmetic delivery sheet whose base material is a felt, paper or water-soluble material or the like. The user attaches such a cosmetic delivery sheet to the skin of the face with the printed surface being oriented toward the face, and can thereby hold the basic cosmetic materials applied to the face. Instead of these basic cosmetic materials, general cosmetic materials corresponding to the selected makeup may be printed.
-
-
PTL 1
Japanese Patent Application Laid-Open No. 2001-346627 -
PTL 2
Japanese Patent Application Laid-Open No. 2007-175384 - PTL 3
Japanese Unexamined Patent Application Publication (Translation of PCT Application) No. 2012-502908 - PTL 4
Japanese Patent Application Laid-Open No. 2003-44837 - PTL 5
Japanese Patent Application Laid-Open No. 2012-86475 - PTL 6
Japanese Patent Application Laid-Open No. 2013-39832 - PTL 7
Japanese Patent Application Laid-Open No. 2012-203425 - However, even when the technique described in PTL 3 is used, it is difficult to sufficiently reproduce the selected makeup. This is because successfully transferring the general cosmetic materials from the cosmetic delivery sheet requires a certain degree of skill. When the cosmetic delivery sheet is left attached as a water-soluble substance, dissolution of the cosmetic delivery sheet may cause concentration or distribution of the general cosmetic materials to change, resulting in a smeared makeup. Therefore, the related art has a problem that it is difficult to appropriately assist makeup for users who do not have enough makeup skill.
- An object of the present invention is to provide a makeup assisting apparatus, a makeup assisting method, and a makeup assisting program capable of appropriately assisting users who do not have enough makeup skill to perform makeup.
- A makeup assisting apparatus according to an aspect of the present invention includes: a makeup selecting section that selects makeup for each face, the makeup being a way of applying makeup, the face being subjected to the makeup; and a makeup presenting section that causes pigment corresponding to the selected makeup to be held on a surface on a side of a sheet closely attachable to a skin of the face for a long time, the side being opposite to a side of the sheet where the sheet is to be closely attached to the skin.
- A makeup assisting method according to an aspect of the present invention includes: selecting makeup for each face, the makeup being a way of applying makeup, the face being subjected to the makeup; and causing pigment corresponding to the selected makeup to be held on a surface on a side of a sheet closely attachable to a skin of the face for a long time, the side being opposite to a side of the sheet where the sheet is to be closely attached to the skin.
- A makeup assisting program according to an aspect of the present invention is a program that causes a computer to execute processing including: selecting makeup for each face, the makeup being a way of applying makeup, the face being subjected to the makeup; and causing pigment corresponding to the selected makeup to be held on a surface on a side of a sheet closely attachable to a skin of the face for a long time, the side being opposite to a side of the sheet where the sheet is to be closely attachable to the skin.
- According to the present invention, it is possible to appropriately assist users who do not have enough makeup skill to perform makeup.
-
-
FIG. 1 is a block diagram illustrating an exemplary configuration of a makeup assisting apparatus according toEmbodiment 1 of the present invention; -
FIG. 2 is a block diagram illustrating an exemplary configuration of a makeup assisting apparatus according toEmbodiment 2 of the present invention; -
FIG. 3 is a diagram illustrating an exemplary makeup table according toEmbodiment 2; -
FIG 4 is a diagram illustrating an exemplary makeup information table according toEmbodiment 2; -
FIG. 5 is a perspective view illustrating an exemplary schematic configuration of a printing section according toEmbodiment 2; -
FIG. 6 is a flowchart illustrating an exemplary operation of the makeup assisting apparatus according toEmbodiment 2; -
FIG. 7 is a diagram illustrating an exemplary image according toEmbodiment 2; -
FIG. 8 is a diagram illustrating an exemplary arrangement of feature points of the face according toEmbodiment 2; -
FIG. 9 is a diagram illustrating exemplary facial part information according toEmbodiment 2; -
FIG. 10 is a diagram illustrating an exemplary simulation image according toEmbodiment 2; -
FIG. 11 is a diagram illustrating an exemplary printed skin-attachment sheet according toEmbodiment 2; and -
FIG. 12 is a perspective view illustrating an exemplary schematic configuration of a manufacturing machine of a thin-film sheet with a mount according toEmbodiment 2. - In the following, embodiments of the present invention will be described in detail with reference to the accompanying drawings.
-
Embodiment 1 of the present invention is an example of a basic mode of the present invention. -
FIG. 1 is a block diagram illustrating an exemplary configuration of a makeup assisting apparatus according to the present embodiment. - In
FIG. 1 ,makeup assisting apparatus 100 is provided withmakeup selecting section 250 andmakeup presenting section 260. -
Makeup selecting section 250 selects makeup which is the way of applying makeup for each face (hereinafter simply referred to as "face") that is subjected to makeup. -
Makeup presenting section 260 causes pigment corresponding to the selected makeup to be held on the surface on a side of a sheet closely attachable to the skin of the face for a long time, the side being opposite to the side closely attached to the skin. -
Makeup assisting apparatus 100 has, for example, a central processing unit (CPU), a storage medium such as a read-only memory (ROM) having a control program stored therein, and a working memory such as a random access memory (RAM), although these components are not illustrated. In this case, the above-described functions of the sections are implemented by the CPU executing the control program. - Such
makeup assisting apparatus 100 can cause pigment corresponding to the makeup selected for each face to be held on the surface of a side of the sheet closely attachable to the skin of the face for a long time, the side being opposite to the side closely attachable to the skin. This allows the user to attach the sheet to which the selected makeup is applied to the skin of the face, leave the sheet attached, and thereby easily reproduce such makeup. Therefore,makeup assisting apparatus 100 can appropriately assist a user who does not have enough makeup skill to perform makeup. -
Embodiment 2 of the present invention is an example of a specific mode of the present invention.Embodiment 2 is an exemplary case where the present invention is applied in an apparatus having a display provided with a touch panel and a digital camera. - First, the terms used in the present embodiment are explained.
- A "facial part" refers to a part characterizing impression of the face, such as eyes, eyebrows, nose, cheekbones, lips and an outline.
- "Facial part ID" refers to identification information of the facial part.
- A "region of the facial part" refers to a region occupied by the facial part on an image or in real space, and includes a position of a feature point of the facial part, such as corners of the eyes.
- A "facial feature value" refers to a value of a predetermined parameter which indicates features of the face. Here, the facial feature value is multivariate data including a plurality of values such as a ratio of a length of the face with respect to a width of the face, a ratio of a length of the nose with respect to a distance between both eyes and a ratio of a width of the eye with respect to the width of the face.
- "Makeup" refers to the way (type) of applying makeup such as eye shadows and lipsticks that corrects impression of features of the facial part to improve aesthetics, and includes at least a color, application concentration and application range of pigment.
- "Makeup information" refers to information representing makeup contents.
- "Makeup type" refers to the type of makeup such as "foundation," "eye shadow," "lipstick," and "blush" that are identified by at least the positional relationship with facial parts.
- "Makeup ID" refers to identification information of makeup.
- Next, a configuration of the makeup assisting apparatus according to the present embodiment is described.
-
FIG 2 is a block diagram illustrating an exemplary configuration of the makeup assisting apparatus according to the present embodiment. - In
FIG. 2 ,makeup assisting apparatus 100 includesimage capturing section 210,image acquiring section 220, facialpart acquiring section 230, makeuptable storing section 240,makeup selecting section 250,makeup presenting section 260,display section 270 andprinting section 280. -
Image capturing section 210 is, for example, a digital video camera, and captures a moving image of the face. Capturingsection 210 outputs the captured moving image to image acquiringsection 220. The moving image includes a plurality of time-series images (frame images). Note that in the present embodiment, the face subjected to makeup is the face of the user ofmakeup assisting apparatus 100. -
Image acquiring section 220 sequentially acquires images making up the moving image from the inputted moving image.Image acquiring section 220 outputs the acquired image to facialpart acquiring section 230 andmakeup presenting section 260. - Facial
part acquiring section 230 acquires a region of the facial part from the inputted image. The region of the facial part is acquired, for example, through matching between each partial region of the image and a template image of each facial part prepared in advance (for example, see PTL 4). Facialpart acquiring section 230 outputs identification information of the acquired facial part and information indicating the region (hereinafter, referred to as "facial part information") tomakeup selecting section 250. - Makeup
table storing section 240 stores a makeup table. The makeup table is a table describing, in association with a facial feature value acquired, makeup appropriate for the face having the facial feature value. - It is assumed in the present embodiment that principal component analysis is performed in advance on samples of the facial feature value of an unspecified number of faces to which makeup experts have applied makeup in the past. It is assumed that the results of the principal component analysis are grouped in advance using a publicly known principal component grouping method in which it is determined based on a determination criterion such as whether or not a principal component value is 1 σ or higher. Further, it is assumed that in the makeup table, makeup which has been frequently applied in the past to the face belonging to the group is registered for each facial feature value group.
-
FIG. 3 is a diagram illustrating an exemplary makeup table. - As shown in
FIG. 3 , makeup table 410 describes a plurality ofmakeup IDs 412 for each facialfeature value group 411. For example, twomakeup IDs 412 of "FM1 and FM2" are associated with facialfeature value group 411 of "FG1." This indicates that when the facial feature value of the user's face is FG1, the makeup indicated by the makeup ID of "FM1" and the makeup indicated by the makeup ID of "FM2" are appropriate. - Note that the trends of makeup change frequently and makeup to be presented should be changed frequently. For this reason, it is desirable to periodically update makeup table 410 from a server on the Internet via, for example, a communication circuit (not shown) provided at
makeup assisting apparatus 100. - Makeup
table storing section 240 inFIG. 2 stores a makeup information table. The makeup information table is a table describing makeup information of the makeup indicated bymakeup ID 412 described in makeup table 410 (seeFIG. 3 ). -
FIG. 4 is a diagram illustrating an exemplary makeup information table stored in makeuptable storing section 240. - As shown in
FIG. 4 , makeup information table 420 describesmakeup ID 421,makeup type 422,color 423,concentration 424 andrange 425 in association with one another. -
Makeup ID 421 is associated with makeup ID 412 (seeFIG. 3 ) of makeup table 410.Makeup type 422, which is illustrated in a simplified form, more specifically includes "foundation," "eye shadow," "lipstick" and "blush" or the like.Color 423, which is illustrated in a simplified form, more specifically includes an RGB value and a gloss value or the like.Concentration 424, which is illustrated in a simplified form, more specifically includes a level of transparency when an image is superimposed on the image of the face and the way of applying gradation or the like.Range 425, which is illustrated in a simplified form, more specifically includes a set of a relative coordinate group from a feature point, a relative position of a central point with respect to the feature point and a radius, or the like. - A set of
color 423,concentration 424 andrange 425 includes at least information necessary for imaging. That is, in the present embodiment, suppose the makeup information includes at least information necessary to generate an image when makeup is applied to the face (information indicating the difference in face color). - Note that makeup table 410 shown in
FIG. 3 and makeup information table 420 shown inFIG. 4 may be integrated into one table. -
Makeup selecting section 250 inFIG. 2 acquires a facial feature value. Note thatmakeup selecting section 250 may acquire a facial feature value from facial part information inputted from facialpart acquiring section 230 or acquire a facial feature value from an image by analyzing the image acquired byimage acquiring section 220.Makeup selecting section 250 selects a makeup candidate which is a candidate for makeup subjected to printing which will be described later for each facial part with reference to makeup table 410 (seeFIG. 3 ) based on the acquired facial feature value.Makeup selecting section 250 acquires makeup information of the selected makeup candidate from makeup information table 420 (seeFIG. 4 ) and outputs the makeup information tomakeup presenting section 260. - Note that as described above, makeup table 410
registers makeup ID 412 for each facial feature value group. Therefore,makeup selecting section 250 determines to which of facialfeature value groups 411 registered in makeup table 410 the facial feature value acquired from the face belongs and selectsmakeup ID 412 associated with determined facialfeature value group 411. This determination is made, for example, by calculating a distance between the acquired facial feature value and a representative value (centroid) of each group. -
Makeup selecting section 250 receives from the user, an operation of switching between makeup candidates (hereinafter referred to as "display makeup") to be a display target of a simulation image, which will be described later, and an operation of selecting display makeup. These operations are performed via, for example, a touch panel provided indisplay section 270, which will be described later.Makeup selecting section 250 selects the selected display makeup as the application makeup which is makeup subjected to printing, which will be described later.Makeup selecting section 250 acquires makeup information of the selected application makeup from makeup information table 420 (seeFIG. 4 ) and outputs the makeup information tomakeup presenting section 260. -
Makeup presenting section 260 causesdisplay section 270, which will be described later, to display a simulation image of the makeup candidate. More specifically,makeup presenting section 260 superimposes an image illustrating a condition of the makeup candidate when the makeup candidate is applied to the face on the image inputted fromimage acquiring section 220 and generates a simulation image. The superimposing position of the image of the makeup candidate is calculated from, for example, facial part information and a range of makeup included in the makeup information.Makeup presenting section 260 then outputs the image data of the generated simulation image to displaysection 270. - It should be noted that the image in the simulation image is superimposed by, for example, a publicly-known image combining process such as an alpha (α) blending process. In this case, an alpha value (α) is set according to concentration of makeup. The alpha blending process is expressed with, for example, the following
Equations 1 to 3;
where r1, g1 and b1 are RGB values of an arbitrary region in the captured image, r2, g2 and b2 are RGB values of the makeup, and R, G and B are RGB values of the corresponding region in the simulation image. - Further, it is assumed that an order of application when makeup is applied to the face in an overlapped manner (hereinafter, referred to as an "application order") is set for each makeup, and an image in a case where the makeup is applied is presented as an image shaded with density according to the concentration. The application order defines, for example, blush should be applied after foundation is applied. In this case, the images may be superimposed on the captured image by
makeup presenting section 260 overpainting the image of each makeup in an order according to the application order. -
Makeup presenting section 260 causes pigment corresponding to the selected application makeup to be held on the surface on a side of a predetermined sheet closely attachable to the skin of the face for a long time (hereinafter referred to as "skin-attachment sheet"), the side being opposite to the side closely attached to the skin. - More specifically,
makeup presenting section 260 generates image data of an image illustrating the state of the application makeup when a makeup candidate is applied to the face and outputs the generated image data toprinting section 280 which will be described later. Thus,makeup presenting section 260 causesprinting section 280 to print the image corresponding to the application makeup on the surface of the skin-attachment sheet. - Note that when the application makeup is selected for a plurality of facial parts,
makeup presenting section 260 causesprinting section 280. to print the image corresponding to the application makeup on the surface of the skin-attachment sheet with an arrangement corresponding to the arrangement of the plurality of acquired regions for a plurality of facial parts. - Suppose
makeup presenting section 260 calculates the shape of the skin-attachment sheet that can be three-dimensionally attached to the face, from the outline of the face, regions of both eyes, region of the nose or the like. Supposemakeup presenting section 260 also outputs the calculated shape of the skin-attachment sheet and information indicating a positional relationship between the shape and the image corresponding to the application makeup (hereinafter referred to as "sheet shape information") toprinting section 280. Here, it is assumed that the sheet shape information includes at least information indicating the outline of the face, regions of both eyelids when both eyes are closed and region of the nose and information indicating a positional relationship between these regions and the application makeup. Note that the regions of both eyelids when both eyes are closed are preferably regions of the eyeholes, and are regions connecting the inner corners of the eyes, lower eyelid, outer corners of the eyes and under eyebrow, for example. -
Display section 270 is, for example, a display part of a display with a touch panel.Display section 270 displays a simulation image based on image data of the inputted simulation image. -
Printing section 280 performs multi-color printing on the surface of the skin-attachment sheet. More specifically,printing section 280 receives the supply of the skin-attachment sheet and the image data of the application makeup, and prints an image corresponding to the application makeup indicated by the image data on the surface on the side of the skin-attachment sheet opposite to the side closely attached to the skin (hereinafter referred to as "outside face").Printing section 280 cuts the skin-attachment sheet on which the image corresponding to the application makeup is printed based on the inputted sheet shape information. - The skin-attachment sheet is a biocompatible sheet attached to the skin of the face without any uncomfortable feeling. More specifically, the skin-attachment sheet is a thin film having a thickness of 10 nm to 500 nm containing a layer made of polylactic acid, polyglycolic acid, polycaprolactone, or a copolymer thereof, and a biocompatible polymer such as hyaluronic acid, and chitosan, for example. Since the thin-film available as a skin-attachment sheet is described, for example, in PTL 5, detailed description thereof will be omitted here. Suppose the skin-attachment sheet has a structure in which a mount is attached to the surface closely attached to the skin (hereinafter referred to as "inside face") and a sheet protection film is attached to the outside face. Suppose the skin-attachment sheet is supplied to
printing section 280 with the sheet protection film peeled off by the user. -
FIG. 5 is a perspective view illustrating an exemplary schematic configuration ofprinting section 280. - As shown in
FIG. 5 ,printing section 280 is constructed ofprinting head section 282,roll feeding section 283,laser cutter section 284, andsheet hook sections 285, which are arranged in that order onbase part 281 on which skin-attachment sheet 300 is placed. -
Printing head section 282 prints an image corresponding to the application makeup based on image data,Roll feeding section 283 sends skin-attachment sheet 300 whose printing is completed to thelaser cutter section 284 side.Sheet hook sections 285 regulate the movement of skin-attachment sheet 300 sent to thelaser cutter section 284 side.
Laser cutter section 284 cuts skin-attachment sheet 300 using a laser cutter based on sheet shape information. - As a specific configuration of ink used in
printing section 280 and each section, any publicly known technique can be adopted if it is appropriate to image printing of the skin-attachment sheet on the outside face (e.g., see PTL 6 and PTL 7). Note that since printing is performed on the outside face of skin-attachment sheet 300, the ink does not come into close contact with the skin. Therefore, the ink does not require high biocompatibility, and can be selected at a high degree of freedom. - Note that
makeup assisting apparatus 100 inFIG 2 has, for example, a central processing unit (CPU), a storage medium such as a read-only memory (ROM) having a control program stored therein, and a working memory such as a random access memory (RAM), although these components are not illustrated. In this case, the above-described functions of the sections are implemented by the CPU executing the control program. - Such
makeup assisting apparatus 100 can cause pigment corresponding to makeup selected for each face to be held on the surface of the side of the sheet closely attachable to the skin of the face for a long time, the side being opposite to the side closely attached to the skin. The user attaches the sheet to which the selected makeup is applied to the skin of the face, leaves the sheet attached, and can thereby easily reproduce makeup. - Next, an operation of
makeup assisting apparatus 100 is described. -
FIG. 6 is a flowchart illustrating an exemplary operation ofmakeup assisting apparatus 100. - First, in step S1100,
image capturing section 210 starts capturing a moving image of the user's face andimage acquiring section 220 starts acquiring images that make up the captured moving image. Facialpart acquiring section 230 starts acquiring facial parts of the face included in the image. - In this case, facial
part acquiring section 230 extracts feature points of the face (facial parts) from the image by analyzing the image, for example. Facialpart acquiring section 230 acquires a region formed of feature points that make up an identical facial part as a region of the facial part. Facialpart acquiring section 230 generates facial part information from the region of the acquired facial part. -
FIG. 7 is a diagram illustrating an exemplary image acquired in step S1100 inFIG. 6 . - As illustrated in
FIG. 7 ,image 510 includes an image of the face of the user (hereinafter, referred to as a "face image") 511. Here, the user wears no makeup. -
FIG. 8 is a diagram illustrating an exemplary arrangement of feature points of the face extracted in step S1100 ofFIG 6 . - As shown in
FIG. 8 , a plurality of feature points (shown by symbols "●") are extracted fromface image 511. For example, first to fourth feature points 521 to 524 make up the right eye. Therefore, facialpart acquiring section 230 acquiresregion 525 surrounded by first to fourth feature points 521 to 524 as the region of the right eye. -
FIG. 9 is a diagram illustrating exemplary facial part information generated in step S1100 ofFIG 6 . - As illustrated in
FIG. 9 ,facial part information 530, for example, describesregion 532 andperson ID 533 for eachfacial part ID 531.Facial part ID 531 is identification information of the facial part such as the left eye and the upper lip.Region 532, which is information indicating a range of the region of the facial part in the image, is a list of coordinate values of a coordinate system set on the image, for example.Person ID 533 is identification information of the person. Asperson ID 533, for example, a value designated by the user through operation to a display with touch panel or the like is set every time capturing is started. - In step S1200 of
FIG. 6 ,makeup selecting section 250 acquires the facial feature value. The facial feature value is, as described above, multivariate data regarding a predetermined parameter indicating the features of the face.Makeup selecting section 250 acquires the facial feature value from one of image 510 (seeFIG. 7 ), a group of facial feature points of the face (seeFIG. 8 ) and facial part information 530 (seeFIG. 9 ), for example.Makeup selecting section 250 selects a makeup candidate based on the acquired facial feature value. Here, suppose a plurality of makeup candidates are selected. - In step S1300,
makeup selecting section 250 determines one display makeup from among a plurality of makeup candidates.Makeup selecting section 250 outputs makeup information corresponding to the determined display makeup tomakeup presenting section 260. - In step S1400,
makeup presenting section 260 generates a simulation image based on makeup information relating to the determined display makeup and causesdisplay section 270 to display the simulation image. -
FIG. 10 is a diagram illustrating an exemplary simulation image generated in step S1400 ofFIG. 6 . - As shown in
FIG. 10 ,simulation image 540 is an image in whichmakeup images 541 to 545 such as eyebrow, eye shadow, eyeliner, blush, and lipstick are superimposed onface image 511. Supposesimulation image 540 is also an image in which a foundation color is superimposed onface image 511. - In step S1500,
makeup selecting section 250 determines whether or not an operation of selecting the current display makeup as the application makeup is performed. When such an operation is not performed (S1500: NO),makeup selecting section 250 moves the process to step S1600. - In step S1600,
makeup selecting section 250 determines whether or not an operation of switching the display makeup to another makeup candidate is performed. When such an operation is not performed (S1600: NO),makeup selecting section 250 moves the process to step S1800, which will be described later. When such an operation is performed (S1600: YES),makeup selecting section 250 moves the process to step S1700. - In step S1700,
makeup selecting section 250 changes the display makeup to another makeup candidate, outputs the corresponding makeup information tomakeup presenting section 260 and proceeds to step S1800. - In step S1800,
image acquiring section 220 determines whether or not input of a moving image is continued. When the input of a moving image is continued (S1800: YES),image acquiring section 220 returns the process to step S1400 and moves the process to the next image. When the input of a moving image is finished (S1800: NO),image acquiring section 220 ends a series of processes. - On the other hand, when an operation of selecting one makeup candidate as the application makeup is performed (S1500: YES),
makeup selecting section 250 moves the process to step S1900. - In step S1900,
makeup presenting section 260 usesprinting section 280 to print the application makeup on an outside face of the skin-attachment sheet and then cut the skin-attachment sheet, and ends a series of processes. -
FIG. 11 is a diagram illustrating an exemplary skin-attachment sheet (hereinafter referred to as "printed skin-attachment sheet") generated in step S1900 ofFIG. 6 . Here, based on the premise that the skin-attachment sheet is attached with the eyelid being closed, a case will be described as an example where the display makeup ofsimulation image 540 shown inFIG. 10 is selected as the application makeup. - As shown in
FIG. 11 , printed skin-attachment sheet 550 is made up ofoverall face sheet 551, right eyelid part sheet 552, lefteyelid part sheet 553 andnose part sheet 554. Right eyelid part sheet 552 and lefteyelid part sheet 553 are associated with the left eyelid part when the left eyelid is closed and the right eyelid part when the right eyelid is closed.Overall face sheet 551 includes a plurality of notches on the edge, holes in parts corresponding to both eyes (both eyelids when both eyelids are closed) and a part corresponding to the nose, and a notch in a part corresponding to the mouth. Skin-attachment sheet 550 has moderate elasticity. Although formed two-dimensionally, skin-attachment sheet 550 can be well attached to the skin of the face which has a three-dimensional shape because skin-attachment sheet 550 has such a shape and elasticity. Note that right eyelid part sheet 552 and lefteyelid part sheet 553 may not necessarily be separated fromoverall face sheet 551.
In this case, it is preferable to correspond to the state in which the eyelids are closed and provide notches in parts corresponding to the eyes. -
Images 561 to 565 are printed onoverall face sheet 551, right eyelid part sheet 552, and lefteyelid part sheet 553 in correspondence tomakeup images 541 to 545 ofsimulation image 540. Suppose colors corresponding to the foundation colors displayed insimulation image 540 are printed on allsheets 551 to 554. - The user first peels off only the edge of such printed skin-attachment sheet 550 from the mount and attaches the peeled part to the corresponding parts of the skin of the face. While holding the part attached to the skin, the user pulls the mount in parallel with the skin and in a direction toward the part where attachment has not been completed. This allows the user to well attach to the skin, skin-attachment sheet 550 on which
makeup images 541 to 545 are printed
By leaving skin-attachment sheet 550 attached, it is possible to easily reproduce the selected makeup. - Note that notches are preferably formed along the eyelid lines and the mouth line. Openings are preferably provided in the regions corresponding to the nose holes.
- Through the above-described operation,
makeup assisting apparatus 100 can present to the user, makeup suitable for the user sequentially, following the moving image of the face and in association with the corresponding regions. Therefore, the user can check the makeup effects while changing the orientation of the face and facial expressions, and can experience as if the user were looking at the user's face actually subjected to makeup and reflected on a mirror. -
Makeup assisting apparatus 100 can receive an operation of switching of display makeup from the user at arbitrary timing. This allows the user to appropriately and speedily determine makeup that matches the user's preference from among a plurality of makeup candidates and select it as a target for printing on the outside face of the skin-attachment sheet. - Next, details of the aforementioned skin-attachment sheet with a mount will be described.
- Skin-attachment sheets with a mount are produced by a manufacturing machine in a factory or the like and distributed and sold to users.
-
FIG. 12 is a perspective view illustrating an exemplary schematic configuration of a manufacturing machine of a skin-attachment sheet with a mount. - As shown in
FIG. 12 , inmanufacturing machine 600 of a thin-film sheet with a mount,roll feeding section 612, first-layerapplication head section 613, first-layerdrying head section 614, second-layerapplication head section 615, second-layerdrying head section 616, and mountpressing roll section 617 are arranged in that order on base part 611 on whichsheet protection paper 610 is placed. -
Sheet protection paper 610 is made of, for example, a silicone raw material which can be easily peeled off from a hardened first layer, which will be described later. Roll feedingsection 612 causessheet protection paper 610 to pass through first-layerapplication head section 613 to mountpressing roll section 617 in that order. - First-layer
application head section 613 uniformly applies a liquid-phase substance made of biocompatible polymer such as polylactic acid to the top surface ofsheet protection paper 610 as a first layer. - First-layer
drying head section 614 includes, for example, an iron-chromium wire heater, and places the first-layer applied to the top surface ofsheet protection paper 610 in an environment of approximately 70 to 110°C for approximately 90 seconds to dry the first-layer and cause the first layer to harden to moderate hardness. - Second-layer
application head section 615 uniformly applies, on the hardened first layer, a liquid-phase substance having a function as a basic cosmetic material containing a moisturizing component such as hyaluronic acid and a function of causing the raw material of a dried second layer, which will be described later, to come into close contact with the skin as a second layer. - Second-layer
drying head section 616 includes, for example, an iron-chromium wire heater, places the second layer applied on the top surface of the first layer in an environment of approximately 100 to 110°C for approximately 90 seconds to dry the second layer and cause the second layer to harden to moderate hardness. The hardened second layer, which is left closely attached to the skin, implements skin care using the basic cosmetic material. - Note that the total thickness of the hardened first layer and second layer is preferably approximately 10 nm to 500 nm.
- Mount pressing
roll section 617 supplies mount 620 to the top surface of the hardened second layer and crimps mount 620 onto the top surface of the second layer.Mount 620 is made of, for example, a silicone raw material which can be easily peeled off from the hardened second layer. - Using
such manufacturing machine 600, a skin-attachment sheet with a mount is generated in whichsheet protection paper 610, the skin-attachment sheet made up of the first layer and the second layer, and mount 620 are attached to one another in that order. Note that a cutter for cutting the skin-attachment sheet with a mount to a predetermined length may be provided after manufacturingmachine 600. - The skin-attachment sheet with a mount generated in this way is stripped of
sheet protection paper 610, for example, by the user's hand, supplied tobase part 281 of printing section 280 (seeFIG. 5 ) and subjected to printing of the selected makeup and cutting according to the face. - As described above,
makeup assisting apparatus 100 according to the present embodiment causes pigment corresponding to makeup selected for each face to be held on the outside face of the skin-attachment sheet. This allows the user to attach the sheet on which the selected makeup is applied to the skin of the face, leave the sheet attached, and thereby easily reproduce such makeup. Therefore,makeup assisting apparatus 100 can appropriately assist a user who does not have enough makeup skill to perform makeup. -
Makeup assisting apparatus 100 according to the present embodiment causes pigment to be held on the skin-attachment sheet through inkjet multi-color printing. This allowsmakeup assisting apparatus 100 to reproduce a fine pattern, complicated color, and delicate tone of the makeup selected bymakeup selecting section 250 with high accuracy. -
Makeup assisting apparatus 100 according to the present embodiment prints an image corresponding to the makeup on the outside face of the skin-attachment sheet. Sincemakeup assisting apparatus 100 does not always require high biocompatibility for the ink used for printing in this way, it is possible to improve the degree of freedom of apparatus design and the degree of freedom of makeup selection. Furthermore,makeup assisting apparatus 100 can reduce the possibility of smeared makeup caused by sweat and sebum, and implement makeup which remains stable for a long time. -
Makeup assisting apparatus 100 according to the present embodiment uses a skin-attachment sheet in which a basic cosmetic material is applied to the inside face. This allowsmakeup assisting apparatus 100 to reduce the possibility of smeared makeup of the basic cosmetic material caused by sweat and sebum, and maintain the initial distribution state for a long time. Maintaining such a distribution state is suitable for a basic cosmetic material that prevents ultraviolet rays from reaching the skin, having a so-called UV (ultraviolet ray) cutting function. -
Makeup assisting apparatus 100 according to the present embodiment prints makeup corresponding to a plurality of facial parts on one skin-attachment sheet (or one set of skin-attachment sheets made up of a plurality of sheets). This prevents the makeup from becoming imperfect such as partially missing makeup. - Note that the makeup candidate selection technique is not limited to the above-described example. For example,
makeup selecting section 250 may select fashionable makeup preferentially irrespective of a facial feature value or select a makeup candidate based on a facial feature value and other information. - Makeup is selected based on, for example, a skin condition. The skin condition is, for example, smear, wrinkle, sebum secretion, hidden smear, water content, blood flow and perspiration or the like of the skin of the face, and acquired, for example, through analysis of an image captured using daily light, ultraviolet rays, infrared light or laser light.
- More specifically,
makeup selecting section 250 selects makeup that applies a concealer to the smeared part and dark circles under the eyes, for example. - Makeup may also be selected based on a predicted change in the skin condition. A change in the skin condition is predicted from the above-described skin condition, environment information, and physical condition information. The environment information includes weather, air temperature, season and an amount of solar radiation, for example. The physical condition information includes a sleeping time, body temperature, amount of physical activities, eyelid opening, eye blink frequency, time in menstruation cycle and blood pressure, for example.
- More specifically, when the user lacks sleep, for example,
makeup selecting section 250 selects makeup that applies a concealer under the eyes assuming that dark circles under the eyes may become darker after a lapse of a certain time. - Makeup may also be selected based on the user's attribute information such as age or residential region.
- Various kinds of information used to select makeup may be inputted through the user's operation or may be acquired through communication by
makeup assisting apparatus 100 from a server on the Internet, or various electric appliances or sensor devices or the like used by the user. - Furthermore, for example,
makeup selecting section 250 may perform color correction of makeup. - The impression of a color of the face varies depending on colors of surroundings or a scene. For example, the face color of a person wearing red-based clothes looks like a color slightly more similar to a turquoise color than the original color. Moreover, the same makeup may be perceived as a fancy tone or quiet tone depending on the scene.
- Thus,
makeup selecting section 250 acquires a color of clothes, a color of the skin and a color of the hair or the like of the user from the image, selects makeup of an appropriate tone as a makeup candidate based on the acquired color or corrects the selected tone of the makeup candidate to an appropriate tone. Thus,makeup assisting apparatus 100 can select more appropriate makeup and present it to the user. The user can apply makeup of appropriate tone without judging whether the tone is good or bad by oneself. Such a selection of makeup exhibits a high effect in selecting a foundation color in particular. -
Makeup assisting apparatus 100 may also be configured to select skin care implemented using the skin-attachment sheet for each face. - In this case, for example, the skin-attachment sheet does not always require the above-described first layer and the skin-attachment sheet is supplied to
printing section 280, with the inside face thereof attached to a mesh-like mount.Makeup selecting section 250 further selects skin care for each face in addition to makeup.Printing section 280 further has a function of blowing a basic cosmetic material over the surface of the skin-attachment sheet with a mount on the mount side (that is, inside face of the skin-attachment sheet).Makeup presenting section 260 causesprinting section 280 to blow the basic cosmetic material corresponding to the selected skin care over the mount. - Since the mount is a mesh-like one, the blown basic cosmetic material passes through the mount, reaching the inside face of the skin-attachment sheet. When the mount is peeled off in this condition, the basic cosmetic material corresponding to the selected skin care is held on the inside face of the skin-attachment sheet.
- Skin care is selected based on the skin condition, for example.
- More specifically,
makeup selecting section 250 selects skin care that applies a basic cosmetic material having a high light scattering effect to smeared parts and selects skin care that applies a basic cosmetic material having a high skin-whitening effect to hidden smeared parts, for example.Makeup selecting section 250 selects skin care that applies a basic cosmetic material having high astringent action and sebum adsorption action to parts estimated to have a high degree of aging based on the ellipticity of skin pores. - Skin care is also selected based on, for example, a change in a predicted skin condition.
- More specifically, for example, when the user's body temperature is high,
makeup selecting section 250 selects skin care that applies a moisture-retaining beauty lotion by assuming that the drying of the skin will advance. - Various kinds of information used to select skin care may be inputted through the user's operation or may be acquired through communication by
makeup assisting apparatus 100 from a server on the Internet, various electric appliances or sensor devices or the like used by the user. - When a skin-attachment sheet is supplied which is cut in advance into a shape based on a general arrangement of facial parts,
printing section 280 need not have any cutting function andmakeup presenting section 260 need not output sheet shape information. However,makeup presenting section 260 needs to output information indicating a positional relationship between the shape of the skin-attachment sheet and makeup toprinting section 280. - When foundation in particular is not selected as the application makeup, the skin-attachment sheet may be generated by being separated for each facial part such as eye shadows placed on the eyelids, blushes placed on the cheeks and lipstick placed on the lip.
- Note that the skin-attachment sheet preferably has a raw material and a thickness that allow the skin color to sufficiently pass therethrough in consideration of a case where foundation is not selected.
- When the skin-attachment sheet has a predetermined shape relative to the region of a facial part,
makeup presenting section 260 may sequentially generate a guide image for each image that makes up a moving image and display the guide images ondisplay section 270. Here, the guide image is an image obtained by superimposing guide information indicating a position of the face at which the skin-attachment sheet is to be closely attached on an image acquired byimage acquiring section 220. The predetermined shape relative to the region of a facial part is a shape determined bymakeup presenting section 260 for each face or a shape based on the above-described general arrangement of facial parts. - In addition, the above-described various types of tables may not be stored in
makeup assisting apparatus 100. For example, ifmakeup assisting apparatus 100 can be connected to a network,makeup assisting apparatus 100 can access a server on the network in which the above-described tables are stored and can select makeup. - Further,
makeup assisting apparatus 100 may be a distributed arrangement system, for example, a system in which, among functional sections illustrated inFIG. 2 , only capturingsection 210 anddisplay section 270 are disposed at a terminal of the user and the other sections of the apparatus are disposed on a server on the network, or the like. - Further,
makeup selecting section 250 may detect outside light and acquire the facial feature value in a state where the influence of external light is reduced from the image. - Further, the specific contents of makeup are not limited to the above-described examples. For example, makeup to be presented includes the way of applying lip gloss, and the like to be presented.
-
Makeup supporting apparatus 100 may present the skin care to the user using a technique different from that of the skin-attachment sheet. For example,makeup supporting apparatus 100 may causedisplay section 270 to display information on the skin care. The skin care in this case may include various skin care measures other than basic cosmetic materials such as the way of applying face massage, the way of applying dietary habits. - A makeup assisting apparatus of the present disclosure includes: a makeup selecting section that selects makeup for each face, the makeup being a way of applying makeup, the face being subjected to the makeup; and a makeup presenting section that causes pigment corresponding to the selected makeup to be held on a surface on a side of a sheet closely attachable to a skin of the face for a long time, the side being opposite to a side of the sheet where the sheet is closely attached to the skin.
- Preferably, the makeup assisting apparatus further includes a printing section that performs printing on the surface of the sheet, in which the makeup presenting section causes the printing section to print an image corresponding to the selected makeup.
- Preferably, the makeup assisting apparatus further includes: an image acquiring section that acquires a captured image of the face; a facial part acquiring section that acquires a region of a facial part of the face from the image; and a display section that displays an image, in which the makeup selecting section selects, for each facial part, a makeup candidate which is a candidate for makeup that is subjected to the printing, the makeup presenting section causes the display section to display a simulation image obtained by superimposing on the image, an image indicating a state of the makeup candidate when the makeup candidate is applied to the face, and the makeup selecting section receives a selection operation on the displayed makeup candidate and selects the selected makeup candidate as application makeup which is ma7keup subjected to the printing.
- Preferably, in the makeup assisting apparatus, the makeup presenting section causes, when the application makeup is selected for a plurality of the facial parts, the printing section to print an image corresponding to the application makeup with an arrangement corresponding to an arrangement of a plurality of regions acquired for the plurality of facial parts.
- Preferably, the makeup assisting apparatus further includes an image capturing section that captures a moving image of the face, in which the sheet has a predetermined shape relative to the region of the facial part, the image acquiring section acquires an image that makes up the moving image, and the makeup presenting section sequentially generates guide images obtainable by superimposing on the image, guide information indicating a position on the face at which the sheet is to be closely attached for each image making up the moving image, and causes the display section to display the guide images.
- Preferably, in the makeup assisting apparatus, the makeup selecting section further selects, for each face, skin care which is a way of applying a basic cosmetic, and the makeup presenting section causes a basic cosmetic material corresponding to the selected skin care to be held on the surface on the side of the sheet where the sheet is to be closely attached to the skin.
- Preferably, in the makeup assisting apparatus, the makeup selecting section further selects, for each face, skin care which is a way of applying a basic cosmetic, the printing section further includes a function of blowing a basic cosmetic material over the surface on the side of the sheet where the sheet is to be closely attached to the skin, the makeup presenting section causes the printing section to blow the basic cosmetic material corresponding to the selected skin care over the sheet, and the printing section is supplied with the sheet while the surface on the side of the sheet where the sheet is to be closely attached to the skin is attached to a mesh-like mount.
- Preferably, in the makeup assisting apparatus, the sheet is made of a biocompatible polymer.
- Preferably, in the makeup assisting apparatus, the printing section includes a cutter section that cuts the sheet, and the makeup presenting section calculates a shape of the sheet that is three-dimensionally attachable to the face, and causes the cutter section to cut the sheet into the calculated shape.
- Preferably, in the makeup assisting apparatus, the shape of the sheet is such a shape that the shape is for a state in which an eyelid of the face is closed, that notches are formed at parts of the shape corresponding to an eye and a mouth of the face, and that at least a part of the shape corresponding to a nose part of the face is separated.
- Preferably, in the makeup assisting apparatus, the makeup selecting section selects makeup based on a change in a skin condition of the face.
- Preferably, in the makeup assisting apparatus, the makeup selecting section selects the makeup and/or corrects a color of the selected makeup based on at least one of a color of clothes, a color of the skin and a color of the hair of a subject whose face is subjected to the makeup.
- Preferably, in the makeup assisting apparatus, the makeup selecting section selects the skin care based on a change in a skin condition of the face.
- A skin-attachment sheet serving as the sheet used for the makeup assisting apparatus of the present disclosure includes: a protection layer that is provided on a surface on a side of the skin-attachment sheet that is opposite to a side of the skin-attachment sheet where the sheet is to be closely attached to the skin, and that is capable of being peeled off from the surface; and a mount that is provided on the surface on the side of the skin-attachment sheet where the sheet is to be closely attached to the skin, and that is capable of being peeled off from the surface, in which the skin-attachment sheet is supplied to the printing section after the protection layer is peeled off.
- Preferably, the skin-attachment sheet in which a basic cosmetic material having an ultraviolet-ray cutting function is held on the surface on the side of the skin-attachment sheet where the sheet is to be closely attached to the skin.
- A makeup assisting method of the present disclosure includes: selecting makeup for each face, the makeup being a way of applying makeup, the face being subjected to the makeup; and causing pigment corresponding to the selected makeup to be held on a surface on a side of a sheet closely attachable to a skin of the face for a long time, the side being opposite to a side of the sheet where the sheet is to be closely attached to the skin.
- A makeup assisting program of the present disclosure that causes a computer to execute processing including: selecting makeup for each face, the makeup being a way of applying makeup, the face being subjected to the makeup; and causing pigment corresponding to the selected makeup to be held on a surface on a side of a sheet closely attachable to a skin of the face for a long time, the side being opposite to a side of the sheet where the sheet is to be closely attachable to the skin.
- It is to be noted that the program may be recorded in a computer-readable recording medium. The recording medium may be a non-transitory recording medium such as a flash memory.
- The disclosure of
Japanese Patent Application No. 2013-059801, filled on March 22, 2013 - The present invention is useful as a makeup assisting apparatus, a makeup assisting method and a makeup assisting program which can appropriately assist makeup for users who do not have enough makeup skill.
-
- 100
- Makeup assisting apparatus
- 210
- Image capturing section
- 220
- Image acquiring section
- 230
- Facial part acquiring section
- 240
- Makeup table storing section
- 250
- Makeup selecting section
- 260
- Makeup presenting section
- 270
- Display section
- 280
- Printing section
- 281, 611
- Base part
- 282
- Printing head section
- 283
- Roll feeding section
- 284
- Laser cutter section
- 285
- Sheet hook section
- 600
- Manufacturing machine
- 612
- Roll feeding section
- 613
- First-layer application head section
- 614
- First-layer drying head section
- 615
- Second-layer application head section
- 616
- Second-layer drying head section
- 617
- Mount pressing roll section
Claims (17)
- A makeup assisting apparatus comprising:a makeup selecting section that selects makeup for each face, the makeup being a way of applying makeup, the face being subjected to the makeup; anda makeup presenting section that causes pigment corresponding to the selected makeup to be held on a surface on a side of a sheet closely attachable to a skin of the face for a long time, the side being opposite to a side of the sheet where the sheet is closely attached to the skin.
- The makeup assisting apparatus according to claim 1, further comprising a printer that performs multi-color printing on the surface of the sheet, wherein the makeup presenting section causes the printer to print an image corresponding to the selected makeup.
- The makeup assisting apparatus according to claim 2, further comprising:an image acquiring section that acquires a captured image of the face;a facial part acquiring section that acquires a region of a facial part of the face from the image; anda display that displays an image, whereinthe makeup selecting section selects, for each facial part, a makeup candidate which is a candidate for makeup that is subjected to the printing,the makeup presenting section causes the display to display a simulation image obtained by superimposing on the image, an image indicating a state of the makeup candidate when the makeup candidate is applied to the face, andthe makeup selecting section receives a selection operation on the displayed makeup candidate and selects the selected makeup candidate as application makeup which is makeup subjected to the printing.
- The makeup assisting apparatus according to claim 3, wherein the makeup presenting section causes, when the application makeup is selected for a plurality of the facial parts, the printer to print an image corresponding to the application makeup with an arrangement corresponding to an arrangement of a plurality of regions acquired for the plurality of facial parts.
- The makeup assisting apparatus according to claim 3, further comprising an image capturing section that captures a moving image of the face, wherein
the sheet has a predetermined shape relative to the region of the facial part,
the image acquiring section acquires an image that makes up the moving image, and
the makeup presenting section sequentially generates guide images obtainable by superimposing on the image, guide information indicating a position on the face at which the sheet is to be closely attached for each image making up the moving image, and causes the display to display the guide images. - The makeup assisting apparatus according to claim 1, wherein
the makeup selecting section further selects, for each face, skin care which is a way of applying a basic cosmetic, and
the makeup presenting section causes a basic cosmetic material corresponding to the selected skin care to be held on the surface on the side of the sheet where the sheet is to be closely attached to the skin. - The makeup assisting apparatus according to claim 2, wherein
the makeup selecting section further selects, for each face, skin care which is a way of applying a basic cosmetic,
the printer further includes a function of blowing a basic cosmetic material over the surface on the side of the sheet where the sheet is to be closely attached to the skin,
the makeup presenting section causes the printer to blow the basic cosmetic material corresponding to the selected skin care over the sheet, and
the printer is supplied with the sheet while the surface on the side of the sheet where the sheet is to be closely attached to the skin is attached to a mesh-like mount. - The makeup assisting apparatus according to claim 1, wherein the sheet is made of a biocompatible polymer.
- The makeup assisting apparatus according to claim 2, wherein
the printer comprises a cutter section that cuts the sheet, and
the makeup presenting section calculates a shape of the sheet that is three-dimensionally attachable to the face, and causes the cutter section to cut the sheet into the calculated shape. - The makeup assisting apparatus according to claim 9, wherein the shape of the sheet is such a shape that the shape is for a state in which an eyelid of the face is closed, that notches are formed at parts of the shape corresponding to an eye and a mouth of the face, and that at least a part of the shape corresponding to a nose part of the face is separated.
- The makeup assisting apparatus according to claim 1, wherein the makeup selecting section selects makeup based on a change in a skin condition of the face.
- The makeup assisting apparatus according to claim 1, wherein the makeup selecting section selects the makeup and/or corrects a color of the selected makeup based on at least one of a color of clothes, a color of the skin and a color of the hair of a subject whose face is subjected to the makeup.
- The makeup assisting apparatus according to claim 6, wherein the makeup selecting section selects the skin care based on a change in a skin condition of the face.
- A skin-attachment sheet serving as the sheet used for the makeup assisting apparatus according to claim 2, the skin-attachment sheet comprising:a protection layer that is provided on a surface on a side of the skin-attachment sheet that is opposite to a side of the skin-attachment sheet where the sheet is to be closely attached to the skin, and that is capable of being peeled off from the surface; anda mount that is provided on the surface on the side of the skin-attachment sheet where the sheet is to be closely attached to the skin, and that is capable of being peeled off from the surface, whereinthe skin-attachment sheet is supplied to the printer after the protection layer is peeled off.
- The skin-attachment sheet according to claim 14, wherein a basic cosmetic material having an ultraviolet-ray cutting function is held on the surface on the side of the skin-attachment sheet where the sheet is to be closely attached to the skin.
- A makeup assisting method comprising:selecting makeup for each face, the makeup being a way of applying makeup, the face being subjected to the makeup; andcausing pigment corresponding to the selected makeup to be held on a surface on a side of a sheet closely attachable to a skin of the face for a long time, the side being opposite to a side of the sheet where the sheet is to be closely attached to the skin.
- A makeup assisting program causing a computer to execute processing comprising:selecting makeup for each face, the makeup being a way of applying makeup, the face being subjected to the makeup; andcausing pigment corresponding to the selected makeup to be held on a surface on a side of a sheet closely attachable to a skin of the face for a long time, the side being opposite to a side of the sheet where the sheet is to be closely attachable to the skin.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP18166330.3A EP3363321A1 (en) | 2013-03-22 | 2014-02-04 | Makeup support device, makeup support method, and makeup support program |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2013059801A JP5372275B1 (en) | 2013-03-22 | 2013-03-22 | Makeup support device, makeup support method, and makeup support program |
PCT/JP2014/000584 WO2014147938A1 (en) | 2013-03-22 | 2014-02-04 | Makeup support device, makeup support method, and makeup support program |
Related Child Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP18166330.3A Division-Into EP3363321A1 (en) | 2013-03-22 | 2014-02-04 | Makeup support device, makeup support method, and makeup support program |
EP18166330.3A Division EP3363321A1 (en) | 2013-03-22 | 2014-02-04 | Makeup support device, makeup support method, and makeup support program |
Publications (3)
Publication Number | Publication Date |
---|---|
EP2976963A1 true EP2976963A1 (en) | 2016-01-27 |
EP2976963A4 EP2976963A4 (en) | 2016-04-06 |
EP2976963B1 EP2976963B1 (en) | 2018-10-17 |
Family
ID=49954916
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP14767708.2A Active EP2976963B1 (en) | 2013-03-22 | 2014-02-04 | Makeup support device, makeup support method, and makeup support program |
EP18166330.3A Ceased EP3363321A1 (en) | 2013-03-22 | 2014-02-04 | Makeup support device, makeup support method, and makeup support program |
Family Applications After (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP18166330.3A Ceased EP3363321A1 (en) | 2013-03-22 | 2014-02-04 | Makeup support device, makeup support method, and makeup support program |
Country Status (5)
Country | Link |
---|---|
US (2) | US10342316B2 (en) |
EP (2) | EP2976963B1 (en) |
JP (1) | JP5372275B1 (en) |
CN (2) | CN105188467B (en) |
WO (1) | WO2014147938A1 (en) |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP3479729A4 (en) * | 2016-06-29 | 2019-07-10 | Panasonic Intellectual Property Management Co., Ltd. | Image processing device and image processing method |
EP3530142A4 (en) * | 2016-10-24 | 2019-10-30 | Panasonic Intellectual Property Management Co., Ltd. | Image processing device, image processing method, and image processing program |
EP3520648A4 (en) * | 2016-09-27 | 2020-01-01 | Panasonic Intellectual Property Management Co., Ltd. | Thin film and thin film formation method |
Families Citing this family (34)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP6288404B2 (en) | 2013-02-28 | 2018-03-07 | パナソニックIpマネジメント株式会社 | Makeup support device, makeup support method, and makeup support program |
FR3015872B1 (en) * | 2013-12-27 | 2017-03-24 | Oreal | MAKE-UP DEVICE COMPRISING A PLURALITY OF COSMETIC INKS |
FR3015888B1 (en) * | 2013-12-27 | 2017-03-31 | Oreal | DEVICE FOR MAKE-UP BY TRANSFERRING KERATINIC MATERIALS |
CN104921959B (en) | 2014-03-18 | 2020-03-06 | 松下知识产权经营株式会社 | Method for producing sheet for skin adhesion, method for beautifying skin, and sheet for skin adhesion |
US9760762B2 (en) * | 2014-11-03 | 2017-09-12 | Anastasia Soare | Facial structural shaping |
CN106998885B (en) | 2014-12-02 | 2021-02-09 | 欧莱雅 | System for dispensing cosmetic products |
KR102005648B1 (en) | 2014-12-02 | 2019-07-30 | 로레알 | Dispensing system having at least two outlet interfaces |
US10849406B2 (en) | 2014-12-02 | 2020-12-01 | L'oreal | System for dispensing at least one makeup product and method for dispensing and evaluating makeup |
FR3029090B1 (en) | 2014-12-02 | 2018-04-06 | L'oreal | ASSEMBLY COMPRISING A AIRBRUSH |
KR102118247B1 (en) * | 2014-12-02 | 2020-06-09 | 로레알 | Dispensing system for delivering a mixture of variable colour |
JP6607343B2 (en) * | 2015-03-30 | 2019-11-20 | パナソニックIpマネジメント株式会社 | Printing apparatus and method for manufacturing thin-film printed body |
KR101867564B1 (en) * | 2015-12-29 | 2018-07-17 | 엘리셀 주식회사 | method and apparatus of manufacturing personalized mask-pack |
ES2930457T3 (en) * | 2016-02-15 | 2022-12-13 | Prinker Korea Inc | Image supply method |
JP6655789B2 (en) * | 2016-03-08 | 2020-02-26 | パナソニックIpマネジメント株式会社 | Image processing apparatus and image processing method |
CN109195481B (en) * | 2016-06-30 | 2021-06-01 | 松下知识产权经营株式会社 | Image processing apparatus and image processing method |
KR101923420B1 (en) * | 2017-04-03 | 2019-02-27 | (주)아모레퍼시픽 | Manufacturing apparatus and method for customized mask pack |
US10912372B2 (en) | 2017-05-16 | 2021-02-09 | Anastasia Beverly Hills, Llc | Facial stencils |
EP3646755A4 (en) * | 2017-06-29 | 2020-05-13 | Panasonic Intellectual Property Management Co., Ltd. | Sheet, image processing device, and image processing method |
CN109426767A (en) * | 2017-08-24 | 2019-03-05 | 丽宝大数据股份有限公司 | Informer describes guidance device and its method |
JP2019115653A (en) * | 2017-12-26 | 2019-07-18 | パナソニックIpマネジメント株式会社 | Body appearance correction support method and device, and computer program |
KR101951235B1 (en) * | 2018-01-02 | 2019-02-22 | (주)아모레퍼시픽 | Customized skin care pack, customized skin care pack package and manufacturing system and method for customized skin care pack |
US11191341B2 (en) * | 2018-01-11 | 2021-12-07 | Casio Computer Co., Ltd. | Notification device, notification method, and storage medium having program stored therein |
KR102006789B1 (en) * | 2018-03-13 | 2019-08-02 | 김예지 | Skin attached filler patch |
US20190380473A1 (en) | 2018-06-19 | 2019-12-19 | Summer Proctor | Beauty Applicator Systems and Related Methods |
CN112533510B (en) * | 2018-10-07 | 2024-06-04 | 宝洁公司 | Method of making an applicator with precision eye opening |
JP7024695B2 (en) * | 2018-11-27 | 2022-02-24 | カシオ計算機株式会社 | Coating equipment and coating system |
JP7398750B2 (en) * | 2019-02-28 | 2023-12-15 | パナソニックIpマネジメント株式会社 | Image processing device, image processing method and sheet |
US12096838B2 (en) | 2019-10-07 | 2024-09-24 | The Procter & Gamble Company | Method of making applicator with precision eye opening |
EP4128194A1 (en) | 2020-03-31 | 2023-02-08 | Snap Inc. | Augmented reality beauty product tutorials |
CN111489311B (en) * | 2020-04-09 | 2023-08-08 | 北京百度网讯科技有限公司 | Face beautifying method and device, electronic equipment and storage medium |
CN111602950B (en) * | 2020-06-09 | 2023-05-09 | 京东方科技集团股份有限公司 | Cosmetic paper, automatic cosmetic device and method |
US11849829B2 (en) * | 2021-01-29 | 2023-12-26 | L'oreal | Remote beauty consultation system |
KR20220145116A (en) * | 2021-04-21 | 2022-10-28 | 프링커코리아 주식회사 | Apparatus and method for providing user-customized color cosmetic print media |
CN113427486B (en) * | 2021-06-18 | 2022-10-28 | 上海非夕机器人科技有限公司 | Mechanical arm control method and device, computer equipment, storage medium and mechanical arm |
Family Cites Families (34)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4554635B1 (en) * | 1982-07-28 | 1995-10-03 | Technology Inc Const | Method and apparatus for marking or cutting laminar patterns or forms |
JPH11169231A (en) * | 1997-12-16 | 1999-06-29 | Ryuichi Utsuki | Makeup method, makeup device used for this method, and makeup transfer film |
US6437866B1 (en) * | 1999-07-07 | 2002-08-20 | Fd Management, Inc. | System for assisting customers in selecting an optimum color cosmetic product |
JP2001104050A (en) * | 1999-10-06 | 2001-04-17 | Seiko Epson Corp | Makeup support method using image processing, dressing table, and recording medium having makeup support processing program using image processing recorded |
JP3582458B2 (en) | 2000-06-07 | 2004-10-27 | 花王株式会社 | Makeup advice system |
JP3779570B2 (en) | 2001-07-30 | 2006-05-31 | デジタルファッション株式会社 | Makeup simulation apparatus, makeup simulation control method, and computer-readable recording medium recording makeup simulation program |
JP2004034304A (en) * | 2002-06-28 | 2004-02-05 | Malay Kk | Label for body adornment |
JP2006312601A (en) * | 2005-05-09 | 2006-11-16 | Nitto Denko Corp | Cosmetic sheet |
KR101290510B1 (en) * | 2005-09-27 | 2013-07-26 | 우베 고산 가부시키가이샤 | Polyamide porous spherical particle |
JP4809056B2 (en) | 2005-12-28 | 2011-11-02 | 株式会社 資生堂 | Face classification device for cheek makeup, face classification program, and recording medium on which the program is recorded |
US8107672B2 (en) | 2006-01-17 | 2012-01-31 | Shiseido Company, Ltd. | Makeup simulation system, makeup simulator, makeup simulation method, and makeup simulation program |
CN101095564A (en) * | 2006-06-27 | 2008-01-02 | 朱鼎亮 | Full-area quick making-up face pack and method for preparing the same |
KR100708319B1 (en) * | 2006-09-18 | 2007-04-18 | 아람휴비스(주) | A method for providing customized cosmetics and the system used therefor |
RU2457827C2 (en) * | 2007-09-28 | 2012-08-10 | Казки Интернэшнл Корпорейшн | Makeup-facilitating overlay and method of makeup with overlay application |
US8425477B2 (en) | 2008-09-16 | 2013-04-23 | Elc Management Llc | Method and system for providing targeted and individualized delivery of cosmetic actives |
TW201212852A (en) * | 2010-09-21 | 2012-04-01 | Zong Jing Investment Inc | Facial cosmetic machine |
JP2012086475A (en) | 2010-10-20 | 2012-05-10 | Hitachi Chemical Co Ltd | Thin-film transfer material, method for manufacturing the same, molding with thin film, and method for manufacturing the same |
JP5267550B2 (en) * | 2010-12-28 | 2013-08-21 | カシオ計算機株式会社 | Nail printing apparatus and printing control method |
US8746820B2 (en) | 2010-11-04 | 2014-06-10 | Casio Computer Co., Ltd. | Nail print apparatus and print controlling method |
JP2012181688A (en) * | 2011-03-01 | 2012-09-20 | Sony Corp | Information processing device, information processing method, information processing system, and program |
JP2012203425A (en) | 2011-03-23 | 2012-10-22 | Seiko Epson Corp | Image processing apparatus, image processing method and printing device |
EP2836187B1 (en) * | 2012-04-11 | 2021-12-08 | L'Oréal | Self-standing cosmetic sheet |
JP5553094B2 (en) | 2012-08-22 | 2014-07-16 | セイコーエプソン株式会社 | Recording method and recorded matter |
JP5991536B2 (en) | 2013-02-01 | 2016-09-14 | パナソニックIpマネジメント株式会社 | Makeup support device, makeup support method, and makeup support program |
JP6008323B2 (en) | 2013-02-01 | 2016-10-19 | パナソニックIpマネジメント株式会社 | Makeup support device, makeup support method, and makeup support program |
US10321747B2 (en) | 2013-02-01 | 2019-06-18 | Panasonic Intellectual Property Management Co., Ltd. | Makeup assistance device, makeup assistance system, makeup assistance method, and makeup assistance program |
JP6132232B2 (en) | 2013-02-01 | 2017-05-24 | パナソニックIpマネジメント株式会社 | Makeup support device, makeup support system, and makeup support method |
JP6128309B2 (en) | 2013-02-01 | 2017-05-17 | パナソニックIpマネジメント株式会社 | Makeup support device, makeup support method, and makeup support program |
JP6288404B2 (en) | 2013-02-28 | 2018-03-07 | パナソニックIpマネジメント株式会社 | Makeup support device, makeup support method, and makeup support program |
JP5372276B1 (en) | 2013-03-22 | 2013-12-18 | パナソニック株式会社 | Makeup support device, makeup support method, and makeup support program |
WO2015029372A1 (en) | 2013-08-30 | 2015-03-05 | パナソニックIpマネジメント株式会社 | Makeup assistance device, makeup assistance system, makeup assistance method, and makeup assistance program |
JP6435516B2 (en) | 2013-08-30 | 2018-12-12 | パナソニックIpマネジメント株式会社 | Makeup support device, makeup support method, and makeup support program |
CN104798101B (en) | 2013-08-30 | 2018-11-23 | 松下知识产权经营株式会社 | Makeup auxiliary device, cosmetic auxiliary method and makeup auxiliary program |
JP6331515B2 (en) | 2014-03-13 | 2018-05-30 | パナソニックIpマネジメント株式会社 | Makeup support device and makeup support method |
-
2013
- 2013-03-22 JP JP2013059801A patent/JP5372275B1/en active Active
-
2014
- 2014-02-04 CN CN201480016479.6A patent/CN105188467B/en active Active
- 2014-02-04 WO PCT/JP2014/000584 patent/WO2014147938A1/en active Application Filing
- 2014-02-04 CN CN201910159320.4A patent/CN109875229B/en active Active
- 2014-02-04 EP EP14767708.2A patent/EP2976963B1/en active Active
- 2014-02-04 EP EP18166330.3A patent/EP3363321A1/en not_active Ceased
- 2014-02-04 US US14/773,476 patent/US10342316B2/en active Active
-
2019
- 2019-01-18 US US16/252,134 patent/US10413042B2/en active Active
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP3479729A4 (en) * | 2016-06-29 | 2019-07-10 | Panasonic Intellectual Property Management Co., Ltd. | Image processing device and image processing method |
EP3520648A4 (en) * | 2016-09-27 | 2020-01-01 | Panasonic Intellectual Property Management Co., Ltd. | Thin film and thin film formation method |
EP3530142A4 (en) * | 2016-10-24 | 2019-10-30 | Panasonic Intellectual Property Management Co., Ltd. | Image processing device, image processing method, and image processing program |
US10789748B2 (en) | 2016-10-24 | 2020-09-29 | Panasonic Intellectual Property Management Co., Ltd. | Image processing device, image processing method, and non-transitory computer-readable recording medium storing image processing program |
Also Published As
Publication number | Publication date |
---|---|
US10413042B2 (en) | 2019-09-17 |
JP2014185089A (en) | 2014-10-02 |
WO2014147938A1 (en) | 2014-09-25 |
US10342316B2 (en) | 2019-07-09 |
EP2976963A4 (en) | 2016-04-06 |
US20190150595A1 (en) | 2019-05-23 |
JP5372275B1 (en) | 2013-12-18 |
CN105188467B (en) | 2019-03-29 |
CN109875229B (en) | 2022-03-11 |
CN105188467A (en) | 2015-12-23 |
CN109875229A (en) | 2019-06-14 |
US20160022014A1 (en) | 2016-01-28 |
EP2976963B1 (en) | 2018-10-17 |
EP3363321A1 (en) | 2018-08-22 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US10413042B2 (en) | Makeup support device, makeup support method, and makeup support program | |
US10010155B2 (en) | Makeup support device, makeup support method, and makeup support program | |
EP2820970B1 (en) | Makeup application assistance device, makeup application assistance method, and makeup application assistance program | |
CN104205162B (en) | Cosmetic servicing unit and cosmetic auxiliary method | |
RU2367577C1 (en) | System and method for application of substance that varies its reflecting property in order to improve visual attractiveness of human skin | |
JP6868847B2 (en) | Image processing device and image processing method | |
EP2962597A1 (en) | Makeup assistance device, makeup assistance method, and makeup assistance program | |
EP3216370B1 (en) | Image processing apparatus, printer apparatus, and image processing method | |
US10567599B2 (en) | Image processing apparatus and method for processing image | |
JP6722866B2 (en) | Image processing apparatus and image processing method | |
KR102118099B1 (en) | Device for skin diagnosis and analysis of face, neck, scalp, and hair | |
US20190192389A1 (en) | Thin film and thin film forming method | |
CN111356383A (en) | Body appearance correction support device, body appearance correction support method, and program | |
JP2008289872A (en) | Device including lens array | |
JP6132248B2 (en) | Makeup support device |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
17P | Request for examination filed |
Effective date: 20150917 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
AX | Request for extension of the european patent |
Extension state: BA ME |
|
A4 | Supplementary search report drawn up and despatched |
Effective date: 20160308 |
|
RIC1 | Information provided on ipc code assigned before grant |
Ipc: A45D 44/00 20060101AFI20160302BHEP |
|
DAX | Request for extension of the european patent (deleted) | ||
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: GRANT OF PATENT IS INTENDED |
|
INTG | Intention to grant announced |
Effective date: 20171219 |
|
GRAJ | Information related to disapproval of communication of intention to grant by the applicant or resumption of examination proceedings by the epo deleted |
Free format text: ORIGINAL CODE: EPIDOSDIGR1 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE |
|
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: GRANT OF PATENT IS INTENDED |
|
INTC | Intention to grant announced (deleted) | ||
INTG | Intention to grant announced |
Effective date: 20180522 |
|
GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE PATENT HAS BEEN GRANTED |
|
AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: EP |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: FG4D |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R096 Ref document number: 602014034295 Country of ref document: DE Ref country code: AT Ref legal event code: REF Ref document number: 1052952 Country of ref document: AT Kind code of ref document: T Effective date: 20181115 |
|
REG | Reference to a national code |
Ref country code: NL Ref legal event code: MP Effective date: 20181017 |
|
REG | Reference to a national code |
Ref country code: LT Ref legal event code: MG4D |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: MK05 Ref document number: 1052952 Country of ref document: AT Kind code of ref document: T Effective date: 20181017 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: NL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20181017 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LV Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20181017 Ref country code: FI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20181017 Ref country code: NO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190117 Ref country code: PL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20181017 Ref country code: BG Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190117 Ref country code: HR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20181017 Ref country code: AT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20181017 Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190217 Ref country code: ES Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20181017 Ref country code: LT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20181017 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20181017 Ref country code: PT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190217 Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20190118 Ref country code: RS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20181017 Ref country code: AL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20181017 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R097 Ref document number: 602014034295 Country of ref document: DE |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CZ Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20181017 Ref country code: IT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20181017 Ref country code: DK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20181017 |
|
PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SM Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20181017 Ref country code: EE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20181017 Ref country code: SK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20181017 Ref country code: RO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20181017 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R119 Ref document number: 602014034295 Country of ref document: DE |
|
26N | No opposition filed |
Effective date: 20190718 |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: PL |
|
GBPC | Gb: european patent ceased through non-payment of renewal fee |
Effective date: 20190204 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20181017 Ref country code: MC Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20181017 Ref country code: LU Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20190204 |
|
REG | Reference to a national code |
Ref country code: BE Ref legal event code: MM Effective date: 20190228 |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: MM4A |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CH Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20190228 Ref country code: LI Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20190228 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20190204 Ref country code: DE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20190903 Ref country code: GB Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20190204 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: BE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20190228 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: TR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20181017 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MT Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20190204 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CY Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20181017 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: HU Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO Effective date: 20140204 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20181017 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: FR Payment date: 20230221 Year of fee payment: 10 |