TWI421781B - Make-up simulation system, make-up simulation method, make-up simulation method and make-up simulation program - Google Patents

Description

Makeup simulation system, makeup simulation device, makeup simulation method, and makeup simulation program Technical field

The present invention relates to a makeup simulation system, a makeup simulation device, a makeup simulation method, and a makeup simulation program, and more particularly to a makeup simulation system, a makeup simulation device, and a makeup simulation that can perform makeup on a user's face included in a moving image. Method and makeup simulation program.

Background technique

In the past, a technique for simulating a face after makeup on a computer without actually applying makeup has been known (for example, see Patent Document 1). However, in Patent Document 1, since the simulation result is displayed on a still screen, it is not possible to easily confirm the face when the user's expression after makeup is changed. Therefore, techniques for simulating makeup in a moving image capable of capturing changes in user expression have been developed (for example, refer to Patent Document 2).

However, the makeup simulation device disclosed in Patent Document 2 is specified in the pixel field corresponding to the user's expression change and the mouth portion and the two eyes, and the pixel field is tracked by template matching, and the makeup field for performing face makeup is calculated. (See, for example, paragraph [0028]). In this way, when the user's expression changes and the pixel area corresponding to the mouth and the two eyes is tracked, there is a problem that the computer processing load is large and it is difficult to perform correct correspondence processing when the eyes are closed.

[Patent Document 1] Japanese Patent Laid-Open Publication No. 2001-346627 [Patent Document 2] Japanese Patent Laid-Open Publication No. 2003-44837

The present invention has been made in view of the above problems, and an object of the present invention is to provide a makeup simulation system, a makeup simulation device, and a makeup that can accurately perform makeup on a user's face included in a moving image when the processing load is small. Simulation method and makeup simulation program.

In order to solve the above problems, the present invention provides a makeup simulation system capable of applying makeup to a moving image after a user's face is photographed, which is characterized in that: a photographing mechanism is provided, which is capable of photographing a user's face and outputting a moving image. a control mechanism capable of receiving a dynamic image outputted from the photographing mechanism and performing image processing on the moving image and outputting the image; and a display mechanism capable of displaying a dynamic image outputted from the control mechanism, and the control mechanism The method further includes: a face recognition processing mechanism for identifying a user's face from the motion image according to a predetermined tracking point; and a makeup processing mechanism for performing predetermined makeup on the user's face included in the motion image according to the tracking point And output to the aforementioned display mechanism.

In the present invention, by providing a face recognition processing mechanism, the user's face is recognized from the motion image according to a predetermined tracking point; and the makeup processing mechanism is a user face included in the motion image according to the tracking point. The part performs predetermined makeup and outputs to the display mechanism; and in the case where the processing load is small, the user's face is recognized from the motion image according to the predetermined tracking point, and the user included in the motion image is correctly based on the tracking point. Apply makeup to the face.

Further, any combination of the constituent elements, expressions, or constituent elements of the present invention can be applied to a method, an apparatus, a system, a computer program, a recording medium, a data structure, etc., as an effective form of the present invention.

According to the present invention, it is possible to provide a makeup simulation system, a makeup simulation device, a makeup simulation method, and a makeup simulation program that can accurately apply makeup to a user's face included in a moving image when the processing load is small.

Simple description of the schema

Fig. 1 is an external view showing a first embodiment of the makeup simulation device of the present invention.

Fig. 2 is a cross-sectional view showing a first embodiment of the makeup simulation device.

Fig. 3 is an external view showing a second embodiment of the makeup simulation device of the present invention.

Fig. 4 is a cross-sectional view showing a second embodiment of the makeup simulation device.

Fig. 5 is an external view showing a third embodiment of the makeup simulation device of the present invention.

Fig. 6 is a cross-sectional view showing a third embodiment of the makeup simulation device.

Fig. 7 is an external view showing a fourth embodiment of the makeup simulation device of the present invention.

Fig. 8 is a cross-sectional view showing a fourth embodiment of the makeup simulation device.

Fig. 9 is an external view showing a fifth embodiment of the makeup simulation device of the present invention.

Fig. 10 is a cross-sectional view showing a fifth embodiment of the makeup simulation device.

Fig. 11 is a view showing a hardware configuration of a fifth embodiment of the makeup simulation device.

Fig. 12 is a flow chart showing an outline of processing performed by the makeup simulation device.

Fig. 13 is an image diagram showing an example of the main screen of the display and the operation screen displayed on the operation panel.

Fig. 14 is a view showing an image of a process other than makeup simulation performed by the makeup simulation device.

Figure 15 is a system configuration diagram of one embodiment of the makeup simulation system of the present invention.

Figure 16 is a screen image showing the processing performed by the main application.

Figure 17 is an image of the user's face contained in the pre-makeup image.

Fig. 18 is an image diagram showing an example of a tracking point.

Fig. 19 is a configuration diagram showing an example of a makeup processing parameter file.

Figure 20 shows an image of the tracking point to which the lipstick treatment is referred.

Fig. 21 is a flow chart showing an example of lipstick treatment.

Fig. 22 is a view showing an image of an example of the contour acquisition processing.

Fig. 23 is a point at which the contour of the contour acquisition image 600 is 8 points and the nose is 3 points, and the contour acquisition image 601 is obtained by re-searching based on the 8 points of the lip and the 3 points of the nose. Comparison screen.

Fig. 24 is an image diagram showing an example of a process of obtaining a preset point from a tracking point of 8 points of the lip and 3 points of the nose.

Fig. 25 is an image diagram showing the processing of the contour according to the point or the preset point.

Fig. 26 is a view showing an image of an example of the generation process of the color map.

Fig. 27 is a view showing an image of an example of coloring processing according to a color map.

Figure 28 shows an image of the tracking point to which the eye shadow processing is referred.

Fig. 29 is a flow chart showing an example of eye shadow processing.

Fig. 30 is a view showing an image of an example of basic contour generation processing.

Fig. 31 is a view showing an example of a process of generating a color outline.

Fig. 32 is a view showing an image of a color map which has not been subjected to the desalination process and a color map which has been subjected to the desalination process.

Figure 33 shows an image of the tracking point referenced by the cheek processing.

Figure 34 is a flow chart showing an example of cheek processing.

Fig. 35 is an image diagram showing an example of a colored outline.

Figure 36 shows an image of the tracking point referenced by the eyebrow processing.

Fig. 37 is a flow chart showing an example of the eyebrow processing.

Fig. 38 is a view showing an image of an example of the eyebrow contour acquisition processing.

Fig. 39 is a view showing an image of an example of the process of creating an indication curve corresponding to the change designation.

Figure 40 shows an image of the tracking point referenced by the foundation treatment.

Fig. 41 is a flow chart showing an example of foundation treatment.

Fig. 42 is an image screen showing an example of a contour.

Fig. 43 is a view showing an image of an original image before the desalination process and an original image after the desalination process.

The best form of implementing the invention

Next, the best mode for carrying out the invention will be explained one by one according to the following embodiments and with reference to the drawings. Fig. 1 is an external view showing a first embodiment of the makeup simulation device of the present invention. The makeup simulation device 1 includes a camera 2, an operation panel 4, a printer 5, an illumination 6, and a display 7.

The camera 2 can photograph a user standing in front of the makeup simulation device 1 and output a moving image. The operation panel 4 can display an operation image and output operation information after receiving the user's operation. The printer 5 can print images displayed on the display (such as image frames after makeup) and information (such as product information for making up an image). Illumination 6 can adjust the luminosity as soon as the simulation begins.

Fig. 2 is a cross-sectional view showing a first embodiment of the makeup simulation device. The makeup simulation device 1 includes a camera 2, an operation panel 4, a printer 5, a display 7, and a control unit 8.

The camera 2 can output the captured motion picture to the control unit 8. The operation panel 4 can display an operation screen output from the control unit 8, and output the operation information to the control unit 8 after receiving the user's operation. The printer 5 can print images and information output from the control unit 8. The display 7 can display a moving image (main image) output from the control unit 8. The control unit 8 can receive the moving image output from the camera 2, and perform image processing to be described later on the moving image to apply makeup to the user's face included in the moving image and output it to the display 7.

The makeup simulation device 1 of Fig. 1 and Fig. 2 is a concept of a mirror portion of an item that is indispensable for makeup, and has a function of interaction with a user. That is, the makeup simulation device 1 has a feature that allows the user to feel natural makeup like a mirror.

The makeup simulation device 1 performs image processing on the moving image or the like output from the camera 2 by the control unit 8, and applies makeup to the user's face included in the moving image, and displays it on the display 7 as a digital mirror unit. The makeup simulation device 1 can display various product information, beauty information, and an image screen after makeup of the user's face on the display 7.

Further, Fig. 3 is an external view of a second embodiment of the makeup simulation device of the present invention. Also, the same components are attached to the same portions as those in Fig. 1.

The makeup simulation device 1 of Fig. 3 includes an operation panel 4, a printer 5, an illumination 6, and a transparent plate 9. The transparent plate 9 is transmissive to light from the outside of the makeup simulation device 1 and transmitted through the light from the inside of the makeup simulation device 1.

Fig. 4 is a cross-sectional view showing a second embodiment of the makeup simulation device. Also, the same components are attached to the same portions as those in Fig. 2. The makeup simulation device 1 of Fig. 4 includes a camera 2, a half mirror 3, an operation panel 4, a printer 5, a display 7, a control unit 8, and a transparent plate 9.

A half mirror (translucent mirror) 3 reflects the illumination and transmits a portion of the illumination. The camera 2 is disposed at a position where the user standing in front of the makeup simulation device 1 can be photographed through the half mirror 3 and the transparent plate 9, and the camera 2 is set at the line of sight of the user. The camera 2 can photograph a user standing in front of the makeup simulation device 1 through the half mirror 3 and the transparent plate 9, and output a moving image.

The display 7 is disposed at a position where the user standing in front of the makeup simulation device 1 can be seen through the half mirror 3 and the transparent plate 9. The light output from the display 7 is reflected by the half mirror 3, and is output to the outside of the makeup simulation device 1 through the transparent plate 9. Therefore, the user can see the moving image displayed on the display 7 from the outside of the makeup simulation device 1.

The makeup simulation device 1 of Figs. 3 and 4 is a concept of a mirror portion of an item that is indispensable for makeup, and has a function of interaction with a user. That is, the makeup simulation device 1 has a feature that allows the user to feel natural makeup like a mirror.

Since the makeup simulation device 1 sets the camera 2 at the position of the line of sight height, the face of the user standing in front of the makeup simulation device 1 can be more naturally photographed than the position of the camera 2 of the first embodiment.

The makeup simulation device 1 performs image processing on the moving image or the like output from the camera 2 by the control unit 8, and applies makeup to the user's face included in the moving image, and displays it on the display 7 as a digital mirror unit. The makeup simulation device 1 can display various product information, beauty information, and an image screen after makeup of the user's face on the display 7.

Further, Fig. 5 is an external view showing a third embodiment of the makeup simulation device of the present invention. Also, the same components are attached to the same parts as in the previous figures. The makeup simulation device 1 of Fig. 5 includes a camera 2, a half mirror 3, an operation panel 4, a printer 5, and an illumination 6.

The half mirror 3 can transmit a portion of the light from the light (e.g., 50%) and can reflect the rest (e.g., 50%) directly in front of it. Since there is no light in the dark, the half mirror 3 neither transmits nor reflects light from the dark.

After the start of the makeup simulation, the illumination 6 adjusts the illuminance to brighten the display 7 side of the half mirror 3. Therefore, the half mirror 3 provided on the display direction side of the display 7 reflects the light from the user side (the outside of the makeup simulation device 1) before the makeup simulation starts, and functions as a mirror portion.

The half mirror 3 transmits the light from the side of the display 7 (inside the makeup simulation device 1) after the start of the makeup simulation, and functions as a glass. Therefore, the user can see the moving image displayed on the display 7 through the half mirror 3.

Fig. 6 is a cross-sectional view showing a third embodiment of the makeup simulation device. The makeup simulation device 1 of Fig. 6 includes a camera 2, a half mirror 3, an operation panel 4, a printer 5, a display 7, and a control unit 8. Also, the same components are attached to the same parts as in the previous figures. The moving image displayed on the display 7 is transmitted through the half mirror 3 which functions as a glass function, and the user can see the moving image displayed on the display 7 from the outside of the makeup simulation device 1.

The makeup simulation device 1 of Figs. 5 and 6 is a concept of a mirror portion of an item that is indispensable for makeup, and has a function of interaction with a user. That is, the makeup simulation device 1 has a feature that allows the user to feel natural makeup like a mirror.

The makeup simulation device 1 performs image processing on the moving image or the like output from the camera 2 by the control unit 8, and applies makeup to the user's face included in the moving image, and displays it on the display 7 as a digital mirror unit. The makeup simulation device 1 can display various product information, beauty information, and an image screen after makeup of the user's face on the display 7.

Further, Fig. 7 is an external view of a fourth embodiment of the makeup simulation device of the present invention. Fig. 8 is a cross-sectional view showing a fourth embodiment of the makeup simulation device. Also, the same components are attached to the same parts as in the previous figures. The makeup simulation device 1 includes a camera 2, a printer 5, an illumination 6, and a touch panel display 15.

The makeup simulation device 1 of FIGS. 7 and 8 is different from the makeup simulation device 1 of FIGS. 1 and 2 in that the touch panel display 15 is used instead of the operation panel 4 and the display 7. The touch panel display 15 functions as the operation panel 4 and the display 7.

The touch panel display 15 can display an operation image and output operation information after receiving the user's operation. The touch panel display 15 can display an operation image outputted from the control unit 8, and output the operation information to the control unit 8 after receiving the user's operation. The touch panel display 15 can display a moving image (main image) output from the control unit 8. The control unit 8 can receive the moving image output from the camera 2, and perform image processing to be described later on the moving image to apply makeup to the user's face included in the moving image and output it to the touch panel display 15.

The makeup simulation device 1 of Figs. 7 and 8 is a concept of a mirror portion of an item that is indispensable for makeup, and has a function of interaction with a user. That is, the makeup simulation device 1 has a feature that allows the user to feel natural makeup like a mirror.

The makeup simulation device 1 performs image processing on the moving image or the like output from the camera 2 by the control unit 8, and applies makeup to the user's face included in the moving image, and displays it on the touch panel display 15 as a digital mirror unit. . The makeup simulation device 1 can display various product information, beauty information, and an image screen after makeup of the user's face on the touch panel display 15.

As shown in FIGS. 9 and 10, the makeup simulation device 1 of the fourth embodiment may be provided with a display case in which a test product (hereinafter referred to as a test article) for display by a user is displayed, and is sold as a self-sale. Use with the frame. Fig. 9 is an external view showing a fifth embodiment of the makeup simulation device of the present invention. Figure 10 is a cross-sectional view showing a fifth embodiment of the makeup simulation device of the present invention. Also, the same components as the previous figures are attached with the same component symbols.

The makeup simulation device 1 includes a camera 2, a printer 5, an illumination 6, a touch panel display 15, a display case 16, and an IC tag reader/writer 17. The makeup simulation device 1 of Figs. 9 and 10 differs from the makeup simulation device 1 of Figs. 7 and 8 in that the display case 16 and the IC tag reader/writer 17 are included.

The display case 16 is a display of most test items. Also, the test article is accompanied by an IC (RFID) tag. The IC tag attached to the test article stores identification information for the identifiable test article. By the user taking out the test article from the display box 16 and bringing it closer to the IC tag reader/writer 17, the IC tag reader/writer 17 can read the identification information of the test article based on the IC tag.

The IC tag reader/writer 17 can transmit the identification information of the test article read from the IC tag to the control unit 8. The control unit 8 can receive the moving image output from the camera 2, and perform the image processing described later on the moving image, and use the test item corresponding to the identification information read from the IC tag to display the user of the moving image. The image of the face after makeup is output to the touch panel display 15.

Further, the correspondence table corresponding to the test article and the identification information may be provided in the makeup simulation device 1, or may be provided in another device that can be obtained from the makeup simulation device 1 through the network.

Further, the makeup simulation device 1 of Figs. 9 and 10 shows an example in which an IC tag is used for identifying a test article, but a bar code, a binary code, a label, or the like may be used. Furthermore, the makeup simulation device 1 of FIGS. 9 and 10 may also be provided with a structure for recognizing the removed test article (such as position recognition using a sensor such as a photo sensor) in the display case 16 in advance, and The display box 16 notifies the control unit 8.

The makeup simulation device 1 of Figs. 9 and 10 is a concept of a mirror portion of an item that is indispensable for makeup, and has a function of interaction with a user. That is, the makeup simulation device 1 has a feature that allows the user to feel natural makeup like a mirror.

The makeup simulation device 1 performs image processing on the moving image or the like output from the camera 2 by the control unit 8, and uses the test item selected from the display case 16 to perform makeup on the face of the user included in the moving image. The screen is displayed on the touch panel display 15 as a digital mirror. The makeup simulation device 1 can display various product information, beauty information, and an image screen after makeup of the user's face on the touch panel display 15. By the user acquiring the label of the test article selected from the display box 16, the makeup simulation device 1 can acquire information such as the user's preference.

Moreover, if the makeup simulation device 1 capable of displaying a shelf such as a test article and a product is provided, the product displayed on the touch panel display 15 in advance on the shelf can be effectively used as a self-sale frame. use.

Hereinafter, the makeup simulation device 1 of the first embodiment will be described as an example. Fig. 11 is a hardware configuration diagram of one embodiment of a makeup simulation device. In addition, the same component symbols are attached to the same portions as those of the first and second figures.

The makeup simulation device 1 of FIG. 11 includes a camera 2, an operation panel 4, a printer 5, a display 7, an arithmetic processing device 10, a memory device 11, a drive device 12, and an auxiliary memory device 13 which are mutually connected via a bus bar B. . Further, the arithmetic processing unit 10, the memory unit 11, the drive unit 12, and the auxiliary memory unit 13 of Fig. 11 constitute the control unit 8 of Fig. 2 .

The makeup simulation program of the present invention can control at least a part of various programs of the makeup simulation device 1. The makeup simulation program is provided by a transmission such as the recording medium 14.

Further, the recording medium 14 on which the makeup simulation program is recorded can use a recording medium capable of optical, electrical or magnetic recording information such as a CD-ROM, a floppy disk, or an optical disk; and an electrical recording such as a ROM or a flash memory. Various types of recording media such as semiconductor memory of information.

Further, when the recording medium 14 on which the makeup simulation program is recorded is provided in the drive device 12, the makeup simulation program can be attached from the recording medium 14 to the auxiliary storage device 13 via the drive device 12. The auxiliary memory device 13 can store the installed makeup simulation program and store the required files, materials, and the like. The memory device 11 can read the makeup simulation program from the auxiliary memory device 13 at the time of startup and store it. Further, the arithmetic processing unit 10 can realize various processes to be described later in accordance with the makeup simulation program stored in the memory device 11.

Fig. 12 is a flow chart showing one embodiment of the outline of the processing performed by the makeup simulation device. Fig. 13 is an image diagram showing an example of the main screen of the display and the operation screen displayed on the operation panel. The screen images 100 to 111 of Fig. 13 are displayed on the main screen of the display 7. The screen images 200 to 210 are displayed on the operation screen of the operation panel 4.

The control unit 8 can continuously receive the moving image captured by the camera 2. At this time, the control unit 8 displays the screen image 100 on the display 7, and displays the screen image 200 on the operation panel 4. Screen images 100 and 200 are examples of screen protectors.

In step S1, the control unit 8 continues to determine whether the received moving image contains the user's face, and repeats the process of step S1 (No in S1) until the control unit 8 recognizes that the moving image contains the user's face.

When the recognized moving image contains the user's face (Yes in S1), the control unit 8 proceeds to step S2 and starts the software including the makeup simulation program for makeup simulation. At this time, the control unit 8 displays the screen image 101 on the display 7, and displays the screen image 201 on the operation panel 4.

The screen image 101 is an example in which a moving image of a user's face is captured by the camera 2. The screen image 201 is an example of a welcome comment showing a lateral movement.

Proceeding to step S3, the control unit 8 starts the makeup simulation based on the software started in step S2. At this time, the control unit 8 displays the screen image 102 on the display 7, and displays the screen image 202 on the operation panel 4. The screen image 102 is an example in which the camera 2 captures a moving image of the user's face and performs a magic mirror performance. The screen image 202 is an example of a welcome annotation that displays a lateral movement similarly to the screen image 201.

Proceeding to step S4, the control unit 8 performs makeup simulation as will be described later. At this time, the control unit 8 displays the screen images 103 to 106 in sequence on the display 7, and displays the screen images 203 to 206 on the operation panel 4.

The screen images 103 to 106 are examples in which a user's face of four types of makeup (images) is displayed by makeup simulation. The screen images 203 to 206 are examples in which the makeup type contents (such as names, etc.) appearing on the screen images 103 to 106 of the display 7 at this time are displayed. Before a predetermined time elapses or the user touches the operation panel 4, the control unit 8 sequentially displays the screen images 103 to 106 on the display 7, and displays the screen images 203 to 206 on the operation panel 4.

When the predetermined time elapses or the user touches the operation panel 4, the control unit 8 proceeds to step S5, displays the screen image 107 on the display 7, and displays the screen image 207 on the operation panel 4. Similarly to the screen image 101, the screen image 107 displays an example in which the camera 2 captures a moving image of the user's face. The screen image 207 is an example in which an image selection screen for selecting one type of image from among four types of makeup (images) is displayed. The user can select one type of image from the image selection screen by operating the operation panel 4.

Proceeding to step S6, the control unit 8 repeats the processing of step S6 (No at S6) before selecting one type of image from the image selection screen. When the user selects one type of image from the image selection screen, the operation panel 4 receives the user's operation and outputs the operation information to the control unit 8.

When it is determined that the user selects one type of video from the video selection screen (Yes in S6), the control unit 8 proceeds to step S7 and displays the video image of the selected video on the display 7 and the operation panel 4. At this time, the control unit 8 displays the screen image 108 on the display 7, and displays the screen image 208 on the operation panel 4.

The screen image 108 is an example of sequentially displaying an image screen of a user's face after performing makeup of a different color type and product information for making up an image screen based on one type of image selected from the image selection screen. The screen image 208 is an example of displaying one type of video content selected from the image selection screen and product information for making up the screen image 108 displayed on the display 7 at this time.

Further, the user can also instruct printing by operating the operation panel 4. Upon receiving the print instruction from the user, the control unit 8 displays the screen image 109 on the display 7, and displays the screen image 209 on the operation panel 4. The screen image 109 is an example of displaying a printed image screen. The screen image 209 is an example of an annotation in the printout. The control unit 8 can control the printer 5 and print the image screen displayed on the display 7.

Moreover, the user can also instruct the display and printing of the comparison screen composed of the image screens before and after the makeup by operating the operation panel 4. When receiving the display instruction of the comparison screen of the user, the control unit 8 displays the screen image 110 on the display 7. The screen image 110 is an example of displaying a comparison screen composed of image screens before and after makeup. When the user's print instruction is received while the comparison screen is displayed, the control unit 8 controls the printer 5 and prints the comparison screen displayed on the display 7.

When the makeup simulation of the user is completed, the control unit 8 displays the screen images 111 and 210 as screen protectors on the display 7 and the operation panel 4, and ends the processing.

Moreover, the examples of FIGS. 12 and 13 show four types of images by makeup simulation, but images of four types of images can also be displayed. Further, the makeup simulation device 1 displays an example in which the user's face included in the moving image output from the camera 2 is used for makeup. However, the moving image captured in advance may be previously recorded as a moving image file in the auxiliary storage device 13 or the like. Apply makeup to the user's face contained in the motion picture file.

The makeup simulation device 1 can also use the motion image output from the camera 2 in addition to the makeup simulation. Fig. 14 is a view showing an image of a process other than makeup simulation performed by the makeup simulation device.

The screen image 300 is an example of displaying a moving image of a user's face captured by the camera 2. The makeup simulation device 1 recognizes the face of the user included in the motion image and cuts out the still picture 301 of the user's face.

The makeup simulation device 1 can perform face diagnosis and skin color diagnosis of the still picture 301 by the face analysis logic and the skin analysis logic, and display the screen image 302 displaying the result on the display 7. Further, the face diagnosis and the skin color diagnosis of the still picture 301 by the face analysis logic and the skin analysis logic are disclosed in Japanese Laid-Open Patent Publication No. 2001-346627.

Further, the makeup simulation device 1 can also display a course selection screen 303 such as a screen image 303 on the display 7, and allows the user to select various courses (such as trend, basis, and freedom). The makeup simulation device 1 displays the screen images 304 to 309 on the display 7 based on the course selected by the user, and performs simulation and suggestion.

Screen images 304 to 306 are examples of simulation screens for each course. Screen images 307 to 309 are examples of suggested screens for each course.

For example, the foundation course represents the simulation and recommendation of the most appropriate makeup technique based on face diagnosis and skin color diagnosis results. In addition, the trend course represents simulations and recommendations for the latest trend makeup. In addition, the free makeup course represents simulations and suggestions for items corresponding to various parts of the eyes, mouth, cheeks, and eyebrows.

When receiving a print instruction from the user in a state where the simulation screen or the advice screen is displayed, the control unit 8 can also control the printer 5 to print the simulation screen or the advice screen displayed on the display 7.

Next, the makeup simulation system for realizing the aforementioned makeup simulation device 1 will be described in detail. Figure 15 is a system configuration diagram of one embodiment of the makeup simulation system of the present invention.

The makeup simulation system 20 of Fig. 15 includes an analog camera 21, a USB capture component 22, a motion picture file 23, a makeup camera 24, a still picture system 25, a motion picture file 26, a shared memory 27, and a simulator main application 28. And interface application 29.

The analog camera 21 outputs a moving image of, for example, an NTSC system, which is captured via the USB capture device 22. The motion picture output from the USB capture component 22 is input to the simulator main application 28 using DirectX31 as an example of an API (Application Interface). Further, the motion picture file 23 can also be input to the simulator main application 28 using DirectX31.

The makeup camera 24 outputs the captured moving image via the IEEE 1394 which is an example of the serial interface. The motion picture output from the makeup camera 24 is input to the simulator main application 28 using the dedicated API 32, and the simulator main application 28 can obtain the original image and still picture of the resolution for the motion image from the motion image input by the dedicated API 32. Still image with resolution.

The main application 28 of the simulator uses a moving image and a moving image file 23 input by DirectX31, and a moving image obtained by using the resolution of the moving image of the moving image input by the dedicated API 32 as the original image, and the original image is subjected to the original image. Trimming and reduction processing.

The simulator main application 28 trims the original image and obtains a pre-makeup image. Further, the simulator main application 28 performs reduction processing on the original image and obtains an image for face recognition processing. The face recognition processing unit 33 obtains the tracking point 34 for recognizing the face of the user, which will be described later, from the face recognition processing image by FFT (High Speed Fourier Transform).

The makeup processing unit 35 obtains a makeup image after makeup of the user's face contained in the pre-makeup image, such as foundation, eyebrow, eye shadow, lipstick, cheek, etc., based on the tracking point 34. The makeup processing unit 35 includes a foundation treatment unit 36, an eyebrow processing unit 37, an eye shadow processing unit 38, a lipstick processing unit 39, and a cheek processing unit 40.

Further, the makeup processing unit 35 can cause the post-makeup image to include the product information 41 for makeup as a post-makeup image. The motion image server 42 can write the pre-makeup image and the post-makeup image to the shared memory 27, and can also output the pre-makeup image and the post-makeup image as the motion image file 26.

The interface application 29 utilizes the ActiveX controller 50 and the ActiveX viewer 51 and includes a motion picture control object 52, a motion picture display object 53, and other controllers 54. Further, the interface application 29 and the simulator main application 28 are linked by ActiveX & Socket.

The interface application 29 can display the pre-makeup image and the post-makeup image written in the shared memory 27 on the display 7 by the ActiveX viewer 51.

The simulator main application 28 performs trimming and reduction processing on the still image for the still picture resolution obtained from the moving image input by the dedicated API 32. The simulator main application 28 trims the still image with a resolution for still images. Further, the simulator main application 28 performs a reduction process on the still image with a resolution for the still picture to obtain a face recognition processing image. The face recognition processing unit 43 obtains the tracking point 44 for recognizing the face of the user, which will be described later, from the face recognition processing image.

The simulator main application 28 obtains a detailed portion from the face of the user included in the corrected moving image based on the tracking point 44, and obtains additional information such as the type of face diagnosis and skin color diagnosis, skin color, etc. based on the detailed portion. The tracking point 45 to which the additional information is added to the tracking point 44, and the still image obtained by the resolution of the still picture obtained by the dedicated API 32 are output to the still picture system 25.

The still picture system 25 can use the tracking point 45 to perform face diagnosis and skin color diagnosis of the still image 301 by the face analysis logic and the skin analysis logic, and display the screen image 302 displaying the result on the display 7. Further, the still picture system 25 can also display the screen images 303 to 309 on the display 7.

Figure 16 is a screen image showing the processing performed by the main application. The screen image 400 is an example of displaying a pre-makeup image. The screen image 401 is an example in which the tracking point 34 obtained from the face recognition processing image is superimposed and displayed on the pre-makeup image. Further, the screen image 402 is an example of displaying a post-makeup image of the user's face makeup contained in the pre-makeup image based on the tracking point 34.

Hereinafter, the face recognition processing and the makeup processing among the processing performed by the simulator main application 28 will be described in detail with reference to the drawings. Further, in the present embodiment, the makeup treatment including the foundation treatment, the eyebrow treatment, the eye shadow treatment, the lipstick treatment, and the cheek treatment is described as an example of the makeup treatment, but other combinations may be employed.

(face recognition processing)

Figure 17 is an image of the user's face contained in the pre-makeup image. Fig. 18 is an image diagram showing an example of a tracking point. The face recognition processing unit 33 of the simulator main application 28 obtains the 45-point tracking point 34 for recognizing the user's face in Fig. 18 from the video screen of Fig. 17. The tracking point 34 of Fig. 18 is an example thereof, and may be adjusted in accordance with the processing capability of the control unit 8 or the fineness of the display 7.

In this way, by obtaining the tracking point 34 from the face of the user included in the pre-makeup image, the makeup processing unit 35 can preset the makeup mode or color to the makeup processing parameter file as shown in FIG. 19 corresponding to the tracking point 34. .

Fig. 19 is a configuration diagram showing an example of a makeup processing parameter file. The makeup processing parameter file of Fig. 19 sets the makeup performing mode or color in accordance with the eye, the mouth, the cheek, and the like in accordance with the tracking point 34. Further, the makeup processing parameter file is set in accordance with each makeup type (image). The makeup processing parameter file of Fig. 19 shows an example of an elegant level.

(lipstick treatment)

As shown in Fig. 20, the lipstick processing unit 39 included in the simulator main application 28 performs lipstick processing by referring to the tracking point 34 of 8 points of the lips and 3 points of the nose. Figure 20 shows an image of the tracking point to which the lipstick treatment is referred.

Fig. 21 is a flow chart showing an example of lipstick treatment. The lipstick treatment can be roughly classified into the preparation processing before step S10 and the color processing in step S20. The pre-preparation processing includes the cutting & rotating processing of step S11, the processing for forming the contour obtaining image of step S12, the contour obtaining processing of step S13, the spline curve generating processing of step S14, the reversal processing of step S15, and the step The color map generation processing of S16. The coloring process includes a coloring process according to the coloring map according to step S21, a debugging process of step S22, and a design drawing process.

The cutting/rotating process of step S11 is continued, and the lipstick processing unit 39 can cut out part of the image 500 including the user's lips from the face recognition processing image, and rotate the partial image 500 into a processing posture to obtain a partial image. 501.

The processing for obtaining the contour acquisition image in step S12 is continued, and the lipstick processing unit 39 creates a contour acquisition image based on the partial image 501. The contour acquisition processing of step S13 is continued, and the lipstick processing unit 39 acquires the lip contour from the contour acquisition image by the dotted line as indicated by the partial image 502.

Fig. 22 is a view showing an image of an example of the contour acquisition processing. The contour acquisition image 600 superimposes a tracking point of 8 points of the lip and 3 points of the nose. The lipstick processing unit 39 searches for the contour acquisition image 601 based on the tracking point of the lip 8 points and the nose 3 points.

Fig. 23 is a point at which the contour of the contour acquisition image 600 is 8 points and the nose is 3 points, and the contour acquisition image 601 is obtained by re-searching based on the 8 points of the lip and the 3 points of the nose. Comparison screen. Further, when the re-searching is not smooth, the default point of Fig. 24 calculated based on the point 8 of the lip of the contour acquisition image 600 and the tracking point of the nose 3 is used.

Fig. 24 is an image diagram showing an example of a process of obtaining a preset point from a tracking point of 8 points of the lip and 3 points of the nose. The lipstick processing unit 39 refers to the tracking point of the nose at three points, and obtains a predetermined point of five points on the upper lip.

The spline curve generation processing of step S14 is continued, and the lipstick processing unit 39 interpolates the outline of the image 601 or the preset point of FIG. 24 with the spline twice, and completes the contour shown in FIG. Fig. 25 is an image diagram showing the processing of the contour according to the point or the preset point. When the lip contour is completed as in the partial image 503, the lipstick processing unit 39 proceeds to step S15 and returns to the rotation return processing performed by the cutting & rotating processing in step S11.

The color map generation processing of step S16 is continued, and the lipstick processing unit 39 generates a color map for determining the color intensity based on the brightness and chroma of the partial image 700. Fig. 26 is a view showing an image of an example of the generation process of the color map. Specifically, the lipstick processing unit 39 generates a gradation image 701 that displays the color intensity based on the brightness and the chroma. The lipstick processing unit 39 cuts out only part of the image 702 surrounded by the lip contour obtained by the spline curve generation processing of step S14 from the gradation image 701 as the color map 504.

The coloring process according to the coloring map of step S21 is continued, and the lipstick processing unit 39 performs the coloring map 504 generated by the coloring pattern generating process of step S16 and the makeup set by the makeup processing parameter file set as in FIG. The color before the makeup is processed by the method or the specified color.

Fig. 27 is a view showing an image of an example of coloring processing according to a color map. The lipstick processing unit 39 colors the pre-makeup image 803 based on the makeup performing mode or the designated color set in the makeup processing parameter file 801 of Fig. 19 and the coloring map 802 generated by the coloring map generating process in step S16. Processing and obtaining a post-makeup image 804.

Further, the process of the debugging & design drawing in step S22 is continued, and the lipstick processing unit 39 ends the lipstick processing after performing the debugging process for the debugging & design.

(eye shadow processing)

As shown in Fig. 28, the eye shadow processing unit 38 included in the simulator main application 28 performs eye shadow processing by referring to the eye point 3 points of the left and right eyes and the tracking point 34 of the eye point 1 point. Figure 28 shows an image of the tracking point to which the eye shadow processing is referred.

Fig. 29 is a flow chart showing an example of eye shadow processing. The eye shadow processing can be roughly classified into the preparation processing before step S30 and the color processing in step S40. The pre-preparation processing is constituted by the basic contour generation processing of step S31.

The coloring process is repeated according to the coloring type, and includes the coloring contour generating process of step S41, the coloring center generating process of step S42, the coloring image generating process of step S43, and the coloring chart of step S44. Coloring processing, debugging of step S45 & design drawing processing.

The basic contour generation processing of step S31 is continued, and the eye shadow processing unit 38 obtains the eye shape of the user's face as shown by the partial image 900 based on the image for face recognition processing. Fig. 30 is a view showing an image of an example of basic contour generation processing.

As shown in the partial image 1001, the eye shadow processing unit 38 searches for the up and down direction from the center of the eye and recognizes the two-point eye contour (upper boundary & lower boundary) to generate a contour as a substantially color contour. The eye shadow processing unit 38 adds four points generated by spline interpolation to two points of the recognized eye contour, the end of the eye, and the four points of the eye, to generate a polygon having a total of eight points as the partial image 1002.

The color contour generation processing of step S41 is continued, and the eye shadow processing unit 38 generates a color outline as a partial image 901. Fig. 31 is a view showing an example of a process of generating a color outline. The eye shadow processing unit 38 generates a color outline based on the end of the eye and the eye as shown in the partial image 1101 in order to generate a color outline. Further, regarding the contour expansion, the vertex displacement, and the like, the parameters can also be specified using the GUI.

The color center generation processing of step S42 is continued, and the eye shadow processing unit 38 generates a color center position as "●" of the partial image 902. The color map generation processing of step S43 is continued, and the eye shadow processing unit 38 generates a color map for determining the color intensity as a part of the image 903.

Specifically, the color map generation processing system determines the color intensity in accordance with the distance from the color center to the polygonal edge. For example, the eye shadow processing unit 38 determines the color map as the color intensity is weakened as it approaches the edge. Further, the color map generation processing is performed by removing a portion of the basic outline from the colored outline.

As shown in Fig. 32, the eye shadow processing unit 38 produces a smoother gradation by smoothing the generated color map. Fig. 32 is a view showing an image of a color map which has not been subjected to the desalination process and a color map which has been subjected to the desalination process.

The coloring process according to the coloring map of step S44 is continued, and the eye shadow processing unit 38 performs the coloring image 903 generated by the coloring pattern generating process of step S43 and the makeup set by the makeup processing parameter file set as in FIG. The method or the specified color, coloring the image before makeup, and obtaining the image after makeup.

Next, the debugging and design drawing processing of step S45 is continued, and the eye shadow processing unit 38 ends the eye shadow processing after performing the debugging & design drawing processing. Further, the eye shadow processing unit 38 can also perform multi-color coloring by repeating the processing of steps S41 to S45 in accordance with the color type.

(cheek treatment)

As shown in Fig. 33, the cheek processing unit 40 included in the simulator main application 28 performs the cheek processing with reference to the tracking point 34 of the eye tail & mouth corner (left and right) and the eye & nose center (stabilized). Figure 33 shows an image of the tracking point referenced by the cheek processing.

Figure 34 is a flow chart showing an example of cheek processing. The cheek processing includes the color contour generation processing of step S50, the coloring processing of step S51, the debugging of step S52, and the design drawing processing.

The color contour generation processing of step S50 is continued, and the cheek processing unit 40 generates a contour polygon as a color contour based on the end of the eye and the corner of the mouth in order to generate a color contour. Fig. 35 is an image diagram showing an example of a colored outline. Further, the number of points, size, shape, or position of the contour polygon can also be specified by the GUI.

The coloring process of step S51 is continued, and the cheek processing section 40 determines the coloring intensity in accordance with the distance from the center of color to the edge of the contour polygon. Further, when the processing cost is excessively determined in terms of the determination of the color intensity, the resolution (the parameter designation by the GUI) can be lowered to determine the color intensity (reduced into a mosaic shape). The cheek processing unit 40 performs coloring processing on the pre-makeup image based on the determined coloring intensity and the makeup performing method or the designated color set in the makeup processing parameter file of Fig. 19, and obtains a post-makeup image.

Next, the debugging and design drawing processing of step S52 is continued, and the cheek processing unit 40 ends the cheek processing after performing the debugging & design drawing processing.

(eyebrow processing)

As shown in Fig. 36, the eyebrow processing unit 37 included in the simulator main application 28 performs eyebrow processing with reference to the left and right eye tails, the eye center, and the tracking point 34 of the eyebrows. Figure 36 shows an image of the tracking point referenced by the eyebrow processing.

Fig. 37 is a flow chart showing an example of the eyebrow processing. The eyebrow processing can be roughly divided into the eyebrow contour obtaining processing of step S60, the eyebrow original field erasing processing of step S70, the eyebrow shape changing processing of step S80, and the changing eyebrow attaching processing of step S90.

The main field erasing processing is constituted by the domain expansion processing of step S71 and the eyebrow erasing processing of step S72. The eyebrow shape change processing is composed of an instruction curve creation process corresponding to the change designation of step S81 and a change eyebrow generation process of step S82.

The eyebrow contour acquisition processing of step S60 is continued, and the eyebrow processing unit 37 obtains the eyebrow shape of the user's face as shown by the partial image 2001 based on the face recognition processing image. Fig. 38 is a view showing an image of an example of the eyebrow contour acquisition processing. As shown in the partial image 2101, the eyebrow processing unit 37 searches for the left and right eyebrows centering on the eyebrow tail (actually near the center of the eyebrow) to obtain the eyebrow contour. As shown in the partial image 2102, the eyebrow processing unit 37 recognizes the shape of the eyebrow contour based on the search result.

The field expansion processing of step S71 is continued, and the eyebrow processing unit 37 expands the field of the outline shape of the eyebrow that displays the recognition. The eyebrow erasing process of step S72 is continued, and the eyebrow processing section 37 fills the expansion field with the nearby skin color, and thereby removes the eyebrow. Further, the eyebrow processing unit 37 performs fusion processing at the boundary portion of the expansion region.

The instruction curve forming process corresponding to the change designation of step S81 is continued, and the eyebrow processing section 37 changes the field (contour) of the eyebrow contour shape of the display recognition in accordance with the designation. Fig. 39 is a view showing an image of an example of the process of creating an indication curve corresponding to the change designation.

As shown in the partial image 2201, the eyebrow processing unit 37 replaces the field of the recognized eyebrow contour shape with the contour 2202 composed of the lateral axis and the plurality of longitudinal rectangles, and performs the contour 2203 by changing the axis shape and the rectangular height. Change processing.

The change eyebrow generation processing of step S82 is continued, and the eyebrow processing section 37 generates a change eyebrow from the outline 2203. The change of the eyebrow attachment process of step S90 is continued, and the eyebrow processing section 37 attaches a change eyebrow to the image before makeup, and obtains a post-makeup image.

(Foundation treatment)

As shown in Fig. 40, the foundation treatment unit 36 included in the simulator main application 28 performs foundation treatment with reference to the left and right eyebrows, the brow and the eyebrows, and the tracking point 34 between the eyes and the nose center. Figure 40 shows an image of the tracking point referenced by the foundation treatment.

Fig. 41 is a flow chart showing an example of foundation treatment. The foundation treatment includes the contour generation processing of step S101, the fade processing for the target image in step S102, and the image attachment processing of step S103. Further, the processing of steps S101 to S103 is repeated in accordance with the target area.

The contour generation processing of step S101 is continued, and the foundation processing unit 36 generates three (four) contours such as a forehead, a nose, and a cheek (left and right) as shown in the image screen of Fig. 42. Fig. 42 is an image screen showing an example of a contour. Further, each contour size, position, and the like can also be parameterized using a GUI.

The fade processing for the target image in step S102 is continued, and the foundation processing unit 36 performs the fade processing on the target image corresponding to the contour generated as shown in Fig. 43. Fig. 43 is a view showing an image of an original image before the desalination process and an original image after the desalination process. The foundation treatment unit 36 can smooth the thickness of the skin or the like by the desalination treatment of the target image.

The image sticking process of the step S103 is continued, and the foundation processing unit 36 pastes the image of the faded image on the forehead, the nose, and the cheek (left and right) of the image before the makeup, and obtains the image after the makeup. .

As described above, according to the present invention, it is possible to accurately apply makeup to the face of the user included in the moving image when the processing load is small. Further, the photographing mechanism disclosed in the scope of the patent application corresponds to the camera 2, the control unit corresponds to the control unit 8, the display unit corresponds to the display 7, the face recognition processing unit corresponds to the face recognition processing unit 33, and the makeup processing unit corresponds to makeup. The processing unit 35 and the operation mechanism correspond to the operation panel 4, the half mirror mechanism corresponds to the half mirror 3, and the printing mechanism corresponds to the printer 5.

Further, the present invention is not limited to the specific disclosed embodiments, and various changes and modifications may be made without departing from the scope of the patent application.

The makeup simulation device 1 of the present invention belongs to an instant simulation. Therefore, unlike a still picture or a conventional makeup simulation device 1, the tracking point of the face can be instantly recognized and simulated based on the tracking point, so that it can be done. The following items that could not be completed in the past.

The makeup simulation device 1 of the present invention can perform real-time simulation, and the makeup simulation device 1 of the present invention can be simulated from the front of the face as in the past, and can be simulated from the side, so that the simulation of blushing and the like can be easily performed. Effect or technical confirmation.

The makeup simulation device 1 of the present invention can be represented by a past plane, and can be expressed by a past plane to express a stereoscopic capture of the face, a stereoscopic effect, or a texture.

Moreover, the makeup simulation device 1 of the present invention can simultaneously recognize the faces of a majority of people, so that simultaneous simulation of most people can be performed at the same time. Since the makeup simulation device 1 of the present invention is excellent in facial recognition function, it can be automatically classified in accordance with various face types, or males and females, and can be combined with face type or classified makeup. For example, the makeup simulation device 1 of the present invention can perform makeup simulation for each of the two persons at the same time.

This international application claims priority based on Japanese Patent Laid-Open No. 2006-9268, filed on Jan. 17, 2006, and the entire contents of

1. . . Makeup simulator

2. . . camera

3. . . Half mirror

4. . . Operation panel

5. . . Printer

6. . . illumination

7. . . monitor

8. . . Control department

9. . . cant see thing

10. . . Operation processing device

11. . . Display device

12. . . Drive unit

13. . . Auxiliary memory device

14. . . Recording media

15. . . Touch panel display

16. . . Display box

17. . . IC tag reader

20. . . Makeup simulation system

twenty one. . . Analog camera

twenty two. . . USB capture component

twenty three. . . Motion picture file

twenty four. . . Makeup camera

25. . . Still picture system

26. . . Motion picture file

27. . . Shared memory

28. . . Simulator main application

29. . . Interface application

31. . . DirectX

32. . . Dedicated API

33. . . Face recognition processing unit

34. . . Tracking point

35. . . Cosmetic processing department

36. . . Foundation treatment department

37. . . Eyebrow processing department

38. . . Eye shadow processing department

39. . . Lipstick processing department

40. . . Cheek processing department

41. . . Product information

42. . . Motion picture server

43. . . Face recognition processing unit

44, 45. . . Tracking point

50. . . ActiveX controller

51. . . ActiveX viewer

52. . . Motion picture control object

53. . . Dynamic image display object

54. . . Other controller

100~111, 200~210, 300~309, 400~402, 500~502, 700~702, 900~903, 1001, 1002, 1101, 2001, 2101, 2102. . . image

504. . . Color map

600~601. . . Contour acquisition image

801. . . Makeup processing parameter file

803. . . Pre-makeup image

804. . . Post-makeup image

2202, 2203. . . profile

Fig. 1 is an external view showing a first embodiment of the makeup simulation device of the present invention.

Fig. 2 is a cross-sectional view showing a first embodiment of the makeup simulation device.

Fig. 3 is an external view showing a second embodiment of the makeup simulation device of the present invention.

Fig. 4 is a cross-sectional view showing a second embodiment of the makeup simulation device.

Fig. 5 is an external view showing a third embodiment of the makeup simulation device of the present invention.

Fig. 6 is a cross-sectional view showing a third embodiment of the makeup simulation device.

Fig. 7 is an external view showing a fourth embodiment of the makeup simulation device of the present invention.

Fig. 8 is a cross-sectional view showing a fourth embodiment of the makeup simulation device.

Fig. 9 is an external view showing a fifth embodiment of the makeup simulation device of the present invention.

Fig. 10 is a cross-sectional view showing a fifth embodiment of the makeup simulation device.

Fig. 11 is a view showing a hardware configuration of a fifth embodiment of the makeup simulation device.

Fig. 12 is a flow chart showing an outline of processing performed by the makeup simulation device.

Fig. 13 is an image diagram showing an example of the main screen of the display and the operation screen displayed on the operation panel.

Fig. 14 is a view showing an image of a process other than makeup simulation performed by the makeup simulation device.

Figure 15 is a system configuration diagram of one embodiment of the makeup simulation system of the present invention.

Figure 16 is a screen image showing the processing performed by the main application.

Figure 17 is an image of the user's face contained in the pre-makeup image.

Fig. 18 is an image diagram showing an example of a tracking point.

Fig. 19 is a configuration diagram showing an example of a makeup processing parameter file.

Figure 20 shows an image of the tracking point to which the lipstick treatment is referred.

Fig. 21 is a flow chart showing an example of lipstick treatment.

Fig. 22 is a view showing an image of an example of the contour acquisition processing.

Fig. 23 is a point at which the contour of the contour acquisition image 600 is 8 points and the nose is 3 points, and the contour acquisition image 601 is obtained by re-searching based on the 8 points of the lip and the 3 points of the nose. Comparison screen.

Fig. 24 is an image diagram showing an example of a process of obtaining a preset point from a tracking point of 8 points of the lip and 3 points of the nose.

Fig. 25 is an image diagram showing the processing of the contour according to the point or the preset point.

Fig. 26 is a view showing an image of an example of the generation process of the color map.

Fig. 27 is a view showing an image of an example of coloring processing according to a color map.

Figure 28 shows an image of the tracking point to which the eye shadow processing is referred.

Fig. 29 is a flow chart showing an example of eye shadow processing.

Fig. 30 is a view showing an image of an example of basic contour generation processing.

Fig. 31 is a view showing an example of a process of generating a color outline.

Fig. 32 is a view showing an image of a color map which has not been subjected to the desalination process and a color map which has been subjected to the desalination process.

Figure 33 shows an image of the tracking point referenced by the cheek processing.

Figure 34 is a flow chart showing an example of cheek processing.

Fig. 35 is an image diagram showing an example of a colored outline.

Figure 36 shows an image of the tracking point referenced by the eyebrow processing.

Fig. 37 is a flow chart showing an example of the eyebrow processing.

Fig. 38 is a view showing an image of an example of the eyebrow contour acquisition processing.

Fig. 39 is a view showing an image of an example of the process of creating an indication curve corresponding to the change designation.

Figure 40 shows an image of the tracking point referenced by the foundation treatment.

Fig. 41 is a flow chart showing an example of foundation treatment.

Fig. 42 is an image screen showing an example of a contour.

Fig. 43 is a view showing an image of an original image before the desalination process and an original image after the desalination process.

1. . . Makeup simulator

2. . . camera

4. . . Operation panel

5. . . Printer

7. . . monitor

8. . . Control department

Claims (15)

A makeup simulation system for performing makeup on a moving image after a user's face is photographed, comprising: a photographing mechanism for photographing a user's face and outputting a moving image; and a control mechanism for receiving the photograph from the foregoing a dynamic image output by the mechanism, and an image processing and output of the dynamic image; and a display mechanism for displaying a dynamic image outputted from the control mechanism; and the control mechanism further includes: a face recognition processing mechanism The user's face is recognized from the moving image based on the predetermined tracking point; and the makeup processing means performs predetermined makeup on the user's face included in the moving image based on the tracking point, and outputs the result to the display means. The makeup simulation system according to claim 1, wherein the makeup treatment mechanism includes at least one of the following mechanisms, and the mechanism includes: a foundation treatment mechanism that is included in the motion image according to the tracking point; The user's face is subjected to a foundation treatment; the lipstick processing mechanism performs a lipstick treatment on the user's face included in the moving image based on the tracking point; and the eyebrow processing mechanism includes the moving image according to the tracking point. The user's face is subjected to an eyebrow processing; the cheek processing mechanism is based on the aforementioned tracking point to the aforementioned moving image The included user's face is subjected to a cheek treatment; and the eye shadow processing means performs an eye shadow processing on the user's face included in the moving image based on the tracking point. The makeup simulation system of claim 1, wherein the makeup processing mechanism generates a contour for predicting a makeup of a user's face included in the motion image based on the tracking point, and performs a coloring process according to the contour. The makeup simulation system of claim 1, wherein the makeup processing mechanism sequentially performs various types of makeup on the user's face included in the motion image at predetermined time intervals, and outputs the image after makeup to the image. The aforementioned display mechanism. The makeup simulation system of claim 4, further comprising a storage mechanism, wherein the storage mechanism stores the product information for making the image into the image according to each type of makeup, and the makeup processing mechanism can The storage unit acquires product information for making up the image screen and outputs the product information to the display unit. The makeup simulation system of claim 1, wherein the makeup processing mechanism outputs a comparison screen to the display unit, and the comparison screen is composed of a user's face before and after makeup of the motion image. The image frame is composed of. For example, the makeup simulation system of claim 1 further includes: a reading mechanism that reads the identification information of the item selected by the user; and The corresponding mechanism is configured to associate the article with the identification information, and the makeup processing mechanism specifies the article corresponding to the identification information read from the reading mechanism according to the corresponding mechanism, and uses the article The image of the user's face included in the moving image is subjected to a predetermined makeup image, and is output to the display means. A makeup simulation device for performing makeup on a moving image after a face is photographed by a user, comprising: a photographing mechanism for photographing a user's face and outputting a moving image; and a control mechanism receiving the photographing mechanism from the photographing mechanism And outputting the dynamic image, and performing image processing on the moving image and outputting the image; and the display mechanism displaying the dynamic image outputted from the control mechanism; and the control mechanism further includes: a face recognition processing mechanism, The predetermined tracking point identifies the user's face from the moving image; and the makeup processing means performs predetermined makeup on the user's face included in the moving image based on the tracking point, and outputs the result to the display means. The makeup simulation device of claim 8, further comprising a half mirror mechanism disposed on a display direction side of the display mechanism, wherein the half mirror mechanism causes light to be emitted from the display mechanism when the display mechanism displays a motion image The side is transmitted to the user side, and when the display means does not display a moving image, the light from the user side is reflected. The makeup simulation device of claim 8, further comprising a half mirror mechanism provided on a display direction side of the display mechanism, wherein the photographing mechanism is disposed to transmit the user when the half mirror mechanism is transmitted At the position of the face, the half mirror mechanism transmits light from the display mechanism side to the user side, and transmits light from the user side to the photographing mechanism side. The makeup simulation device of claim 8 further includes a printing mechanism, and the printing mechanism can print an image screen of the user's face after being displayed by the display mechanism. The makeup simulation device of claim 8 further includes an display mechanism, and the display mechanism can display an item for making up an image of the user's face after being displayed by the display means. The makeup simulation device of claim 8 further includes: a reading mechanism for reading the identification information of the item selected by the user; and a corresponding mechanism for causing the item to correspond to the identification information; Further, the makeup processing means specifies the article corresponding to the identification information read from the reading means based on the corresponding mechanism, and uses the article to perform predetermined makeup on the face of the user included in the moving image. The image screen is output to the display mechanism. A makeup simulation method for use in a makeup simulation system for applying a moving image of a user's face; characterized in that it comprises the following steps: The control mechanism recognizes the user's face from the moving image captured by the photographing mechanism, and starts the makeup simulation; the control mechanism identifies the user's face contained in the motion image according to the predetermined tracking point; and the control mechanism according to the foregoing tracking point pair The user's face included in the moving image is subjected to predetermined makeup and output to the display means. A makeup simulation program is a program for performing makeup on a moving image after a user's face is shot in a computer having at least an arithmetic processing device, a memory device, and an output device, and the makeup simulation program performs the following steps: The arithmetic processing device recognizes a user's face from a moving image captured by the photographing mechanism, and starts a makeup simulation; identifies a user's face included in the moving image based on a predetermined tracking point; and includes the moving image according to the tracking point The user's face performs predetermined makeup and outputs it to the aforementioned output mechanism.