JP2022045944A - Makeup support controller, makeup support system, and makeup support control method - Google Patents

Abstract

To perform support so as to make it possible to learn a procedure of makeup.SOLUTION: A control unit 20, which is a makeup support controller, comprises: a projection control unit 25 for performing control matching with an object person's face part so that model video showing a makeup procedure to be a model for each portion is intermittently projected; a photographic data acquisition unit 21 for acquiring photographic data obtained by photographing the face part; and a determination unit 233 for comparing a state of makeup of the face part in the photographic data with a state of makeup in the model video to determine a makeup result. The determination unit 233 performs determination by comparing the photographic data photographed in a period in which the model video is not projected with the model video projected immediately before.SELECTED DRAWING: Figure 1

Description

The present invention relates to a makeup support control device, a makeup support system, and a makeup support control method.

A make-up support system that gives advice on make-up treatment and corresponds to the make-up to be performed is known (see, for example, Patent Document 1). A technique is known in which an image for make-up or the like is projected onto an object such as a human face or a moving object to synchronize a real object with a virtual projected image (see, for example, Patent Document 2). ..

Japanese Patent No. 6534168 Japanese Unexamined Patent Publication No. 2018-195996

In the technique described in Patent Document 1, the subject image before the make-up treatment and the synthesized subject image after the make-up treatment are displayed side by side. In the technique described in Patent Document 2, a make-up image is projected on a human face. As described above, the techniques described in Patent Document 1 and Patent Document 2 are techniques for comparing images before and after makeup, and are not intended to learn the procedure of makeup. Therefore, a technique that supports learning the makeup procedure is desired.

The present invention has been made in view of the above, and an object of the present invention is to assist in learning the procedure of makeup.

In order to solve the above-mentioned problems and achieve the object, the makeup support control device according to the present invention intermittently displays a model image showing a model makeup procedure for each part according to the face of the subject. A projection control unit that controls the projection of the face, a shooting data acquisition unit that acquires shooting data of the face, a makeup state of the face of the shooting data, and a makeup state of the model image. The determination unit includes a determination unit for determining the finish of makeup by comparing with, and the determination unit includes the photographing data photographed during the period when the model image is not projected and the model projected immediately before. Judgment is made by comparing with the video.

The makeup support system according to the present invention projects the above-mentioned makeup support control device, a projection device that intermittently projects a model image showing a model makeup procedure for each part, and the face of the subject. A half mirror is provided, and the projection control unit controls the projection device so as to project in accordance with the face portion displayed on the surface of the half mirror.

The makeup support control method according to the present invention includes a projection control step that controls to intermittently project a model image showing a model makeup procedure for each part according to the face of the subject, and the face. A determination step of comparing a shooting data acquisition step of acquiring shooting data of a portion, a makeup state of the face portion of the shooting data, and a makeup state of the model image to determine the finish of the makeup. In the determination step, the photographed data captured during the period in which the model image is not projected is compared with the model image projected immediately before the determination.

According to the present invention, there is an effect that it is possible to support learning the procedure of makeup.

FIG. 1 is a block diagram showing a configuration example of a makeup support system having a makeup support control device according to the first embodiment. FIG. 2 is a schematic view showing a makeup support system having a makeup support control device according to the first embodiment. FIG. 3 is a diagram showing an example of determination conditions. FIG. 4 is a flowchart showing a processing flow in the makeup support control device according to the first embodiment. FIG. 5 is a flowchart showing a processing flow in the makeup support control device according to the first embodiment. FIG. 6 is a block diagram showing a configuration example of a makeup support system having a makeup support control device according to the second embodiment. FIG. 7 is a flowchart showing a processing flow in the makeup support control device according to the second embodiment.

Hereinafter, embodiments of the makeup support control device, the makeup support system, and the makeup support control method according to the present invention will be described in detail with reference to the accompanying drawings. The present invention is not limited to the following embodiments.

[First Embodiment]
(Makeup support system)
FIG. 1 is a block diagram showing a configuration example of a makeup support system 1 having a control unit 20 which is a makeup support control device according to the first embodiment. FIG. 2 is a schematic view showing a makeup support system 1 having a control unit 20 which is a makeup support control device according to the first embodiment. The makeup support system 1 projects a makeup procedure as a model for each part of the face F of the subject M to which the makeup is applied. The portion of the face F is, for example, the eyes, mouth, cheeks, and the like.

The mirror 10 reflects the face F of the subject M. The subject M makes up while looking at the mirror 10 and confirming the makeup procedure as a model projected on the face F. The mirror 10 may be an optical mirror or a half mirror.

The makeup support system 1 includes a camera 11, a moving image data storage unit 12, a projection device 13, a display device 14, and a control unit (makeup support control device) 20. The makeup support system 1 may include a mirror 10.

The camera 11 photographs the face F of the subject M. The camera 11 photographs the face F of the subject M during makeup or the face F of the subject M after makeup. The camera 11 photographs the face portion F of the subject M while it is not projected onto the face portion F of the subject M by the projection device 13. The camera 11 captures the face portion F in a state in which the model image described later is not projected on the face portion F of the subject M. As a result, the state of makeup on the face F of the subject M is appropriately photographed. On the other hand, if the face portion F on which the model image is projected is photographed, it may be difficult to confirm the state of makeup. The camera 11 outputs the captured shooting data to the shooting data acquisition unit 21 of the control unit 20.

When the mirror 10 is a half mirror, the camera 11 may be arranged behind the back surface opposite to the front surface facing the subject M. In other words, the camera 11 may be arranged inside the mirror 10. The camera 11 may be built in the mirror 10. In the present embodiment, as shown in FIG. 2, the mirror 10 is arranged behind the back surface of the mirror 10.

The moving image data storage unit 12 stores moving image data in which the procedure for applying makeup to the face portion is taken. The moving image data storage unit 12 can be realized by, for example, a RAM (Random Access Memory), a semiconductor memory element such as a flash memory such as an SD card, or a storage device such as a hard disk or a solid state drive. The moving image data storage unit 12 may be composed of a plurality of different memories or the like. The moving image data storage unit 12 may be an external storage device connected via a communication unit (not shown).

The video data shows a model makeup procedure. The model makeup procedure is a makeup procedure performed by a skilled practitioner, such as a salesperson of cosmetic-related products such as cosmetics and makeup tools, or a makeup artist. The model makeup procedure is, for example, a model makeup procedure among the makeup procedures performed by the subject M himself. The model makeup procedure is, for example, a makeup procedure performed by a third party who is good at makeup.

The moving image data is moving image data obtained by shooting the procedure of applying makeup. The moving image data is, for example, moving image data obtained by photographing a makeup procedure applied to the face F of the subject M by a salesperson or a practitioner at the time of purchasing cosmetics. The moving image data is, for example, moving image data obtained by photographing the makeup procedure applied to the face F by the subject M himself. The moving image data may be, for example, moving image data obtained by photographing a makeup procedure applied by a third party and publishing it on the Internet.

The projection device 13 is installed so as to be able to project a model image showing a makeup procedure as a model on the face F of the subject M. For example, the projection device 13 is a projector using a liquid crystal display or a projector using a laser light source. The projection device 13 projects the three-dimensional object projection light of the model image based on the image signal output by the projection control unit 25 of the control unit 20. The projection device 13 intermittently projects the model image. In other words, the projection device 13 repeats a period in which the model image is projected on the face portion F of the subject M and a period in which the model image is not projected. The non-projecting period may match the shooting timing of the camera 11.

The projection device 13 may be arranged around the mirror 10. In this embodiment, as shown in FIG. 2, it is arranged under the mirror 10. In this case, the projection device 13 is arranged outside the mirror 10.

When the mirror 10 is a half mirror, the projection device 13 may be arranged behind the back surface. In other words, the projection device 13 may be arranged inside the mirror 10. The projection device 13 may be built in the mirror 10.

The display device 14 displays a message, advice, and the like indicating the determination result of the finish of the makeup. The display device 14 is a display including, for example, a liquid crystal display (LCD) or an organic EL (Electro-Luminescence) display.

(Control unit)
The control unit 20 is, for example, an arithmetic processing unit composed of a CPU (Central Processing Unit) or the like. The control unit 20 loads a program stored in a storage unit (not shown) into a memory and executes an instruction included in the program. The control unit 20 includes a shooting data acquisition unit 21, a moving image data acquisition unit 22, a moving image processing unit 23, a projection image generation unit 24, a projection control unit 25, a display image generation unit 26, and a display control unit 27. Has. The control unit 20 includes an internal memory (not shown), and the internal memory is used for temporary storage of data in the control unit 20 and the like.

The shooting data acquisition unit 21 acquires shooting data obtained by shooting the face F of the subject M during makeup or the face F of the subject M after makeup. The shooting data acquisition unit 21 acquires shooting data from the camera 11.

The moving image data acquisition unit 22 acquires moving image data from the moving image data storage unit 12.

The moving image processing unit 23 processes the shooting data acquired by the shooting data acquisition unit 21, the moving image data acquired by the moving image data acquisition unit 22, and the video data of the model video. The moving image processing unit 23 includes a face recognition unit 231, a processing unit 232, and a determination unit 233.

The face recognition unit 231 performs image processing on the video data acquired by the video data acquisition unit 22, and the shape of the face and the portion of the person to be treated, in other words, the person to whom the makeup is applied, included in the video data. , Recognize size and tint. The person to be treated is not limited to the subject M, but includes a third party. The face recognition unit 231 executes the recognition process from the beginning to the end of the moving image data. As a method for recognizing a face and a part, a known method can be used and is not limited.

The face recognition unit 231 performs image processing on the shooting data acquired by the shooting data acquisition unit 21 to recognize the face portion F of the subject M. The face recognition unit 231 recognizes the shape, size, and color of the face portion F and the portion. The face recognition unit 231 continues the recognition process while the shooting data acquisition unit 21 is acquiring the shooting data. As a method for recognizing the face F and the site, a known method can be used and is not limited.

The processing unit 232 processes the moving image data acquired by the moving image data acquisition unit 22. The processing unit 232 processes the moving image data acquired by the moving image data acquisition unit 22 to generate a model image. The processing unit 232 stores the generated model image in a storage unit (not shown). The processing process by the processing unit 232 may be executed once for the moving image data.

The processing unit 232 divides the moving image data into each part of the face to which the makeup is applied, adds chapters, reverses the moving image data left and right, and processes the moving image data to generate a model image. More specifically, the processing unit 232 adds chapters to each recognized facial part such as the eyes, mouth, and cheeks based on the recognition result of the face recognition unit 231. For example, the moving image data including the period of applying eye shadow, the period of applying lipstick, and the period of applying blusher is divided by a site and three chapters are added. The processing unit 232 further flips the moving image data left and right.

The processing unit 232 deletes a portion of the moving image data that is not related to makeup. More specifically, the processing unit 232 deletes a part other than the makeup procedure from the moving image data, for example, before the start of makeup or after the completion of makeup. The processing unit 232 performs image processing on the moving image data, for example, and deletes a part other than the person to be treated, such as a background, from the moving image data. The processing unit 232 performs image processing on the moving image data, for example, and deletes a body part other than the face part such as from the neck to the bottom from the moving image data.

The model image processed in this way is divided into chapters for each part such as the eyes, mouth, and cheeks. The model image is flipped horizontally to be projected onto the face F of the subject M. The model image may include a facial image of the person to be treated included in the moving image data. The model image may include only the color of the makeup to which the facial image of the person to be treated included in the moving image data is subtracted. The model image may include cosmetic tools and the practitioner's fingers.

The determination unit 233 compares the makeup state of the face portion F of the subject M in the shooting data with the makeup state of the model image, and determines the finish of the makeup. More specifically, the determination unit 233 determines by comparing the shooting data taken during the period when the model image is not projected with the model image.

The determination conditions of the determination unit 233 will be described in detail with reference to FIG. FIG. 3 is a diagram showing an example of determination conditions. The determination unit 233 may determine the finish of the makeup for each portion of the face portion F. The determination unit 233 determines whether or not the makeup is completed for each part. The determination unit 233 determines the color of the makeup by comparing, for example, the makeup state of the face F of the actual subject M with the makeup state as a model. The determination unit 233 determines that the product is completed, for example, when the difference in color is equal to or less than the color threshold. The determination unit 233 determines the shade of makeup by comparing, for example, the state of makeup on the face F of the actual subject M with the state of makeup as a model. For example, when the difference in shading is equal to or less than the shading threshold value, the determination unit 233 determines that the work is completed. The determination unit 233 determines, for example, the lightness and darkness of the makeup by comparing the makeup state of the face F of the actual subject M with the makeup state as a model. The determination unit 233 determines that the product is completed, for example, when the difference between light and dark is equal to or less than the light and dark threshold value. The determination unit 233 determines, for example, the range in which the makeup is applied by comparing the makeup state of the face F of the actual subject M with the makeup state as a model. The determination unit 233 determines that the range is complete, for example, when the difference in the range is equal to or less than the range threshold value. The determination unit 233 may determine that it is completed when all the conditions are satisfied.

For example, when the determination result indicates that the makeup of the portion of the face F is completed, the reproduction of the model image of the portion concerned is terminated, and the model image of the next portion is reproduced. For example, when the determination result indicates that the makeup of the portion of the face F is not completed, the reproduction of the model image of the portion is repeated. For example, if the determination result indicates that the makeup of the portion of the face F is not completed, the advice may be displayed on the display device 14.

The determination unit 233 may determine the finish of the entire makeup of the face portion F. The determination unit 233 may determine, for example, the overall balance.

For example, when the determination result indicates that the entire makeup of the face F is completed, the reproduction of the model image is terminated. For example, when the determination result indicates that the makeup of the entire face F is not completed, the reproduction of the desired model image is repeated. The desired model image is, for example, a model image of a part to be redone. For example, if the determination result indicates that the entire makeup of the face F is not completed, the advice may be displayed on the display device 14.

The projection image generation unit 24 generates a model image for projection that projects the makeup procedure as a model onto the face F of the subject M. The projection image generation unit 24 generates a model image for projection from the model image processed by the processing unit 232.

The projection image generation unit 24 generates a model image for projection whose shape and size are matched to the face portion F of the subject M. More specifically, the projection image generation unit 24 determines the shape and size of the face portion and the portion of the model image, and the shape and size of the face portion F and the portion of the subject M included in the recognition result of the face recognition unit 231. Convert according to.

The projection image generation unit 24 may generate a model image for projection that matches the color of the face portion F of the subject M. More specifically, the projection image generation unit 24 converts the color of the makeup of the model image according to the color of the face F and the portion of the subject M included in the recognition result of the face recognition unit 231.

The projection image generation unit 24 may generate a model image including a face image or a model image from which the face image is subtracted.

The projection image generation unit 24 may generate an image in which the color of the portion to which the makeup is applied is lighter, the brightness is darker, or the brightness is lowered. The projection image generation unit 24 may generate an image of only a frame line in the portion to which the makeup is applied among the parts to which the makeup is applied. In this case, image processing may be performed on the captured data to recognize the change in the color of the portion of the face F, and the portion where the color has changed may be recognized as the portion to which the makeup has been applied. Image processing may be performed on the photographed data to recognize the positions and movements of the makeup tool and the fingers, and the portion through which the makeup tool and the fingers have passed may be recognized as the makeup-applied portion.

The projection control unit 25 controls the face portion F of the subject M to intermittently project a model image showing a makeup procedure as a model for each portion. More specifically, the projection control unit 25 controls the face portion F of the subject M so that the projection device 13 intermittently projects the model image for projection generated by the projection image generation unit 24. The projection control unit 25 controls the projection so that the period during which the model image is projected onto the face portion F of the subject M and the period during which the model image is not projected are repeated. The projection control unit 25 intermittently outputs a video signal for projecting a model image for projection generated by the projection image generation unit 24 onto the face portion F of the subject M to the projection device 13. The projection control unit 25 intermittently outputs a video signal so as to track the face portion F of the subject M and project a model image for projection.

The projection control unit 25 may control to project a model image including a face image or a model image from which the face image is subtracted.

The projection control unit 25 controls the projection so as to be aligned with the face portion F of the subject M.

The display image generation unit 26 generates a display image showing information such as makeup advice to the subject M. More specifically, the display image generation unit 26 generates a display image showing a message and advice based on the determination result of the determination unit 233.

The display image generation unit 26 generates, for example, an image showing advice on the color of makeup, such as “more red” according to the determination result of the color of makeup. The display image generation unit 26 generates an image showing advice on the shade of makeup, such as “darker” or “lighter”, depending on the determination result of the shade of makeup. The display image generation unit 26 generates an image showing advice on the lightness and darkness of the makeup, such as "brighter" or "darker" depending on the determination result of the lightness and darkness of the makeup. The display image generation unit 26 generates an image showing advice on the range of makeup, such as "thinning the line" or "shortening the line", depending on the determination result of the range of makeup.

The display image generation unit 26 generates an image showing advice on the overall balance. When the overall balance is poor, the display image generation unit 26 generates an image that prompts the user to start over, for example, "Because the balance is poor, repeat the chapters of the eyes."

The display control unit 27 controls the display device 14 to display the display image generated by the display image generation unit 26. In other words, the display control unit 27 outputs a video signal for displaying the display video generated by the display video generation unit 26 to the display device 14.

(Processing in the control unit)
Next, the flow of processing in the control unit 20 which is a makeup support control device will be described with reference to FIGS. 4 and 5. FIG. 4 is a flowchart showing a processing flow in the control unit 20 which is the makeup support control device according to the first embodiment. FIG. 5 is a flowchart showing a processing flow in the control unit 20 which is the makeup support control device according to the first embodiment.

The processing of moving image data will be described with reference to FIG. The processing of the flowchart shown in FIG. 4 may be executed for the moving image data each time new moving image data is stored in the moving image data storage unit 12. Alternatively, among the moving image data stored in the moving image data storage unit 12, the newly added moving image data may be executed at predetermined intervals or at arbitrary timings.

The control unit 20 acquires video data from the video data storage unit 12 by the video data acquisition unit 22 (step S101). The control unit 20 proceeds to step S102.

The control unit 20 determines, by the face recognition unit 231, a portion (makeup portion) of the face portion to which the makeup of the moving image data is applied (step S102). More specifically, the control unit 20 recognizes facial parts such as the eyes, mouth, and cheeks to which makeup is applied from the moving image data by the face recognition unit 231. For example, the eyes, mouth, and cheeks are recognized from the moving image data including the period of applying eye shadow, the period of applying lipstick, and the period of applying blush. The control unit 20 proceeds to step S103.

The control unit 20 divides the moving image data into parts by the processing unit 232 and adds chapters (step S103). For example, the moving image data including the period of applying eye shadow, the period of applying lipstick, and the period of applying blusher is divided by a site and three chapters are added. In other words, it includes a chapter that applies eye shadow to the eyes, a chapter that applies lipstick to the mouth, and a chapter that applies blush to the cheeks. The control unit 20 proceeds to step S104.

The control unit 20 deletes a portion of the moving image data that is not related to makeup by the processing unit 232 (step S104). For example, parts other than the makeup procedure, such as before the start of makeup or after the completion of makeup, are deleted from the video data. For example, the part other than the person to be treated, such as the background, is deleted from the moving image data. For example, body parts other than the face, such as below the neck, are deleted from the video data. The control unit 20 proceeds to step S105.

The control unit 20 determines whether or not the processing by the processing unit 232 is completed until the end of the moving image data (step S105). The control unit 20 determines whether or not the processing is completed depending on whether or not the processing is completed until the end of the moving image data file. When the control unit 20 determines that the machining process is completed (Yes in step S105), the control unit 20 ends the process. When the control unit 20 determines that the machining process has not been completed (No in step S105), the control unit 20 re-executes the process of step S102. In this way, the moving image data is processed to generate a model image.

The makeup support process will be described with reference to FIG. When the operation of the subject M to start the makeup support process is detected, the makeup support system 1 is activated. While the makeup support system 1 is being activated, the camera 11 photographs the face portion F of the subject M, and the captured shooting data is output to the shooting data acquisition unit 21 of the control unit 20. During the activation of the makeup support system 1, the face recognition unit 231 recognizes the face portion F of the subject M with respect to the shooting data. While the makeup support system 1 is being activated, the control unit 20 repeats the processes of steps S111 to S123. FIG. 5 is a flowchart when there are three chapters of the model image.

The control unit 20 acquires a model image which is processed moving image data from a storage unit (not shown) (step S111). The control unit 20 proceeds to step S112.

The control unit 20 projects the first chapter of the model image onto the face portion F of the subject M by repeat reproduction (step S112). For example, the first chapter is a chapter that applies eye shadow to the eyes. The control unit 20 generates a model image for projection from the model image by the projection image generation unit 24. The control unit 20 projects a model image for projection by the projection control unit 25. The control unit 20 proceeds to step S113.

The control unit 20 acquires the shooting data during blanking by the shooting data acquisition unit 21 (step S113). More specifically, the control unit 20 acquires the shooting data taken during the period when the projection device 13 is not projecting by the shooting data acquisition unit 21. The control unit 20 proceeds to step S114.

The control unit 20 determines whether or not the makeup of the chapter being regenerated is completed by the determination unit 233 (step S114). For example, it is determined whether or not the makeup for applying eye shadow to the eyes is completed. The control unit 20 determines the color, shade, lightness and darkness, and range of the makeup around the eyes by the determination unit 233. When the determination unit 233 determines that the makeup of the chapter being reproduced is completed (Yes in step S114), the control unit 20 proceeds to step S116. If the determination unit 233 does not determine that the makeup of the chapter being reproduced is completed (No in step S114), the control unit 20 proceeds to step S115.

When it is not determined that the makeup of the chapter being reproduced is completed (No in step S114), the control unit 20 displays advice according to the determination result on the display device 14 (step S115). More specifically, the control unit 20 generates a display image showing advice by the display image generation unit 26 based on the determination result of the determination unit 233. The control unit 20 outputs a video signal for displaying the display video indicating the advice generated by the display video generation unit 26 to the display device 14 by the display control unit 27. The control unit 20 re-executes the process of step S112.

When it is determined that the makeup of the chapter being reproduced is completed (Yes in step S114), the next chapter of the model image is projected onto the face F of the subject M by repeat reproduction (step S116). For example, the following chapter is a chapter that applies lipstick to the mouth. The control unit 20 generates a model image for projection from the model image by the projection image generation unit 24. The control unit 20 projects a model image for projection by the projection control unit 25. The control unit 20 proceeds to step S117.

The control unit 20 acquires the shooting data during blanking by the shooting data acquisition unit 21 (step S117). More specifically, the control unit 20 acquires the shooting data taken during the period when the projection device 13 is not projecting by the shooting data acquisition unit 21. The control unit 20 proceeds to step S118.

The control unit 20 determines whether or not the makeup of the chapter being regenerated is completed by the determination unit 233 (step S118). For example, it is determined whether or not the makeup of applying lipstick to the mouth is completed. The control unit 20 determines the color, shade, lightness and darkness, and range of the makeup on the mouth by the determination unit 233. When the determination unit 233 determines that the makeup of the chapter being reproduced is completed (Yes in step S118), the control unit 20 proceeds to step S120. If the determination unit 233 does not determine that the makeup of the chapter being reproduced is completed (No in step S118), the control unit 20 proceeds to step S119.

When it is not determined that the makeup of the chapter being reproduced is completed (No in step S118), the control unit 20 displays advice according to the determination result on the display device 14 (step S119). More specifically, the control unit 20 generates a display image showing advice by the display image generation unit 26 based on the determination result of the determination unit 233. The control unit 20 outputs a video signal for displaying the display video indicating the advice generated by the display video generation unit 26 to the display device 14 by the display control unit 27. The control unit 20 re-executes the process of step S116.

When it is determined that the makeup of the chapter being reproduced is completed (Yes in step S118), the next chapter of the model image is projected onto the face F of the subject M by repeat reproduction (step S120). For example, the next chapter is the final chapter, which is a blusher on the cheeks. The control unit 20 generates a model image for projection from the model image by the projection image generation unit 24. The control unit 20 projects a model image for projection by the projection control unit 25. The control unit 20 proceeds to step S121.

The control unit 20 acquires the shooting data during blanking by the shooting data acquisition unit 21 (step S121). More specifically, the control unit 20 acquires the shooting data taken during the period when the projection device 13 is not projecting by the shooting data acquisition unit 21. The control unit 20 proceeds to step S122.

The control unit 20 determines whether or not the makeup of the chapter being regenerated is completed by the determination unit 233 (step S122). For example, it is determined whether or not the makeup for applying blusher to the cheeks is completed. The control unit 20 determines the color, shade, lightness and darkness, and range of the makeup on the cheeks by the determination unit 233. The control unit 20 determines the overall balance by the determination unit 233. When the determination unit 233 determines that the makeup of the chapter being reproduced is completed (Yes in step S122), the control unit 20 ends the process. If the determination unit 233 does not determine that the makeup of the chapter being reproduced is completed (No in step S122), the control unit 20 proceeds to step S123.

When it is not determined that the makeup of the chapter being reproduced is completed (No in step S122), the control unit 20 displays advice according to the determination result on the display device 14 (step S123). More specifically, the control unit 20 generates a display image showing advice by the display image generation unit 26 based on the determination result of the determination unit 233. The control unit 20 outputs a video signal for displaying the display video indicating the advice generated by the display video generation unit 26 to the display device 14 by the display control unit 27. The control unit 20 re-executes the process of step S120. The control unit 20 may re-execute the process corresponding to any chapter to be redone.

In this way, the model image is intermittently projected on the face F of the subject M for each part. The subject M applies makeup to each part while checking his / her face F reflected on the mirror 10. The makeup support system 1 compares the shooting data taken during the period when the model image is not projected with the model image to determine the finish of the makeup. The makeup support system 1 displays advice or prompts a redo of a specific part based on the determination result.

(effect)
As described above, in the present embodiment, the model image can be intermittently projected on the face portion F of the subject M for each portion. According to the present embodiment, the subject M can apply makeup to each part while checking his / her face F reflected on the mirror 10. Further, according to the present embodiment, it is possible to determine the finish of the makeup by comparing the shooting data taken during the period when the model image is not projected with the model image. According to the present embodiment, it is possible to display advice or urge a redo of a specific part based on the determination result. In this way, the present embodiment can support the subject M to learn the makeup procedure.

In the present embodiment, the model image is divided into parts to which makeup is applied. According to this embodiment, it is possible to support the learning of the makeup procedure for each part. Further, in the present embodiment, the model image is processed by reversing the shooting data obtained by shooting the procedure of applying makeup. According to the present embodiment, an appropriate model image can be projected on the face F of the subject M.

In the present embodiment, a model image including a face image or a model image from which the face image is subtracted is projected. According to the present embodiment, an appropriate model image can be projected on the face F of the subject M.

In this embodiment, a model image is projected according to the face portion F of the subject M. According to the present embodiment, an appropriate model image can be projected on the face F of the subject M.

[Second Embodiment]
The makeup support system 1A according to the present embodiment will be described with reference to FIGS. 6 and 7. FIG. 6 is a block diagram showing a configuration example of a makeup support system 1A having a control unit 20A, which is a makeup support control device according to the second embodiment. FIG. 7 is a flowchart showing a processing flow in the control unit 20A, which is the makeup support control device according to the second embodiment. The basic configuration of the makeup support system 1A of the present embodiment is the same as that of the makeup support system 1 of the first embodiment. In the following description, the same components as those of the makeup support system 1 of the first embodiment are designated by the same reference numerals or corresponding reference numerals, and detailed description thereof will be omitted. The makeup support system 1A of the present embodiment is different from the first embodiment in that it includes a communication device 15A and that the control unit 20A has a transmission control unit 31A and a reception control unit 32A.

The communication device 15A is a communication unit. The communication device 15A enables transmission / reception of data with an external device. The communication device 15A transmits the pre-makeup data of the face F of the subject M to an external device. The communication device 15A receives post-makeup data indicating a procedure for applying makeup to the face F of the subject M from an external device. The communication device 15A communicates wirelessly or by wire. As the communication device 15A, for example, a mobile phone line including a 5G line or the like may be used. The communication device 15A may use, for example, a wireless communication standard including Wi-Fi (registered trademark). The communication device 15A may use a wired communication standard. In the communication device 15A, data transmission / reception is controlled by the transmission control unit 31A and the reception control unit 32A of the control unit 20A.

The transmission control unit 31A controls to transmit data via the communication device 15A. The transmission control unit 31A controls the communication device 15A to transmit the pre-makeup data, which is the photographing data obtained by photographing the face portion F of the subject M before makeup, to an external device.

The practitioner confirms the received pre-makeup data. Then, the practitioner generates post-makeup data based on the pre-makeup data, which is processed so as to be a model makeup according to the face F of the subject M. The practitioner superimposes makeup that matches the subject M in terms of color, shade, lightness and darkness, and range on the pre-makeup data. At this time, the practitioner generates post-makeup data so that the procedure for actually applying makeup to the face F of the subject M can be understood. In this way, the post-makeup data processed as if the makeup was applied to the pre-makeup data is generated.

The reception control unit 32A controls the communication device 15A to receive the post-makeup data processed as if the pre-makeup data was applied from an external device. The reception control unit 32A stores the acquired post-makeup data in the moving image data storage unit 12. In this embodiment, the post-makeup data is used as moving image data.

Next, the flow of processing in the control unit 20A, which is a makeup support control device, will be described with reference to FIG. 7. The processing of steps S123 to S126 is the same as that of steps S102 to S105 of the flowchart shown in FIG.

The control unit 20A transmits the pre-makeup data to the practitioner by the communication device 15A by the transmission control unit 31A (step S121). The control unit 20A proceeds to step S122.

The control unit 20A receives the post-makeup data from the practitioner by the communication device 15A by the reception control unit 32A (step S122). The received post-makeup data is stored in the moving image data storage unit 12. The control unit 20A proceeds to step S123.

In this way, the model image generated by the practitioner according to the face F of the subject M is projected.

As described above, in the present embodiment, the model image generated by the practitioner according to the face F of the subject M can be used. According to the present embodiment, it is possible to support the subject M to learn a makeup procedure suitable for the face F.

By the way, although the makeup support system 1 according to the present invention has been described so far, it may be implemented in various different forms other than the above-described embodiment.

Each component of the illustrated makeup support system 1 is functionally conceptual and does not necessarily have to be physically configured as shown in the figure. That is, the specific form of each device is not limited to the one shown in the figure, and all or part of the device is functionally or physically dispersed or integrated in an arbitrary unit according to the processing load and usage status of each device. You may.

The configuration of the makeup support system 1 is realized, for example, by a program loaded in a memory as software. In the above embodiment, it has been described as a functional block realized by cooperation of these hardware or software. That is, these functional blocks can be realized in various forms by hardware only, software only, or a combination thereof.

The above-mentioned components include those that can be easily assumed by those skilled in the art and those that are substantially the same. Further, the above configurations can be combined as appropriate. Further, various omissions, substitutions or changes of the configuration can be made without departing from the gist of the present invention.

In the above, the projection device 13 has been described as projecting a model image from the outside of the mirror 10 onto the face portion F of the subject M, but the present invention is not limited to this. The projection device 13 is arranged inside the mirror 10 which is a half mirror, and may be controlled to be superimposed on the face portion F of the subject M displayed on the surface of the mirror 10 and projected from the inside. In this case, the model image is not projected on the face F of the subject M. The subject M can confirm the state in which the model image is superimposed on the face portion by the mirror 10.

In the above, the subject M has been described as applying makeup while checking the mirror 10, but the present invention is not limited to this. Instead of the mirror 10, a confirmation display device such as a display for displaying the shooting data of the subject M may be provided. In other words, it suffices to have a face display device such as a mirror 10 or a confirmation display device.

1 Makeup support system 10 Mirror 11 Camera 12 Video data storage unit 13 Projection device 14 Display device 20 Control unit (makeup support control device)
21 Shooting data acquisition unit 22 Video data acquisition unit 23 Video processing unit 231 Face recognition unit 232 Processing unit 233 Judgment unit 24 Projection image generation unit 25 Projection control unit 26 Display image generation unit 27 Display control unit M Target person F Face unit

Claims (5)

A projection control unit that controls to intermittently project a model image showing the makeup procedure that serves as a model for each part according to the subject's face.
A shooting data acquisition unit that acquires shooting data of the face, and a shooting data acquisition unit.
A determination unit for determining the finish of makeup by comparing the state of makeup on the face of the shooting data with the state of makeup on the model image.
Equipped with
The determination unit makes a determination by comparing the shooting data shot during the period when the model video is not projected with the model video projected immediately before.
Makeup support control device. Processing department that processes video data related to makeup,
Equipped with
The moving image data is a photograph of the procedure for applying makeup.
The processing unit divides the moving image data and processes the moving image data to generate the model image for each part.
The makeup support control device according to claim 1. A transmission control unit that controls the transmission of shooting data obtained by photographing the face before makeup, and
A reception control unit that controls to receive post-makeup data processed as if makeup was applied to the pre-makeup shooting data.
Equipped with
The received post-makeup data is used as the model image.
The makeup support control device according to claim 1 or 2. The makeup support control device according to any one of claims 1 to 3.
A projection device that intermittently projects a model image showing the procedure of makeup that serves as a model for each part, and
A half mirror that reflects the subject's face is provided.
The projection control unit controls the projection device so as to project in accordance with the face portion displayed on the surface of the half mirror.
Makeup support system. A projection control step that controls to intermittently project a model image showing the makeup procedure that serves as a model for each part according to the subject's face, and
The shooting data acquisition step for acquiring the shooting data obtained by shooting the face portion, and
A determination step of comparing the makeup state of the face portion of the shooting data with the makeup state of the model image to determine the finish of the makeup.
Including
In the determination step, the determination is made by comparing the shooting data captured during the period when the model image is not projected with the model image projected immediately before.
Makeup support control method.

Images