JP2005181688A - Makeup presentation - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To effectively and plainly appeal the combinations of various kinds of cosmetics and makeup procedures to users in makeup presentation. <P>SOLUTION: In a makeup presentation system 1, a CPU 400 acquires cosmetic data and plain face image data and generates decorated face image data on the basis of the acquired cosmetic data and plain face image data. The generated decorated face image data are protected to a three-dimensional image 10 by a projector 20. Thereby a demonstrator can perform makeup presentation while quickly projecting a face image decorated by makeup intended by the demonstrator herself (or himself). <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

  The present invention relates to makeup presentation technology, and more particularly to technology for realizing a quick presentation of a wide variety of cosmetics.

  In presentations that announce, introduce, and promote new cosmetic products to users, it is important to appeal to the user in terms of the texture, color, and atmosphere of cosmetics when using them, and make-up techniques using the cosmetics. However, it is extremely difficult for a performer to do this verbally. Therefore, in the presentation of cosmetics, some presentation support means for appealing to the user's vision is required. Conventionally, it has been performed by broadcasting a VTR that records an image created by photographing a model with makeup in advance, or by a demonstration of actually applying makeup to a model.

  At present, however, user preferences and requirements have diversified, and a wide variety of cosmetics have been developed and marketed in response to such needs. In addition, the cosmetics are greatly different in texture, color tone, impression, etc. during use depending on the skin condition, color tone, etc. of the person who uses the cosmetic product. Therefore, combinations of cosmetics such as lipsticks, foundations and mascaras, and combinations of these with human skin types are extremely diverse.

  Under such circumstances, there is a problem that in the method of broadcasting a previously created video, various combinations and makeup techniques cannot be visually reproduced on the spot according to the user's request. On the other hand, the method of actually using a model can reproduce only a combination of skin types and cosmetics of a limited model, and the model needs to remove makeup to change the makeup. There was a problem that it was not possible to respond flexibly and quickly.

  SUMMARY OF THE INVENTION An object of the present invention is to display a wide variety of cosmetic combinations and makeup techniques in an easy-to-understand manner effectively for a user in a makeup presentation in a prompt manner.

  In order to solve at least a part of the above problems, a first aspect of the present invention provides a makeup presentation method. The makeup presentation method according to the first aspect of the present invention acquires the face image data representing the face, projects the face image on a three-dimensional image using the obtained face image data, and projects the face image data. Obtaining cosmetic data to be used for decoration of a face image, generating decorative face image data based on the acquired cosmetic data and the acquired bare face image data, instead of the face image data being projected, The face image decorated on the three-dimensional image is projected using the generated decoration face image data.

  According to the makeup presentation method according to the first aspect of the present invention, decorative face image data can be generated and projected based on the acquired cosmetic data and the face image data. Therefore, the performer can quickly display the face image made up by the cosmetics selected from a wide variety of cosmetics by inputting the cosmetic data during the makeup presentation. In addition, by projecting a face image onto a three-dimensional image, the texture and color tone of cosmetics and the makeup method using the cosmetics can be expressed more realistically, and can be displayed effectively and clearly to the user. .

  In the makeup presentation method according to the first aspect of the present invention, when there is a decoration change request while projecting the decorated face image, it is used to further decorate the decorated face image. Acquiring cosmetic data, changing the decorative face image data based on the acquired cosmetic data, and using the changed decorative face image data instead of the decorative face image data being projected, the three-dimensional It is preferable to project a face image decorated on the image.

  In such a case, the projected decorative face image can be changed on the basis of the cosmetic data acquired in response to the request even after once projecting the decorated decorative face image. Therefore, the performer can add cosmetics to be applied to the face image flexibly and quickly and change the combination of cosmetics in the makeup presentation.

  In the makeup presentation method according to the first aspect of the present invention, if there is a request to change the face during projection of the decorated face image, obtain face data for changing the face image, Based on the acquired face image data, the face image data is changed, the face image data is changed based on the changed face image data, and the changed face image data is changed instead of the face image data being projected. It is preferable to project the face image decorated on the three-dimensional image using the decorative face image data.

  In such a case, during the projection of the decorative face image, it is possible to change the real face image that is the base of the decorative face image being projected based on the raw face data acquired upon request. Therefore, the performer can quickly change the combination of the face and cosmetics in the makeup presentation.

  In the makeup presentation method according to the first aspect of the present invention, the cosmetic data includes position information to be decorated on the face image, and the face image is decorated with cosmetics based on the position information. When specifying the position and generating or changing the decorative face image data, the position information may be used in addition to the cosmetic data.

  In such a case, the cosmetic data includes position information to be decorated, and the decoration face image data can be generated or changed using the position information. As a result, it is possible to accurately generate or change the face image data intended by the performer.

  In the makeup presentation method according to the first aspect of the present invention, when acquiring position information to be decorated with cosmetics in a face image and generating or changing the decorative face image data, in addition to the cosmetic data, The acquired position information may be used.

  In such a case, in addition to the cosmetic data, position information to be decorated or changed can be acquired, and decorated face image data can be generated or changed based on these. As a result, it is possible to accurately generate or change the face image data intended by the performer.

  In the makeup presentation method according to the first aspect of the present invention, the cosmetic data or the face data is acquired by acquiring cosmetic information for specifying the cosmetic data or face information for specifying the face data. Then, it may be performed by acquiring cosmetic data or facial data corresponding to the acquired cosmetic information or the facial information from a storage device that stores cosmetic data or facial data in advance.

  In such a case, based on the acquired cosmetic information and face information, the corresponding cosmetic data and face data can be acquired from a storage device in which the cosmetic data and face data are recorded in advance. As a result, the facial image data intended by the performer can be generated or changed only by simple cosmetic information and face information input by the performer.

  In the makeup presentation method, the cosmetic information or the face information is acquired by acquiring voice information including the cosmetic information or the face information, converting the acquired voice information into character information, and converting the converted information. It may be performed by extracting and recognizing the cosmetic information or the face information from character information.

  In such a case, the cosmetic information or the face information can be acquired by recognizing the cosmetic information or the face information from the acquired voice information. As a result, the face image data intended by the performer can be generated or changed when the performer inputs the cosmetic information and the face information by voice.

  The second aspect of the present invention provides a makeup presentation method. In the makeup presentation method according to the second aspect of the present invention, the face image data representing the face is acquired, and the face image is projected onto a three-dimensional image using the acquired face image data, and the projection is performed. Obtaining cosmetic data to be used for decoration of a face image, generating decorative image data having a shape corresponding to a region to be decorated based on the acquired cosmetic data, and overlaying the face image projected on the three-dimensional image Then, a decoration image using the generated decoration image data is projected.

  According to the makeup presentation method according to the second aspect of the present invention, it is possible to generate decoration image data based on the acquired cosmetic data and project the decoration image data on the face image. Therefore, the performer can quickly display the face image made up by the cosmetics selected from a wide variety of cosmetics by inputting the cosmetic data during the makeup presentation. In addition, by projecting a face image onto a three-dimensional image, the texture and color tone of cosmetics and the makeup method using the cosmetics can be expressed more realistically, and can be displayed effectively and clearly to the user. .

  A third aspect of the present invention provides a makeup presentation system that projects a face image. The makeup presentation system according to the third aspect of the present invention includes a three-dimensional image used as a screen, a face image data selection means for selecting face image data representing a face, and a cosmetic for decorating the face image Cosmetic data acquisition means for acquiring data, decorative face image data generation means for generating decorative face image data using the previous face image data and the previous face cosmetic data, and the generated decorative face image data or the face Projection means for projecting a face image onto the three-dimensional image using image data is provided.

  According to the makeup presentation system according to the third aspect of the present invention, the decorative face image data can be generated and projected using the acquired cosmetic data and the selected bare face image data. Therefore, when a performer inputs cosmetic data during a makeup presentation, a face image made up by a cosmetic selected from a wide variety of cosmetics can be quickly displayed. In addition, by projecting a face image on a three-dimensional image, the texture and color tone of the cosmetics and the makeup method using the cosmetics can be displayed more realistically.

  The makeup presentation system according to the third aspect of the present invention further includes a decoration face image data changing means for changing the generated decoration face image data, and the cosmetic data acquisition means generates the decoration face image data. When the cosmetic data is further acquired later, it is preferable that the decorative face image data changing means changes the decorative face image data based on the further acquired cosmetic data.

Even after the decoration face image data is generated, the decoration face image data can be changed based on the acquired cosmetic information. Therefore, the performer can add the cosmetics to be applied to the face image flexibly and quickly and change the combination of the cosmetics in the makeup presentation.

  The makeup presentation system according to the third aspect of the present invention further includes a face data acquisition unit that acquires the face data for changing the face image data, and the decoration face image data change unit includes the acquired face image. It is preferable that the face image data is changed based on the data, and the decoration face image data is changed based on the changed face image data.

  In such a case, based on the acquired face data, the face image that is the base of the decorated face image can be changed. Therefore, the performer can quickly change the combination of the face and cosmetics in the makeup presentation.

  The makeup presentation system according to the third aspect of the present invention further includes position information acquisition means for acquiring position information for applying decoration or a face change with cosmetics in the face image, the decoration face image data generation means, or The decorative face image data changing means may generate or change the decorative face image data using the position information in addition to the cosmetic data or the bare face data.

  In such a case, in addition to the cosmetic data or the face data, position information on the face image to which the decoration or face change by the cosmetics is applied can be acquired, and the decoration face image data can be generated or changed based on these. As a result, the generation or change of face image data intended by the performer can be performed more accurately.

  In the makeup presentation system according to the third aspect of the present invention, the position information acquisition means includes a touch panel for inputting the position information, and a position to be recognized by converting the input position information into position information in a face image. Information recognition means may be used.

  In such a case, the performer can easily input position information using the touch panel.

  In the makeup presentation system according to the third aspect of the present invention, the position information acquisition means is arranged on the face image projection surface of the three-dimensional image and pointed out on the face image projection surface of the three-dimensional image. A tactile sensor that inputs position information and position information recognition means that converts the input position information into position information in a face image and recognizes the position information may be used.

  In such a case, the performer can input the position information by touching the face portion of the three-dimensional image. As a result, when a decorative face image with makeup is projected based on the input position information, it is possible to make it appear as if the performer is actually applying makeup to the face portion of the three-dimensional image.

  The makeup presentation system according to the third aspect of the present invention further includes a cosmetic data storage unit that stores cosmetic data in advance, and a facial data storage unit that stores facial data in advance. The data acquisition means includes: information input means for inputting cosmetic information for specifying the cosmetic data or face information for specifying the face data; and the cosmetic information corresponding to the input cosmetic information or the face information. It may be an information search means for searching for and acquiring data or face data from the cosmetic data storage means or the face data storage means.

  In such a case, since the corresponding cosmetic data and face data are acquired from the information storage means in which the cosmetic data and face data are recorded in advance based on the input cosmetic information and face information, the performer can easily apply the cosmetic information and face information. The face image data intended by the performer can be generated or changed simply by inputting information.

  In the makeup presentation system according to the third aspect of the present invention, the information input means converts a voice input means for inputting voice information, and converts the inputted voice information into character information. From the converted character information, Voice recognition means that extracts and recognizes the cosmetic information or the face information may be used.

  In such a case, cosmetic information or face information is input by extracting and recognizing the cosmetic information or face information from the input voice information, so that the performer inputs the cosmetic information and face information by voice. The face image data intended by the performer can be generated or changed.

  In addition to this, the makeup presentation method according to the first aspect of the present invention can also be realized as a makeup presentation program and a computer-readable recording medium that records the makeup presentation program.

  Hereinafter, a makeup presentation method and a makeup presentation system according to the present invention will be described based on examples with reference to the drawings.

·Example:
With reference to FIG. 1 and FIG. 2, the structure of the makeup presentation system which concerns on the Example of this invention is demonstrated. FIG. 1 is an explanatory diagram showing a schematic configuration of a makeup presentation system according to the present embodiment. FIG. 2 is a schematic front view of the three-dimensional image 10 according to the present embodiment.

  The makeup presentation system 1 according to this embodiment includes a three-dimensional image 10 used as a screen, a projector 20 that projects an image onto the three-dimensional image 10, and adjustment of the projection position of the image on the three-dimensional image 10. Two imagers 30 used for the above, a personal computer 40 for generating and outputting image data, a microphone 50 for inputting sound, and a touch panel monitor serving as both a monitor for the personal computer 40 and a position information input means 60.

  The three-dimensional image 10 has a human head shape. As shown in FIG. 2, the three-dimensional image 10 does not have the shape of eyes or eyebrows, and the portion 106 corresponding to the eyes has a flat shape. Therefore, the eye image projected from the projector can be projected beautifully without causing distortion. On the other hand, the three-dimensional image 10 has a three-dimensional shape (102, 104) for the nose and mouth, and when the image is projected, the texture, color tone, and the cosmetics of the cosmetics such as lipstick are displayed. The makeup method used is expressed more realistically in three dimensions.

  Further, as shown in FIG. 2, five light-emitting diodes (LEDs) 108 are embedded in the surface of the face portion of the three-dimensional image 10 so as not to stand out. The light emitting diode 108 is connected to the wireless receiver 70, and is turned on and off by the personal computer 40 via the wireless transmitter 80 connected to the personal computer 40. When the personal computer 40 (CPU 400) analyzes the captured face image data of the three-dimensional image 10 acquired via the image pickup device 30 in the projection image adjustment process described later, the light-emitting diode 108 It functions as a mark for recognizing the position, size, etc. For this reason, the five light emitting diodes 108 are arranged in a well-balanced manner at appropriate intervals on the face portion of the three-dimensional image 10 so that the function as a mark can be sufficiently exhibited.

  The projector 20 is a device that generates an optical image based on input image data, and projects the generated optical image on a screen with illumination light emitted from a light source. The projector 20 is connected to the personal computer 40 via the connection cable C1. The projector 20 projects a face image on the three-dimensional image 10 using the face image data output from the personal computer 40.

  The two image pickup devices 30 are arranged so as to photograph the face portion of the three-dimensional image 10 and are connected to the personal computer 40 via the connection cable C2. The imaging device 30 outputs the captured image to the personal computer 40 as digital image data. Instead of the image capturing device 30, an image capturing device that outputs a captured image as an analog image signal may be used, and a means for converting the analog image signal into digital image data may be provided on the personal computer 40 side.

  The personal computer 40 is a commonly used type of computer, a central processing unit (CPU) 400 that executes recognition processing of acquired information such as voice information, generation processing of image data, and the like, and acquired cosmetic data. Random access memory (RAM) 401 that temporarily stores various data such as, a program for executing recognition information recognition processing, image data generation processing, etc., such as voice information, cosmetic texture, color tone, etc. A hard disk (HDD) 402 for storing cosmetic data such as cosmetics, facial data related to a natural face before makeup, and basic facial image data. In addition to this, the personal computer 40 has input / output terminals (not shown) for connecting connection cables from the projector 20, the image pickup device 30, the microphone 50, the touch panel monitor 60, and the wireless transceiver 70. I have. Instead of the HDD 402, a read-only memory (ROM) or a hard disk on a server connected to the personal computer 40 via a network may be used.

  The microphone 50 outputs the input voice as a voice signal to the personal computer 40 connected via the connection cable C3.

  The monitor 60 with a touch panel is connected to the personal computer 40 by a connection cable C4. The touch panel monitor 60 is configured by, for example, a touch panel unit 604 configured by a transparent resistive film type tablet, electrostatic induction type tablet, and the like and a display unit 602 such as a liquid crystal display device overlapped. When an arbitrary coordinate point (XY coordinate) on the touch panel unit 604 is pressed with a finger or a pen, a signal corresponding to the pressed coordinate point can be output to the personal computer 40. The display unit 602 functions as a monitor for the personal computer 40.

  With reference to FIG. 3, an outline of a functional configuration of the personal computer 40 (CPU 400) according to the present embodiment will be described. FIG. 3 is a block diagram showing a functional configuration of the personal computer 40 (CPU 400) according to the present embodiment.

  The position information recognition unit M1 recognizes position information in the face image corresponding to the point pressed by the performer based on the coordinate points obtained from the touch panel, and the decoration face image data generation unit M6 or the decoration face image data change unit. Send to M7.

  The voice recognition unit M2 converts the voice signal obtained from the microphone 50 into character information, and is included when the converted character information includes predetermined predetermined cosmetic information and face information. The cosmetic information and the face information are extracted and recognized and sent to the data search unit M3.

  The data search unit M3 searches the HDD 402 based on the cosmetic information and the face information obtained from the voice recognition unit M2, acquires corresponding information, and displays the decorative face image data generation unit M6 or the decorative face image data change unit. Send to M7. That is, when the information obtained from the voice recognition unit M2 is cosmetic information, the HDD 402 is searched to obtain corresponding cosmetic data, and when the information obtained from the voice recognition means is bare face information. The HDD 402 is searched to obtain corresponding face data.

  In addition, in the presentation, the face image selection unit M4 selects a face image that is a base of face image data processing and acquires it as face image data. The face image selection unit M4 sends the acquired face image data to the face image adjustment unit M5.

  The face image adjustment unit M5 outputs the face image data obtained from the face image selection unit M4 to the projector 20. The face image adjustment unit M5 adjusts the size and position of the face image data of the projected face image based on the captured face image data obtained from the image pickup device 30. Further, the adjusted face image data is sent to the decorative face image data generation unit M6.

  The decorative face image data generation unit M6 includes cosmetic data obtained from the data search unit M3, position information on the face image obtained from the position information recognition unit M1, and face image data obtained from the face image adjustment unit M5. The decorative face image data is generated based on the above. The decorative face image data generation unit M6 outputs the generated decorative face image data to the projector 20.

  The decorative face image data changing unit M7 is obtained from the decorative face image data generating unit M6 based on the cosmetic data obtained from the data searching unit M3 and the position information in the face image obtained from the position information recognizing unit M1. Change the decorated face image data. Further, the decorative face image data changing unit M7 changes the decorative face image data based on the bare face data obtained from the data search unit M3 and the position information in the face image obtained from the position information recognition unit M1. The decorative face image data generation unit M6 outputs the changed decorative face image data to the projector 20.

  In this embodiment, the information input means is constituted by the microphone 50 and the voice recognition unit M2. The cosmetic data acquisition unit and the face data acquisition unit are configured by an information input unit and a data search unit M3. The position information acquisition unit includes the touch panel monitor 60 and the position information recognition unit M1.

  A presentation support process by the makeup presentation system 1 according to the present embodiment will be described with reference to FIGS. FIG. 4 is a flowchart showing the processing routine of the presentation support process by the makeup presentation system 1 according to the present embodiment. FIG. 5 is a flowchart illustrating the routine of the face image projection process according to the embodiment. FIG. 6 is a flowchart illustrating the processing routine of the decoration face image data generation process according to the embodiment. FIG. 7 is a flowchart illustrating a processing routine of position information acquisition processing according to the embodiment. FIG. 8 is a flowchart illustrating a processing routine of data acquisition processing according to the embodiment. FIG. 9 is an explanatory diagram showing an example of cosmetic data recorded in the HDD 402. FIG. 10 is an explanatory diagram showing a specific example of generation of decorative face image data. FIG. 11 is a flowchart illustrating the processing routine of the decorative face image data change process according to the embodiment. FIG. 12 is an explanatory diagram showing an example of bare face data recorded in the HDD 402. FIG. 13 is an explanatory diagram illustrating a first specific example of changing decorative face image data. FIG. 14 is an explanatory diagram showing a second specific example of changing decorative face image data.

  The presentation support process by the makeup presentation system 1 according to the present embodiment is started by any start instruction from the performer. For example, when an icon for start instruction is displayed on the touch panel monitor 60, the start may be started when the icon is selected, or the performer instructs the start by voice via the microphone 50. May be started when.

  As shown in FIG. 4, when receiving an instruction to start the presentation support process, the personal computer 40 (CPU 400) acquires the face image data and temporarily stores it on the RAM 401. (Step S102). That is, first, in the presentation, the face image data of the face image that is the base of the face image to be displayed is captured. The acquired facial image data is selected by a performer from a group of facial image data recorded in advance on, for example, the HDD 402 or a hard disk on a server connected to the personal computer 40 via a network.

  The CPU 400 outputs the acquired bare face image data to the projector 20, and executes a bare face image projection process for projecting the bare face image onto the three-dimensional image 10 via the projector 20 (step S104).

  In the face image projection process (step S104), a process for adjusting the position, size, and the like of the face image to be projected is performed. In other words, the three-dimensional image 10 and the projector 20 are arranged so that the face image projected from the projector 20 is projected onto the face area of the three-dimensional image 10, but only by adjusting the arrangement position thereof. It is difficult to match the face image with the face area of the three-dimensional image 10. Also, depending on the presentation venue, the arrangement position of the device may be limited. Further, it may be necessary to use a three-dimensional image 10 having a different size in accordance with the size of the presentation venue.

  Here, the makeup presentation system 1 according to the present embodiment automatically adjusts the size and position of the image data of the projected image during the projection of the face image, so that the projected face image and the face area of the three-dimensional image 10 are perfectly matched. And an adjustment process for realizing a beautiful three-dimensional projection. For example, the CPU 400 adjusts the projected face image data so that the lip image is projected onto the lip shape 104 on the three-dimensional image 10 at an appropriate position and size. Hereinafter, such a face image projection process will be described.

  As shown in FIG. 5, when starting the face image projection process, the CPU 400 first sends a lighting instruction to the light emitting diode 108 via the wireless transmitter 80 and the wireless receiver 70 and is attached to the three-dimensional image 10. The five light emitting diodes 108 are turned on (step S202).

  The CPU 400 acquires the image of the three-dimensional image 10 captured by the two image capturing devices 30 as captured face image data (step S204).

  Based on the acquired projected face image data, the CPU 400 adjusts the face image data so that the size and position of the face image fit the face area of the three-dimensional image 10 (step S206). That is, the CPU 400 analyzes the captured face image data acquired from the imaging device 30 and recognizes the positions of the five light emitting diodes 108. From the recognized position of the light emitting diode 108, the CPU 400 estimates the position and size of the doll and the distance from the projector to the doll. Two imagers 30 are used because the distance from the projector to the doll can be estimated by analyzing two imaged face image data photographed from different angles by the two imagers. It is. Based on the estimated position, size, and distance, the CPU 400 adjusts the face image data.

  The CPU 400 outputs the adjusted face image data to the projector 20, and projects the adjusted face image on the three-dimensional image 10 via the projector 20 (step S208).

  The CPU 400 acquires again the image of the three-dimensional image 10 captured by the two image capturing devices 30 as captured face image data (step S210).

  The CPU 400 analyzes the newly acquired captured face image data and determines whether further adjustment of the bare face image data is necessary (step S212). That is, the CPU 400 compares the position of the face image projected on the three-dimensional image 10 with the position of the light emitting diode 108 on the acquired captured face image data, and projects the face area of the three-dimensional image 10. Whether or not adjustment is necessary is determined based on whether or not the positional deviation from the image is sufficiently small. In order to facilitate the determination at this time, the CPU 400 may add a reference point to be compared with the position of the light emitting diode 108 to the bare face image data in a color that is easy to recognize when projecting the bare face image data (step S208).

  As a result, when it is determined that further adjustment of the face image data is necessary (step S212: NO), the CPU 400 repeats the above-described adjustment processing (steps S206 to S212). If it is determined that the adjustment has been completed (step S212: YES), the CPU 400 transmits a turn-off instruction to the light-emitting diode 108 via the wireless transmitter 80 and the wireless receiver 70, and turns off the light-emitting diode 108 ( Step S214).

  The face image projection process is completed, and the presentation starts with the face image correctly projected onto the three-dimensional image 10.

  During the presentation, the CPU 400 generates decorative face image data based on the cosmetic information acquired via the microphone 50, the position information acquired via the touch panel monitor 60, and the bare face image data previously acquired (step). S106).

  As shown in FIG. 6, in the decorative face image data generation process, the CPU 400 first acquires position information for specifying a part to be decorated to be decorated with cosmetics in the face image (step S302). In the position information acquisition process, as shown in FIG. 7, the CPU 400 determines whether or not there is position information input from the touch panel monitor 60 (step S402). If there is no input (step S402: NO), the CPU 400 waits until there is an input. If there is an input (step S402: YES), the CPU 400 acquires a coordinate signal corresponding to the input coordinate point, converts the acquired coordinate signal into position information in the face image, and stores it in the RAM 401. (Step S404). For example, the face image may be divided into 100 vertical and 100 horizontal horizontal small areas, and the coordinates (x, y) of the small area to which the position represented by the acquired coordinate signal belongs may be used as position information in the face image. Alternatively, the face image is divided into parts such as eyes, nose, mouth, cheeks, and foreheads in advance, and the part represented by the acquired coordinate signal may be used as position information in the face image.

  CPU 400 obtains cosmetic data relating to the cosmetic used for decoration of the face image (step S304). In the cosmetic data acquisition process (step S304), as shown in FIG. 8, the CPU 400 determines whether or not there is a voice input from the microphone 50 (step S502). If there is no input (step S502: NO), the CPU 400 waits until there is an input. If there is an input (step S502: YES), the CPU 400 acquires the input audio information as an audio signal and temporarily stores it in the RAM 401 (step S504). Next, the CPU 400 converts the acquired voice signal into character information, analyzes the converted character information, and if predetermined predetermined cosmetic information is included, extracts the cosmetic information. Obtain (step S506).

  As the cosmetic information, for example, as shown on the left side of FIG. 9, a product name of the cosmetic product, a word representing the color of the cosmetic product, or the like can be used. The number of cosmetic information to be acquired is not limited to one, and only the number necessary for specifying cosmetic data used for decoration is acquired. For example, in the example shown in FIG. 9, cosmetic data is specified using two items of product name and cosmetic color, but only the product number may be used, or the cosmetic name and color number 2 may be used. Two pieces of information may be used.

  CPU 400 determines whether all cosmetic information necessary for specifying cosmetic data has been acquired (step S508). When it is determined that not all have been acquired (step S508: NO), that is, when the acquired audio information does not include predetermined cosmetic information and the cosmetic information cannot be acquired, or the cosmetic information is acquired. If it is possible, however, if it is necessary to further acquire cosmetic information in order to specify the cosmetic data, the CPU 400 returns to step S502 and acquires all necessary cosmetic information (steps S502 to S508). repeat.

  When all necessary cosmetic information is acquired (step S508: YES), the CPU 400 searches the HDD 402 using the acquired cosmetic information and acquires corresponding cosmetic data (step S510). For example, as shown on the right side of FIG. 9, the cosmetic data includes image data necessary for generating decorative face image data, and is recorded in the HDD 402 in association with the cosmetic information as shown on the left side of FIG. 9. Yes. The corresponding cosmetic data can be searched based on the associated cosmetic information. Specifically, as shown in FIG. 9, the CPU 400 uses the information “BBB” and “black 1” as the corresponding cosmetic data as the cosmetic name “eye color”, makeup color data, and composition rate “0”. .3 "is acquired.

  When the cosmetic data is acquired, the CPU 400 generates decorative face image data based on the acquired position information, cosmetic data, and bare face image data (step S306). For example, the decoration area to be decorated is determined based on the position information and the cosmetic data, and the decoration face image data in which the decoration area is decorated is generated based on the bare face image data corresponding to the determined decoration area and the cosmetic data. To do.

  As a specific example, a case will be described in which the coordinates of the upper part of the right eye in the image data are acquired as position information, and the cosmetic name “eye color”, cosmetic color data, and composition rate “0.7” are acquired as cosmetic data. The CPU 400 determines the decoration area as a predetermined area above the right eye based on the coordinates of the upper right eye and the cosmetic name “eye color”. Then, the CPU 400 synthesizes the color based on the makeup color data and the color of the predetermined area above the right eye in the face image data according to the obtained synthesis rate “0.7” at a ratio of 0.7: 0.3. The synthesized color is generated. Further, the CPU 400 replaces the color of the predetermined area above the right eye in the decorative face image with the generated composite color, and generates decorative face image data as shown in FIG.

  The CPU 400 outputs the generated decorative face image data to the projector 20, and projects the decorative face image onto the three-dimensional image 10 via the projector 20 (step S108). That is, when the performer inputs the type and color of cosmetics and the position to apply makeup to the personal computer 40 via the microphone 50 or the touch panel monitor 60 in the makeup presentation, the decorative face image with makeup automatically applied. Is projected onto the three-dimensional image 10.

  Thereafter, CPU 400 determines whether or not there is a request to change the decorative face image (step S110).

  When there is a change request (step S110: YES), the CPU 400 displays the decorative face based on the cosmetic information or the face information acquired through the microphone 50 and the position information acquired through the touch panel monitor 60. A decorative face image data changing process for changing the image data is executed (step S114).

  In the decorative face image data change process, cosmetic data and position information are acquired, and the decorative face image data is changed based on them, and the raw face data and position information are acquired, and based on these In some cases, the image data is changed, and the decorative face image data is changed based on the changed face image data. That is, the processing differs depending on whether the voice information input from the microphone 50 includes the face information that requests the change of the face image data or the cosmetic information that requests that the decorative face image be further applied.

  As shown in FIG. 11, the CPU 400 first acquires position information via the touch panel monitor 60 (step S602). Since this position information acquisition process is the same as the position information acquisition process in the decorative face image data generation process described above (see FIG. 7), description thereof is omitted.

  CPU 400 acquires cosmetic data or real face data based on the audio information input from microphone 50 (step S604). Since this data acquisition process is substantially the same as the cosmetic data acquisition process in the decorative face image data generation process described above (see FIG. 8), it will be briefly described.

  In this data acquisition process, the CPU 400 is slightly different from the cosmetic data acquisition process in the decorative face image data generation process, and not only when the predetermined audio information is included in the acquired audio information, but is also determined in advance. Even when the predetermined face information is included, the face information is extracted and acquired (step S506).

  As the face information, for example, as shown on the left side of FIG. 12, information indicating a change type, a color, or the like can be used. The face information to be acquired is not limited to one as in the case of cosmetic information, and is acquired as many times as necessary to specify the face data necessary for changing the face image. For example, as shown on the left side of FIG. 12, two pieces of information “skin color” and “black” may specify the face data necessary to change the skin color of the face image to black. , One piece of information “stain” may specify the face data necessary for changing the spot to the position indicated in the face image.

  When all the necessary cosmetic information or face information is acquired, if the acquired information is cosmetic information, the CPU 400 uses the acquired cosmetic information in the same manner as the cosmetic data acquisition process in the decorative face image data generation process. The HDD 402 is searched to obtain corresponding cosmetic data. On the other hand, when the acquired information is the face information, the CPU 400 searches the HDD 402 using the acquired face information and acquires corresponding face data (step S510 in FIG. 8). That is, in this information acquisition process, the CPU 400 may acquire cosmetic data or acquire face data.

  The face data includes, for example, face data such as image data necessary for changing the face image data as shown on the left side of FIG. 12, and is recorded in the HDD 402 in association with the face information shown on the right side of FIG. Has been. The corresponding face data can be searched based on the associated face information. Specifically, as shown in FIG. 12, based on the information of “skin color” and “black”, the CPU 400 has the change type “skin color”, the change color data, Three of the synthesis rate “1.0” are acquired.

  CPU 400 determines whether the acquired information is real face data or cosmetic data (step S606). When the acquired information is cosmetic data (step S606: NO), the CPU 400 changes the decorative face image data based on the acquired position information and cosmetic data (step S608). In this case, the modification of the decorative face image data is almost the same as the generation of the decorative face image data described above. However, unlike the generation of the decorative face image data, the decorative face image data before the change is used instead of the real face image data. As a base. For example, the decoration area to be decorated is determined based on the position information and the cosmetic data, and the decoration face image data in the decoration area is determined based on the decorative face image data before the change corresponding to the determined decoration area and the cosmetic data. change.

  As a specific example, a case will be described in which the CPU 400 acquires cosmetic data related to lipstick and position information indicating a mouth portion when a decorative face image with an eye color is projected in a presentation. When the CPU 400 executes this process, as shown in FIG. 13, the decorative face image data of the decorative face image to which the eye color is applied is changed to decorative face image data in which lipstick is applied to the mouth portion.

  When the acquired information is bare face data (step S606: YES), the CPU 400 changes the face image data based on the acquired position information and the face data (step S610). For example, based on the acquired position information and the face data, the face image change area to be changed is determined, and the face image change is performed based on the face image data and the face data corresponding to the determined face image change area. Change the face image data in the region.

  The CPU 400 changes the decorative face image data based on the changed bare face image data (step S608). For example, the CPU 400 stores, in the HDD 402 or the RAM 401, a processing history related to generation or change of decorative face image data executed before changing the face image data. Then, based on the changed face image data, the decoration face image data is changed by executing the generation or change process of the decoration face image data again according to the processing history.

  As a specific example, while projecting a decorative face image with an eye color and lipstick, the CPU 400 acquires the coordinates of a cheek in the image data as position information, and uses the skin type “skin color” as cosmetic data. The case where the changed color data and the composition rate “1.0” are acquired will be described. Based on the coordinates of the cheek portion and the skin type “skin color”, the CPU 400 determines the bare face image change region as the entire skin portion. The CPU 400 replaces the color of the entire skin portion in the face image data with the color based on the changed color data based on the acquired synthesis rate “1.0” (synthesizes at a ratio of 1.0: 0). Then, the CPU 400 executes generation or change processing of decorative face image data (change processing for applying eye color and processing for applying lipstick) performed before the change based on the changed face image data. Thus, the decorative face image data is changed as shown in FIG.

  The CPU 400 outputs the modified decorative face image data to the projector 20, and projects the decorative face image onto the three-dimensional image 10 via the projector 20 (step S108).

  When there is no change request (step S110: NO), the CPU 400 determines whether or not there is an end instruction (step S112). CPU 400 returns to step S110 again when there is no end instruction (step S112: NO), and ends the presentation when there is an end instruction (step S112: YES).

  As described above, according to the makeup presentation system according to the present embodiment, when a performer inputs sound including cosmetic information from the microphone 50 and inputs position information from the touch panel monitor 60, the face being projected is displayed. It is possible to quickly reflect the decoration instruction by the intended cosmetics on the image at the intended position.

  Further, even after the decorative face image is projected, when the performer inputs voice including cosmetic information from the microphone 50 and inputs position information from the touch panel monitor 60, the projected decorative face image is displayed as intended. Cosmetic decorations can be added or changed immediately. Furthermore, when the performer inputs sound including face information from the microphone 50 and inputs position information from the touch panel monitor 60, the face image that is the base of the decorative face image can be quickly changed. Therefore, it is possible to quickly and flexibly display a variety of combinations of cosmetics and face images obtained by combining a natural face and cosmetics according to a request from a user or the like and a presentation situation.

  Further, since cosmetic information is input by voice and position information is input by a touch panel, a face image can be generated or changed easily and accurately.

  Further, since the face image is projected onto the three-dimensional image 10, the texture and color tone of the cosmetics and the makeup method using the cosmetics can be expressed more realistically and effectively appealed to the user.

  In addition, since the size and position of the projected face image can be automatically adjusted to the three-dimensional image 10, a three-dimensional image having an appropriate size can be used according to the situation of the presentation venue, and the like. System installation is easy.

・ Modification:
Hereinafter, some modified examples of the present embodiment will be described.

  A first modification will be described with reference to FIGS. 15 to 16. FIG. 15 is an explanatory diagram showing a schematic configuration of a makeup presentation system according to the present modification. FIG. 16 is a schematic front view of the three-dimensional image 10 according to this modification. The components common to the makeup presentation system according to the embodiment are denoted by the same reference numerals and the description thereof is omitted.

  In this modification, the monitor 90 of the personal computer 40 is not a touch panel type but a general monitor such as a liquid crystal or a CRT.

  In the present modification, as shown in FIG. 16, as position information input means for inputting position information in a face image, a tactile sensor 110 is arranged on the face area surface on which the face image is projected in the three-dimensional image 10. .

  The tactile sensor 110 is configured to transmit a signal corresponding to a point pressed by a finger or the like to the personal computer 40 via the wireless transceiver 75. Then, the personal computer 40 (CPU 400) converts the signal acquired from the tactile sensor 110 into position information in the face image and acquires the same signal as the signal acquired from the touch panel monitor 60 in the embodiment.

  According to the modified example configured as described above, in addition to the same effects as in the embodiment, it is as if the performer is actually applying makeup to the three-dimensional image 10 while touching the three-dimensional image 10. You can give a presentation.

  A second modification will be described with reference to FIG. FIG. 17 is an explanatory diagram showing an outline of a method of forming a projected face image according to this modification. In the embodiment, for the face image obtained by decorating the bare face image, the decorated face image data is generated, and the decorated face image is projected onto the three-dimensional image 10 using the generated decorated face image data. However, in this modification, decorative face image data is not generated.

  Instead, in this modification, decoration image data having a shape of a region to be decorated in the face image is generated. For example, as shown in FIG. 17B, the decorative image data of lipstick and eye color has image data that reproduces the color and texture of lipstick on the shape of the lips, and the shape of the upper region of the eye to which the eye color is applied. It consists of image data that reproduces the color and texture of the eye color. Then, the decoration image using the generated decoration image data is projected onto the bare face image as shown in FIG. 17A projected on the three-dimensional image 10. As a result, as shown in FIG. 17C, a face image as if the face image is decorated with cosmetics is reproduced on the three-dimensional image 10.

  Such projection may be executed by using, as the projector 20, a projector that can simultaneously display image signals supplied from a plurality of different image supply devices (a projector capable of so-called overlay display). Alternatively, a personal computer having a function of outputting image data obtained by superimposing two image data (a so-called superimpose function) may be used as the personal computer 40.

  In the decoration face image data generation process, decoration face image data change process, and face image change process in the embodiment described above, the CPU 400 first acquires position information in the face image and later acquires cosmetic data or face data. However, the order of acquisition may be reversed.

  Further, the generation or change processing of the face image data may be executed based on only the cosmetic data or the face data without acquiring the position information. In such a case, position information for applying decoration to the face image or position information for changing the face image is included in the cosmetic data or the face data. For example, when the cosmetic data is acquired for the lipstick, the position information for specifying the part to be decorated as the mouth portion is included in the cosmetic data, and the CPU 400 needs to acquire the position information from the touch panel monitor 60. Disappears.

  The operation of the makeup presentation system 1 does not need to be performed only with position information in the face image and sound, and an instruction icon or the like displayed on the touch panel monitor 60 may be used as necessary. For example, when position information or audio information is erroneously input, an icon for canceling the input may be displayed on the touch panel monitor 60 so that the input can be freely performed again.

  The present invention has been described above based on the embodiments and modifications of the present invention. However, the present invention is not limited to the above embodiments and modifications, and can be variously modified without departing from the spirit of the present invention. Can be implemented.

It is explanatory drawing which shows schematic structure of the makeup presentation system which concerns on an Example. It is a schematic front view of the three-dimensional image 10 which concerns on an Example. It is a block diagram which shows the functional structure of the personal computer 40 (CPU400) which concerns on an Example. It is a flowchart which shows the processing routine of the presentation assistance process by the makeup presentation system 1 which concerns on an Example. It is a flowchart which shows the processing routine of the bare face image projection process which concerns on an Example. It is a flowchart which shows the process routine of the decoration face image data generation process which concerns on an Example. It is a flowchart which shows the processing routine of the positional information acquisition process which concerns on an Example. It is a flowchart which shows the process routine of the data acquisition process (it corresponds to cosmetics data acquisition process in a decoration face image data generation process) which concerns on an Example. 4 is an explanatory diagram illustrating an example of cosmetic data recorded in an HDD 402. FIG. It is explanatory drawing which shows the specific example of the production | generation of decoration face image data. It is a flowchart which shows the process routine of the decoration face image data change process which concerns on an Example. 4 is an explanatory diagram illustrating an example of bare face data recorded in an HDD 402. FIG. It is explanatory drawing which shows the 1st specific example of the change of decoration face image data. It is explanatory drawing which shows the 2nd specific example of a change of decoration face image data. It is explanatory drawing which shows schematic structure of the makeup presentation system which concerns on a 1st modification. It is a schematic front view of the three-dimensional image 10 which concerns on a 1st modification. It is explanatory drawing which shows the outline of the formation method of the projection face image which concerns on a 2nd modification.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 ... Makeup presentation system 10 ... Three-dimensional image 20 ... Projector 30 ... Imaging device 40 ... Personal computer 50 ... Microphone 60 ... Touch panel type monitor 70 ... Wireless receiver 75 ... Wireless transmitter / receiver 80 ... Wireless transmitter 90 ... Monitor 102 ... Solid shape (nose)
104 ... Solid shape (mouth)
106 ... flat part (eye equivalent part)
108 ... Light emitting diode 110 ... Tactile sensor 400 ... CPU
401: Random access memory (RAM)
402: Hard disk (HDD)
602 ... Display unit 604 ... Touch panel unit M1 ... Position information recognition unit M2 ... Voice recognition unit M3 ... Data search unit M4 ... Real face image selection unit M5 ... Real face image adjustment unit M6 ... Decoration face image data generation unit M7 ... Decoration face image data Change part

Claims (16)

A makeup presentation method,
Get real face image data representing the real face,
Using the acquired face image data, a face image is projected onto a three-dimensional image,
Obtaining cosmetic data used for decoration of the projected face image;
Based on the acquired cosmetic data and the acquired bare face image data, generate decorative face image data,
A makeup presentation method for projecting a face image decorated to the three-dimensional image using the generated decoration face image data instead of the projected face image data. The makeup presentation method according to claim 1,
When there is a request to change the decoration while projecting the decorated face image,
Obtaining cosmetic data used to further decorate the decorated face image;
Based on the acquired cosmetic data, change the decorative face image data,
A makeup presentation method for projecting a face image decorated to the three-dimensional image using the modified face image data instead of the face image data being projected. In the makeup presentation method according to claim 1 or 2,
If there is a request to change the face while projecting the decorated face image,
Obtaining face data for changing the face image,
Based on the acquired face data, the face image data is changed,
Based on the changed face image data, the decorative face image data is changed,
A makeup presentation method for projecting a face image decorated to the three-dimensional image using the modified face image data instead of the face image data being projected. In the makeup presentation method according to any one of claims 1 to 3,
The cosmetic data includes position information to be decorated on the face image,
Based on the position information, specify a position to be decorated with cosmetics in the face image,
A makeup presentation method that uses the position information in addition to the cosmetic data when generating or changing the decorative face image data. In the makeup presentation method according to any one of claims 1 to 3,
Obtain location information for cosmetic decoration on face images,
A makeup presentation method using the acquired position information in addition to the cosmetic data when generating or changing the decorative face image data. The makeup presentation method according to any one of claims 1 to 5,
Acquisition of the cosmetic data or the face data is
Acquiring cosmetic information for specifying the cosmetic data, or face information for specifying the face data;
A makeup presentation method performed by acquiring cosmetic data or facial data corresponding to the acquired cosmetic information or the facial information from a storage device that stores cosmetic data or facial data in advance. The makeup presentation method according to claim 6,
Acquisition of the cosmetic information or the face information is
Obtaining voice information including the cosmetic information or the face information;
Converting the acquired voice information into character information;
A makeup presentation method performed by extracting and recognizing the cosmetic information or the face information from the converted character information. A makeup presentation method,
Get real face image data representing the real face,
Using the acquired face image data, a face image is projected onto a three-dimensional image,
Obtaining cosmetic data used for decoration of the projected face image;
Based on the acquired cosmetic data, generate decorative image data of a shape corresponding to the region to be decorated,
A makeup presentation method for projecting a decoration image using the generated decoration image data on a face image projected on the three-dimensional image. A makeup presentation system that projects a face image,
A three-dimensional image used as a screen;
A face image data selection means for selecting face image data representing a face;
Cosmetic data acquisition means for acquiring cosmetic data for decorating the face image;
A decorative face image data generating means for generating decorative face image data using the previous period face image data and the previous period cosmetic data;
A makeup presentation system comprising projecting means for projecting a face image onto the three-dimensional image using the generated decorative face image data or the bare face image data. The makeup presentation system according to claim 9, further comprising:
A decorative face image data changing means for changing the generated decorative face image data;
When the cosmetic data acquisition means further acquires the cosmetic data after generating the decorative face image data,
The decorative face image data changing means is a makeup presentation system that changes the decorative face image data based on the further acquired cosmetic data. The makeup presentation system according to claim 10, further comprising:
Comprising a face data acquisition means for acquiring face data for changing the face image data;
The decorative face image data changing means changes the face image data based on the acquired face data,
A makeup presentation system that changes the decorative face image data based on the changed face image data. The makeup presentation system according to any one of claims 9 to 11 further includes:
Position information acquisition means for acquiring position information for performing decoration or cosmetic face change on a face image,
The decorative face image data generating means or the decorative face image data changing means is
A makeup presentation system that generates or changes the decorative face image data using the position information in addition to the cosmetic data or the face data. The makeup presentation system according to claim 12,
The position information acquisition means includes
A touch panel for inputting the position information;
A makeup presentation system which is position information recognition means for recognizing the input position information by converting it into position information in a face image. The makeup presentation system according to claim 12,
The position information acquisition means includes
A tactile sensor that is disposed on the face image projection surface of the three-dimensional image and inputs position information pointed out on the face image projection surface of the three-dimensional image;
A makeup presentation system which is position information recognition means for recognizing the input position information by converting it into position information in a face image. The makeup presentation system according to any one of claims 10 to 14, further comprising:
Cosmetic data storage means for storing cosmetic data in advance;
A face data storage means for storing face data in advance,
The cosmetic data acquisition means or the bare face data acquisition means,
Information input means for inputting cosmetic information for specifying the cosmetic data, or face information for specifying the face data;
A makeup presentation system, which is information retrieval means for retrieving the cosmetic information corresponding to the inputted cosmetic information or the cosmetic data corresponding to the facial information or the facial data from the cosmetic data storage means or the facial data storage means. The makeup presentation system according to claim 15,
The information input means includes
Voice input means for inputting voice information;
A makeup presentation system which is voice recognition means that converts the inputted voice information into character information and extracts and recognizes the cosmetic information or the face information from the converted character information.

Images