JP2019125358A - Notification device, notification method and program - Google Patents

Abstract

To provide a notification device and a notification method and program for enabling a user to more appropriately recognize a change in a user's state.SOLUTION: A notification device includes: a body condition information acquisition part 111 or a make-up information acquisition part; a light emission part 17 and a display part 19 as a notification part; a control part 114; and a determination part 112. The body condition information acquisition part 111 or the make-up information acquisition part acquires face information. The light emission part 17 and the display part 19 as the notification part performs notification based on the face information. The determination part 112 determines change between face information before the notification and face information after the notification. The control part 114 controls notification by the light emission part 17 and the display part 19 as the notification part on the basis of a determination result by the determination part 112.SELECTED DRAWING: Figure 4

Description

  The present invention relates to a notification device, a notification method, and a program.

2. Description of the Related Art In recent years, there is a technology for acquiring information indicating a user's state (for example, a state related to physical condition or a state related to makeup) and using the acquired information in various ways.
For example, Patent Document 1 discloses a configuration in which information on a user's face is acquired, and notification based on the acquired information on the face is performed to the user.

JP, 2014-166218, A

  However, conventional techniques such as the technique disclosed in Patent Document 1 only provide notification based on the state of the user at a certain point in time. Therefore, it may be difficult for the user to recognize a change in his / her state. For example, in some cases, it has been difficult for the user to recognize whether the facial expression has been improved by the treatment such as a massage or to recognize that the makeup has been properly performed.

  The present invention has been made in view of such a situation, and it is an object of the present invention to more appropriately recognize the change of the user's state to the user.

In order to achieve the above object, a notification device according to one aspect of the present invention is
Face information acquisition means for acquiring face information;
Notification means for performing notification based on the face information;
Determining means for determining changes in the face information before notification and the face information after notification;
A control unit that controls notification by the notification unit based on the determination result by the determination unit;
And the like.

  According to the present invention, the change of the user's state can be more appropriately recognized by the user.

It is a block diagram which shows the external appearance structure of the front surface of the alerting | reporting apparatus which concerns on one Embodiment of this invention. It is a block diagram which shows the external appearance structure of the side of a notification apparatus. It is a block diagram which shows the structure of the hardware of an alerting | reporting apparatus. It is a functional block diagram which shows the functional structure for performing physical condition alerting | reporting process among functional components of an alerting | reporting apparatus. It is a flowchart explaining the flow of the physical condition alerting | reporting process which an alerting device performs. It is an image figure explaining transition of a mirror part and an alerting | reporting part at the time of the physical condition alerting | reporting process which an alerting device performs. It is a functional block diagram showing a functional configuration for performing makeup notification processing among functional configurations of a notification device. It is a flow chart explaining the flow of the makeup informing processing which an informing device performs.

Hereinafter, embodiments of the present invention will be described using the drawings.
The notification device 1 according to an embodiment of the present invention is configured as a self-supporting mirror that can be carried by the user. Then, the notification device 1 acquires physical condition information of the user facing the mirror. In addition, the notification device 1 controls the notification means to notify support information for improving physical condition information. Furthermore, the notification device 1 determines whether the physical condition information has improved after the notification of the support information.

  According to such a notification device 1, the user can grasp the method for improving the physical condition information by the support information. In addition, the notification device 1 can perform any process after determining whether or not the physical condition of the user who understood the method for improving the physical condition information has improved. That is, according to the notification device 1, it is possible to more appropriately recognize the user's own physical condition information.

[Appearance configuration]
FIG. 1: is a block diagram which shows the external appearance structure of the front surface of the alerting | reporting apparatus 1 which concerns on one Embodiment of this invention. Moreover, FIG. 2 is a block diagram which shows the external appearance structure of the side of the alerting | reporting apparatus 1. As shown in FIG. The size of the front surface of the notification device 1 is formed to, for example, an A4 size defined by ISO (International Organization for Standardization) 216.

As shown in FIGS. 1 and 2, the notification device 1 is configured to include a mirror portion 30 and a leg portion 31. The mirror unit 30 is a mirror having a reflective surface.
The leg 31 and the hinge 32 are mechanisms for making the notification device 1 stand on its own. The leg 31 is pivotably joined to the mirror 30 by the hinge 32.
As shown in FIG. 2A, when carrying the notification device 1, the user can carry the side surface of the mirror unit 30 and the side surface of the leg portion 31 as a non-bulky shape. On the other hand, as shown in FIG. 2 (B), when the user installs and uses the notification device 1 on a desk etc., notification is made by rotating the leg portion 31 with the hinge portion 32 as the central point. The device 1 can be made to stand on its own. In addition, in order to enable the notification device 1 to be self-supporting, the hinge portion 32 has a structure for holding the leg portion 31 in a state where the predetermined angle is maintained.

  As shown in FIG. 1, the notification device 1 further includes an imaging unit 16, a light emitting unit 17, an input unit 18, and a display unit 19.

  The imaging unit 16 is a part that images a user facing the mirror unit 30 as a subject when using the notification device 1. The imaging unit 16 is disposed at a position where it can capture a face image of the user facing the mirror unit 30.

The light emitting unit 17 is a portion that emits light to illuminate the user facing the mirror unit 30. When the light emitting unit 17 illuminates the user, the notification device 1 functions as a lighted mirror (sometimes referred to as an "actress mirror"). Moreover, the light emission part 17 also alert | reports as an alerting | reporting part in the below-mentioned physical condition alerting | reporting process.
In addition, the light emission part 17 is arrange | positioned in multiple places at each both ends of the mirror part 30, respectively. However, for convenience of illustration, in FIG. 1, only one light emitting unit 17 is given a code, and the other light emitting units 17 are omitted from the code.

  The input unit 18 is a part that receives an operation input by the user. In FIG. 1, an input unit 18a, an input unit 18b, an input unit 18c, and an input unit 18d are illustrated as the input unit 18 corresponding to the content of the operation. Here, the input unit 18a receives an operation for switching to the make mode. In addition, the input unit 18 b receives an operation for switching to the care mode. Furthermore, the input unit 18c receives an operation for switching to a setting mode for performing various settings. Furthermore, the input unit 18 d receives an operation for switching on / off of the power supply of the notification device 1.

  The display part 19 is a part which performs alerting | reporting as an alerting | reporting part in the below-mentioned physical condition alerting | reporting process. The display unit 19 displays a message such as characters, an image, and the like. In addition, the display unit 19 may display the face image of the user facing the mirror unit 30 and captured by the imaging unit 16. In the notification device 1, the reflection surface of the reflection unit that constitutes the mirror unit 30 and the display surface of the display unit 19 are arranged so as to be simultaneously visible from the user and superimposed in the viewing direction of the user facing the mirror unit 30. Ru.

For example, the display unit 19 configured by a liquid crystal display is disposed in parallel in parallel on the back side in the viewing direction of the mirror unit 30 configured by a half mirror.
With such an arrangement, the user can simultaneously view his / her face reflected by the mirror unit 30 and the information displayed on the display unit 19 at the same time. In the example of FIG. 1, the display area of the display unit 19 is provided at the top of the screen, and the reflection area of the mirror unit 30 is provided at the bottom of the screen.

Heretofore, the appearance structure of the notification device 1 has been described. However, this structure is only an example, and the appearance structure of the notification device 1 is not limited to this example.
For example, although the imaging part 16 may be arrange | positioned at the upper part of the mirror part 30 as shown in FIG. 1, for example, you may be arrange | positioned in the lower part of the mirror part 30. FIG. Further, similarly to the display unit 19, the imaging unit 16 may be arranged in parallel in parallel on the back side in the viewing direction of the mirror unit 30 configured by a half mirror.

  Also, for example, the light emitting unit 17 may be disposed in the upper part or the lower part of the mirror unit 30, or may be disposed in the entire periphery of the mirror unit 30. Furthermore, for example, the number and arrangement of the input units 18 may be changed. Further, for example, a part of the display unit 19 may be configured as a touch panel, and the input unit 18 and the display unit 19 may be integrally configured.

  Furthermore, for example, the display area realized by the display unit 19 may be disposed at the top of the screen, but may be disposed at another position. For example, assuming that the face of the user is projected on the central portion of the mirror unit 30, the display area may be arranged around the central portion.

  Furthermore, for example, the mirror unit 30 may be disposed on a part of the front surface of the notification device 1, and the display unit 19 may be disposed on another part of the front surface. In other words, the mirror unit 30 and the display unit 19 do not have to be arranged in an overlapping manner.

[Hardware configuration]
FIG. 3 is a block diagram showing the hardware configuration of the notification device 1.
As illustrated in FIG. 3, the notification device 1 includes a central processing unit (CPU) 11, a read only memory (ROM) 12, a random access memory (RAM) 13, a bus 14, an input / output interface 15, and imaging. A light emitting unit 17, an input unit 18, a display unit 19, a storage unit 20, and a drive 21 are provided.

  The CPU 11 executes various processes in accordance with a program stored in the ROM 12 or a program loaded from the storage unit 20 to the RAM 13.

  Data and the like necessary for the CPU 11 to execute various processes are also stored in the RAM 13 as appropriate.

  The CPU 11, the ROM 12 and the RAM 13 are connected to one another via a bus 14. An input / output interface 15 is also connected to the bus 14. An imaging unit 16, a light emitting unit 17, an input unit 18, a display unit 19, a storage unit 20, and a drive 21 are connected to the input / output interface 15.

  Although not shown, the imaging unit 16 includes an optical lens unit and an image sensor.

The optical lens unit is configured of a lens that collects light, such as a focus lens or a zoom lens, in order to capture an object.
The focus lens is a lens that forms an object image on the light receiving surface of the image sensor. The zoom lens is a lens that freely changes the focal length in a certain range.
The imaging unit 16 is also provided with peripheral circuits for adjusting setting parameters such as focus, exposure, and white balance, as necessary.

The image sensor includes a photoelectric conversion element, an AFE (Analog Front End), and the like.
The photoelectric conversion element is composed of, for example, a complementary metal oxide semiconductor (CMOS) type photoelectric conversion element or the like. A subject image is incident on the photoelectric conversion element from the optical lens unit. Therefore, the photoelectric conversion element photoelectrically converts (captures) an object image, accumulates an image signal for a certain period of time, and sequentially supplies the accumulated image signal as an analog signal to the AFE.
The AFE performs various signal processing such as A / D (Analog / Digital) conversion processing on this analog image signal. A digital signal is generated by various signal processing, and is output as an output signal of the imaging unit 16.
An output signal of such an imaging unit 16 is appropriately supplied to the CPU 11 and the like.

  The light emitting unit 17 includes a light emitter such as a light emitting diode (LED) corresponding to each color in the RGB color model, and a control circuit capable of adjusting color components in light emission of the light emitter based on the RGB color model. The light emitting unit 17 illuminates the user by adjusting the RGB color components to a predetermined state and emitting light when the notification device 1 is activated. The predetermined state is a state in which the user's face projected on the mirror unit 30 looks natural. Further, the light emitting unit 17 reduces the R component, for example, and emits light by suppressing the light emission of the light emitter corresponding to R, for example, based on the instruction from the CPU 11.

  The input unit 18 includes various buttons and the like, and inputs various information in accordance with a user's instruction operation.

  The display unit 19 is configured of a liquid crystal display or the like, and displays an image corresponding to the image data output by the CPU 11. The mirror unit 30 is configured by a half mirror, and for example, the face of the user is projected. The arrangement of the display unit 19 and the mirror unit 30 is as described above with reference to FIG.

  The storage unit 20 is configured by a semiconductor memory such as a dynamic random access memory (DRAM) and stores various data.

  A removable medium 100 made of a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory or the like is appropriately attached to the drive 21. The removable medium 100 stores a program for executing a physical condition notification process, which will be described later, and various data such as image data. Programs read out from the removable medium 100 by the drive 21 and various data such as image data are installed in the storage unit 20 as necessary.

  In addition to the hardware configuration described above, the notification device 1 may further include another hardware configuration. For example, the notification device 1 may be configured by a lamp, a speaker, a vibration motor, or the like, and may include an output unit that outputs light, voice, or a vibration signal. Also, for example, the notification device 1 may include a communication unit or the like for communicating with another device (not shown) via a network including the Internet.

[Functional configuration]
FIG. 4 is a functional block diagram showing a functional configuration for executing a physical condition notification process among the functional configurations of the notification device 1.
The physical condition notification process is a series of processes in which the notification device 1 performs notification based on physical condition information.
When the physical condition notification process is performed, as illustrated in FIG. 4, the physical condition information acquisition unit 111, the determination unit 112, the selection unit 113, and the control unit 114 function in the CPU 11.
Further, in one area of the storage unit 20, a determination information storage unit 201 and a notification information storage unit 202 are set.

  The determination information storage unit 201 stores information for the determination unit 112 to determine the physical condition information. Specifically, the physical condition information of the user acquired in the physical condition notification process and the physical condition information as a reference of determination are stored.

  The notification information storage unit 202 stores, under the control of the control unit 114, information for the light emitting unit 17 and the display unit 19 to perform notification. Specifically, control information for controlling light emission of the light emitting unit 17, character data (text data) for displaying on the display unit 19, and image data are stored. In the following description, both the light emitting unit 17 and the display unit 19 will be referred to as “informing unit” as appropriate.

  The various data such as the physical condition information and the notification information stored in the determination information storage unit 201 and the notification information storage unit 202 may be stored only in the storage unit 20, but the removable media 100 may be stored in the drive 21. It may be read out as appropriate.

  The physical condition information acquisition unit 111 is a part that acquires physical condition information that is information indicating the physical condition of the user. In the present embodiment, the physical condition information acquisition unit 111 analyzes the image captured by the imaging unit 16 and acquires an analysis result as physical condition information. Here, as described above with reference to FIG. 1, the imaging unit 16 is disposed at a position where the face of the user facing the mirror unit 30 is imaged. Therefore, the image captured by the imaging unit 16 includes the image of the face portion of the user.

First, the physical condition information acquisition unit 111 analyzes this image to specify an area corresponding to the face portion of the user in the image. For example, the physical condition information acquisition unit 111 specifies an area corresponding to the face portion of the user by extracting the outline of the user's face in the image or extracting feature points such as eyes. Next, the physical condition information acquisition unit 111 analyzes the color of each pixel in the area corresponding to the identified user's face portion. For example, RGB values are calculated for each pixel, and the R value of each pixel is integrated to obtain physical condition information of the user.
That is, in the present embodiment, the redness of the user's face is used as physical condition information indicating the user's physical condition or mental condition. This is because, in general, a reddish face is considered to be a healthy complexion without feeling tired, rather than a pale face.

  Note that weighting may be performed when integrating the value of R of each pixel. For example, when specifying the area corresponding to the face portion of the user, the area of the cheek or lip that is likely to be characterized by redness is further specified. Then, with regard to the value of R in the area of the cheek or lip where this redness tends to appear as a feature, the integration may be performed by giving more weight to the value of R in other areas.

  The physical condition information acquisition unit 111 acquires physical condition information by performing analysis as described above at the start of the physical condition notification process (hereinafter, this physical condition information is referred to as “first physical condition information”). Further, when a predetermined time elapses thereafter, the physical condition information acquisition unit 111 acquires physical condition information again by performing analysis as described above (hereinafter, this physical condition information is referred to as “second physical condition information”).

  Then, the physical condition information acquisition unit 111 stores each of the physical condition information acquired by performing analysis in this manner in the determination information storage unit 201 as determination information. In addition, the physical condition information acquisition unit 111 uses the average value of the history of physical condition information acquired in the past as the reference physical condition information (hereinafter, this physical condition information is referred to as "reference physical condition information") in the determination information storage unit 201. Store.

  The determination unit 112 is a part that makes a determination based on the physical condition information stored in the determination information storage unit 201. In this respect, as described above, in the present embodiment, the value of R corresponding to redness of the user's face is used as the physical condition information. Therefore, the determination unit 112 performs determination based on the value of R corresponding to redness on the user's face.

First, the determination unit 112 compares the first physical condition information with the reference physical condition information, and based on the comparison result, whether the physical condition information of the user at the start of the physical condition notification process is better than the reference Determine
Specifically, the determination unit 112 compares the first physical condition information with the reference physical condition information, and when the first physical condition information has a higher R value than the reference physical condition information, the physical condition notification process is performed. It is determined that the physical condition of the user at the start is good. Although the value of R is used to compare the first physical condition information and the reference physical condition information, the present invention is not limited to this, and comparison may be performed as at least one or more parameters of RGB, and further, an image The comparison may be performed using analysis or biological information obtained from a biological sensor.

Further, the determination unit 112 compares the first physical condition information with the second physical condition information, and determines whether the physical condition information has improved based on the comparison result.
Specifically, the determination unit 112 compares the first physical condition information with the second physical condition information, and the value of R of the second physical condition information is more than the value of R of the first physical condition information. When it has increased by a predetermined value or more, it is determined that the physical condition information of the user has been improved by performing the physical condition notification processing. In addition, although the value of R was used also in comparison with the 1st physical condition information and the 2nd physical condition information, not only this but comparison may be performed as at least one or more parameters among RGB, and further, The comparison may be performed using image analysis or biological information obtained from a biological sensor.

  The determination unit 112 outputs the determination result obtained by such determination to the control unit 114 described later.

  The selection unit 113 is a portion that selects a notification unit used for notification in the physical condition notification process. The selection unit 113 selects an appropriate notification unit according to the content of the notification determined based on the physical condition information.

The control unit 114 is a part that executes notification by controlling the notification unit selected by the selection unit 113 based on the determination result of the determination unit 112.
The specific content of the notification executed by the respective units in cooperation with each other will be described in detail in the following [Operation].

[Operation]
Next, the operation of the notification device 1 will be described.
FIG. 5 is a flowchart for explaining the flow of the physical condition notification process performed by the notification device 1. Moreover, FIG. 6 is an image figure explaining transition of the mirror part 30 and alerting | reporting part (namely, light emission part 17 and display part 19) at the time of physical condition alerting | reporting processing.
The physical condition notification process is started upon activation of the notification device 1.

  In step S11, the physical condition information acquisition unit 111 analyzes the image captured by the imaging unit 16 to acquire first physical condition information when the user is detected in front of the mirror unit 30.

  In step S12, the determination unit 112 compares the first physical condition information acquired in step S11 with the reference physical condition information stored in the determination information storage unit 201, and the physical condition of the user at the start of the physical condition notification process. Is determined to be good.

  If the user's physical condition is good, it is determined as Yes in step S12, and the process ends. That is, since the physical condition of the user is good, the process ends without giving a notification. In this case, the notification device 1 functions as a mirror with illumination by the light emitting unit 17 that emits light and the mirror unit 30 that projects the user. On the other hand, if it is determined that the physical condition of the user is not good, the result is No in step S12, and the process proceeds to step S13.

  In step S13, the selection unit 113 and the control unit 114 cooperate to notify the user. In this notification, for example, the selection unit 113 selects the display unit 19 as the notification unit. Then, the control unit 114 causes the display unit 19 to display a message or an illustration including advice relating to the physical condition, such as “Your facial color is not good.” Or “It looks tired,” for the user. Inform by notifying. In this case, for example, a message such as “Do you want to make makeup?” May be further displayed on the display unit 19 as a message for prompting setting of the make mode, which will be described later.

The state of the mirror unit 30 and the notification unit (that is, the light emitting unit 17 and the display unit 19) when the notification in step S13 is performed is illustrated as FIG. In this case, the light emitting unit 17 adjusts the RGB color components to a predetermined state and emits light when the notification device 1 is activated. Further, the face of the user illuminated by the light emission adjusted to the predetermined state is projected on the mirror unit 30. Further, the display unit 19 displays the message as described above.
The user can notice that his physical condition is not good by receiving such notification.

  In step S14, the control unit 114 determines which mode is currently set. Here, in the present embodiment, two modes of “make mode” and “care mode” are provided. Then, the control unit 114 sets one of the modes based on the user's operation by the input unit 18a or the input unit 18b illustrated in FIG. The setting based on the user's operation may be performed in advance prior to the physical condition notification process, or may be performed in the process of the physical condition notification process. For example, the mode may be set by the user who received the notification in step S13 performing an operation.

  When the user selects the makeup mode, if the makeup mode is set, it is determined in step S14 that the "make mode" is set, and the process proceeds to step S15. On the other hand, when the care mode is selected by the user and the care mode is set, it is determined in step S14 that the "care mode" is set, and the process proceeds to step S18.

  When the make mode is selected, in step S15, the selection unit 113 and the control unit 114 cooperate to notify the user. In this notification, for example, the selection unit 113 selects the light emitting unit 17 as the notification unit. Then, the control unit 114 controls the light emitting unit 17 to intentionally suppress the R component of the light emitting unit 17. This emphasizes that the user's face is not sufficiently red and that it has a poor complexion. That is, the control unit 114 emphasizes the physical condition information acquired by the physical condition information acquisition unit 111 more. Further, the physical condition information of the redness of the face projected on the mirror unit 30 is further emphasized for the user. Furthermore, the selection unit 113 selects the display unit 19 as a notification unit. Then, the control unit 114 notifies the user by, for example, displaying on the display unit 19 a sample image of makeup and a color sample used by the sample.

The state of the mirror unit 30 and the notification unit (that is, the light emitting unit 17 and the display unit 19) when the notification in step S15 is performed is illustrated as (B-1) in FIG. In this case, the light emitting unit 17 intentionally emits light with the R component suppressed. In the mirror unit 30, the face of the user illuminated by the light emission suppressing the component of R is projected. Furthermore, the display unit 19 displays a sample image of makeup and a color sample used by the sample.
The user can make appropriate makeup by receiving such notification. In particular, since it is emphasized that the complexion is bad, makeup can be made to compensate for this. Note that, for example, when it is detected that the user has started makeup by analyzing the image captured by the imaging unit 16, natural light emission in which suppression of the R component is canceled from light emission in which the R component is suppressed by the light emission unit 17 You may switch to By doing this, the user can make makeup while accurately grasping the progress of the makeup applied to the user and the degree of makeup under the natural light emission in which the suppression of the R component is canceled.

  In step S16, the determination unit 112 compares the first physical condition information with the second physical condition information, and determines based on the comparison result whether the physical condition information has been improved. This second physical condition information is that after the notification in step S15, cosmetics such as red powder (for example, red lipstick, teak, etc.) are applied to the user's face by makeup performed by the user Is the physical condition information of the user whose face is colored red.

If the value of R in the second physical condition information does not increase by a predetermined value or more than the value of R in the first physical condition information, the physical condition information is not improved, so it is determined as No in step S16. And repeat step S16. This indicates that the makeup is still insufficient by the user.
On the other hand, if the value of R in the second physical condition information is increased by a predetermined value or more than the value of R in the first physical condition information, the physical condition information is improved, so in step S16 The determination is Yes, and the process proceeds to step S17. This indicates that makeup has been properly performed by the user.
In addition, after acquiring information on the face of the user exposed by the light emission in which the R component is suppressed, the determination unit 112 removes the influence of the color tone on the face exposed to the light emission by post-processing, and The second physical condition information may be compared with the second physical condition information, and when acquiring the face image of the user used for the comparison, the light is turned off or the face with natural light whose suppression of the R component is stopped. You may make it light. By performing such processing, it is possible to eliminate the need to perform comparison determination after taking into consideration the influence of light emission in which the red component is suppressed at the time of determination by the determination unit 112.

  In step S17, the selection unit 113 and the control unit 114 cooperate to notify the user. In this notification, for example, the selection unit 113 selects the light emitting unit 17 as the notification unit. Then, the control unit 114 controls the light emitting unit 17 to return the light emitting state of the light emitting unit 17 to a predetermined state similar to that at the start of the notification device 1. As described above, this predetermined state is a state in which the user's face projected on the mirror unit 30 looks natural. Further, the selection unit 113 selects the display unit 19 as a notification unit. Then, the control unit 114 notifies the user of, for example, a message including advice concerning physical condition such as “Your facial color has been improved by makeup” by displaying characters or an illustration on the display unit 19.

  The state of the mirror unit 30 and the notification unit (that is, the light emitting unit 17 and the display unit 19) when the notification in step S17 is performed is illustrated as (B-2) in FIG. In this case, the light emitting unit 17 returns from the state in which the component of R is intentionally suppressed to the state in which the user's face projected on the mirror unit 30 can be viewed naturally. Further, the display unit 19 displays the message as described above.

  The user can understand that the complexion has improved by confirming the message. In addition, the user can confirm the face after makeup while the user's face projected on the mirror unit 30 looks natural. Thus, the physical condition notification process ends.

  On the other hand, when the care mode is selected, in step S18, the selection unit 113 and the control unit 114 cooperate to notify the user. In this notification, for example, the selection unit 113 selects the display unit 19 as the notification unit. Then, the control unit 114 notifies the user by, for example, displaying on the display unit 19 a massage method for improving blood circulation.

The state of the mirror unit 30 and the notification unit (that is, the light emitting unit 17 and the display unit 19) when the notification in step S18 is performed is illustrated as (C-1) in FIG. In this case, the display unit 19 displays a massage method for improving blood circulation.
The user can perform a massage for improving blood circulation by receiving such notification.

  In step S19, the determination unit 112 determines whether a predetermined time has elapsed since the notification in step S18. The predetermined time is sufficient for blood circulation to be improved by massage. If the predetermined time has not elapsed, it is determined as No in Step S19, and the determination of Step S19 is repeated. On the other hand, when the predetermined time has elapsed, it is determined as Yes in Step S19, and the process proceeds to Step S20.

  In step S20, the determination unit 112 compares the first physical condition information and the second physical condition information, and determines whether the physical condition information has improved based on the comparison result. The second physical condition information is the physical condition information of the user after the massage for improving blood circulation.

  If the value of R in the second physical condition information has increased by a predetermined value or more than the value of R in the first physical condition information, the physical condition information is improved, so it is determined as Yes in step S20. The process proceeds to step S21. This indicates that the user performed a massage to improve blood circulation, thereby improving blood circulation and causing a reddish appearance on the face.

  In step S21, the selection unit 113 and the control unit 114 cooperate to notify the user. In this notification, for example, the selection unit 113 selects the display unit 19 as the notification unit. Then, the control unit 114 notifies the user of, for example, a message such as “The complexion has been improved by the massage” by displaying characters or an illustration on the display unit 19.

The state of the mirror unit 30 and the notification unit (that is, the light emitting unit 17 and the display unit 19) when the notification in step S21 is performed is illustrated as (C-2) in FIG. In this case, the display unit 19 displays a message as described above.
The user can understand that the complexion has improved by confirming the message. Thus, the physical condition notification process ends.

  On the other hand, if the value of R of the second physical condition information is not increased by a predetermined value or more than the value of R of the first physical condition information, the physical condition information is not improved, so in step S20 The determination is No, and the process proceeds to step S22. This indicates that the blood circulation is not good and the face is not reddened even though the massage is sufficiently performed. In this respect, in the case of the make mode, it is considered that physical condition information will eventually improve (that is, the value of R will eventually increase by a predetermined value or more) by continuing the make-up, as in step S16. The judgment was continued until the physical condition information improved. However, in the case of the care mode, the user is currently in poor physical condition if the physical condition information does not improve even though the massage is sufficiently performed, and the physical condition information is improved even if the massage is continued further It is thought that it does not. Therefore, the process proceeds to step S22 without continuing the determination as in step S16.

  In step S22, the selection unit 113 and the control unit 114 cooperate to notify the user. In this notification, for example, the selection unit 113 selects the display unit 19 as the notification unit. Then, the control unit 114 notifies the user of, for example, a message such as “The massage was performed but the complexion did not improve.” By displaying characters or an illustration on the display unit 19. The user can confirm that the complexion has not improved by confirming the message. Therefore, the user can understand that he / she may be in a state such as anemia or gastric ulcer. In addition, receiving at a hospital can be considered accordingly. Thus, the physical condition notification process ends.

  By the process described above, the notification device 1 can notify the user of support information for improving the acquired physical condition information. Therefore, the user can grasp the method for improving physical condition information.

The notification device 1 configured as described above or the notification device 1 configured as a modification to be described later includes a physical condition information acquisition unit 111 or a makeup information acquisition unit 115, a light emitting unit 17 as a notification unit, and a display. A unit 19 includes a control unit 114 and a determination unit 112.
The physical condition information acquisition unit 111 or the makeup information acquisition unit 115 acquires face information.
The light emitting unit 17 and the display unit 19 as a notification unit perform notification based on face information.
The determination unit 112 determines changes in the face information before notification and the face information after notification.
The control unit 114 controls notification by the light emitting unit 17 and the display unit 19 as a notification unit based on the determination result by the determination unit 112.
Thereby, the notification device 1 can notify the user of the change of the user based on the acquired face information. Therefore, the user can grasp a change in the user's own state (for example, a change in physical condition information or a change in makeup). That is, according to the notification device 1, it is possible to more appropriately recognize the change in the state of the user.

The notification device 1 includes a plurality of light emitting units 17 and display units 19 as a notification unit, and further includes a selection unit 113.
The selection unit 113 selects the type of the light emitting unit 17 and the display unit 19 as the notification unit.
The control unit 114 controls notification by the light emitting unit 17 and the display unit 19 as the notification unit selected by the selection unit 113.
Thus, the notification device 1 can notify by the selected notification unit. Therefore, the notification device 1 can perform, for example, notification suitable for each mode set by the user.

The determination unit 112 calculates the difference between the face information before notification and the face information after notification.
The control unit 114 causes the light emitting unit 17 and the display unit 19 as the notification unit to notify the difference calculated by the determination unit 112.
As a result, the notification device 1 can notify the user of the difference in face information, which is information indicating the change of the user based on the acquired face information. Therefore, the user can grasp the difference of face information which is information indicating the user's own change.

The control unit 114 causes the light emitting unit 17 and the display unit 19 as a notification unit to notify so as to emphasize face information.
As a result, the user can more appropriately grasp his / her own state that would otherwise be difficult to notice.

The control unit 114 causes the light emitting unit 17 and the display unit 19 to notify of information prompting a predetermined action according to face information.
As a result, the user can perform predetermined actions according to the face information, and along with this, it is possible to improve the physical condition or to appropriately makeup.

The physical condition information acquisition unit 111 or the makeup information acquisition unit 115 acquires an image of a subject for which face information is to be acquired as face information,
The determination unit 112 determines changes in the face information before notification and the face information after notification based on the image of the subject.
In this way, the notification device 1 can determine whether the physical condition information has been improved or whether makeup has been properly performed based on the user's face image or the like. For example, the determination can be made based on the change in the facial color specified by analyzing the face image.

The light emitting unit 17 and the display unit 19 as a notification unit perform notification by light emission,
The control unit 114 controls the light emission of the light emitting unit 17 and the display unit 19 as the notification unit based on the determination result of the determination unit 112.
Thereby, the notification device 1 can perform notification using light emission. For example, by performing control to reduce the R component of the RGB components in light emission, notification can be made to emphasize the user's face color.

The light emitting unit 17 and the display unit 19 as the notification unit are to notify by characters.
The control unit 114 controls characters notified by the light emitting unit 17 and the display unit 19 as a notification unit based on the determination result by the determination unit 112.
As a result, the notification device 1 can notify by message text or the like using characters.

The light emitting unit 17 and the display unit 19 as the notification unit are to notify by characters.
The control unit 114 controls the display position of the character notified by the light emitting unit 17 and the display unit 19 as a notification unit based on the determination result by the determination unit 112.
In this way, the notification device 1 can perform notification after controlling the display position of a message or the like using characters.

The notification device 1 includes a display unit 19 or a mirror unit 30 that displays an object for which face information is to be acquired.
Thus, the notification device 1 can cause the user to visually recognize the user's face or the like by means of an image display unit such as a mirror or a display.

The display surface of the display unit and the display surfaces of the light emitting unit 17 as the notification unit and the display surface of the display unit 19 are disposed so as to be simultaneously visible in a visible direction.
Thus, the user can simultaneously view his / her face and the like reflected and the like by the display unit and the information to be notified.

The physical condition information acquisition unit 111 or the makeup information acquisition unit 115 acquires information on physical condition or information on makeup as face information.
As a result, it is possible to determine changes in physical condition or changes in makeup before and after notification. Therefore, it is possible to perform notification based on changes in physical condition or changes in makeup.

The light emitting unit 17 and the display unit 19 as the notification unit notify support information or evaluation information based on the face information.
Thus, the user can receive notification of support information (for example, advice for improving physical condition) and evaluation information (for example, evaluation related to makeup) based on his / her face information.

[effect]
Next, the effects of the above-described embodiment will be described.
As a premise, for example, it is not desirable for a person who is engaged in job hunting or a person who is engaged in service to show others a tired face or a face that looks unhealthy. Therefore, these persons cover their tired face and unhealthy face by performing makeup etc. while checking their own face etc. shown in a mirror at home.

  However, no one knows how to cover a tired face unless it is a cosmetic professional or someone who has taught cosmetic methods. I can not afford to think, "How should I cover?" Especially when I feel ill or lack of sleep. In the case of chronic fatigue in which daily fatigue has accumulated continuously during work, household chores, childcare, nursing care, etc., people who are not aware that they have a tired face (poor complexion) are not pointed out by others in the first place There are many. If you act without being aware that tiredness is on your face, you may fall into a vicious cycle where job hunting, customer service, and business negotiations do not go well with your first impression, and it will damage your health and lead to illness.

Therefore, the user can obtain the following effects by using the above-described embodiment.
In the case of chronic fatigue, it is difficult for the person to notice that he has a poor complexion or a tired expression. In the shadow of chronic fatigue, there may be a disease. However, according to the present embodiment, since it is possible to promote makeup and massage that show a fair color, it is possible to not only improve the appearance but also to make the person aware.

  In addition, people in job hunting and hospitality businesses fail when they give an unhealthy impression with a first impression. However, according to the present embodiment, even if you look tired in the mirror of the washstand when you get up, the mirror will make a proposal for makeup that makes you feel well on the spot, so even if you do not hesitate in the busy morning You can make a good impression.

Furthermore, according to the present embodiment, the mirror can tell how to make and massage without having to check.
Furthermore, according to the present embodiment, if there is no defect in the complexion even after the massage, there is a suspicion of a disease, so it is possible to notice poor health before becoming a major illness.

[Modification]
The present invention is not limited to the above-described embodiment, and modifications, improvements, and the like in the range in which the object of the present invention can be achieved are included in the present invention.

[Modification using past physical condition information]
For example, in the above-described embodiment, after the notification in step S13, the determination unit 112 performs the determination in step S16 or step S20. Then, in this determination, the determination unit 112 compares the first physical condition information and the second physical condition information, and determines whether the physical condition information has improved based on the comparison result.

  By deforming this, after the notification in step S13, the determination unit 112 determines, in step S16 and step S20, the physical condition information acquired in the past (hereinafter, this physical condition information is referred to as "past physical condition information") and the second. You may make it compare with physical condition information. Here, past physical condition information is physical condition information acquired by the physical condition information acquisition part 111 analyzing the image which the imaging part 16 imaged, before alerting | reporting in step S13.

  Specifically, for example, the physical condition information acquisition unit 111 stores the first physical condition information and the second physical condition information acquired in the previous physical condition notification process in the determination information storage unit 201. And in this physical condition alerting | reporting process, the determination part 112 utilizes these 1st physical condition information and 2nd physical condition information which are stored in the determination information storage part 201 as past physical condition information. Thereby, the determination unit 112 can compare, for example, the physical condition information of the previous day (past physical condition information) with the current physical condition information (second physical condition information).

  In this comparison, as in the above-described embodiment, whether or not the physical condition information has improved may be determined based on the comparison result, but the presence or absence of change or the degree of change may be determined. In this case, for example, the determination unit 112 performs the determination by calculating the difference between the past physical condition information and the second physical condition information. The calculated difference is, for example, a difference of the value of R.

Then, after the comparison is completed, the selection unit 113 and the control unit 114 cooperate with each other to notify the user of a message indicating the difference instead of the notification in step S17, step S21 and step S22. May be
In this notification, for example, the selection unit 113 selects the display unit 19 as the notification unit. Then, the control unit 114 instructs the user to send a letter or an illustration, for example, a message indicating a difference, such as "Your complexion is not good compared to yesterday" or "Your greener than yesterday." The notification is given by displaying on the display unit 19.

  As described above, it is possible to make the user more appropriately recognize the change of the user's own physical condition by comparing with the past physical condition information or reporting the difference from the past physical condition information. Become.

  In addition, although the determination part 112 calculated the difference of the value of R in order to compare the past physical condition information and 2nd physical condition information, and the example which alert | reports the difference of the value of this R was demonstrated, it is limited to this Absent. The determination unit 112 may calculate the difference for at least one or more parameters of RGB, and may further calculate the difference for image analysis or biological information obtained from a biological sensor. Also, the control unit 114 may notify the user of these differences. Furthermore, the past physical condition information may be physical condition information acquired at a certain point in the past, but may be an average value of a plurality of physical condition information acquired at a plurality of past points in time.

[Modification using other physical condition information]
In addition, for example, in the above-described embodiment, the physical condition notification process is performed using the value of R of the face area of the user as physical condition information. By modifying this, other physical condition information may be used to perform physical condition notification processing. For example, by using an infrared filter or the like for the imaging unit 16, the physical condition information acquisition unit 111 acquires the body temperature of the user. Then, the body temperature of the user may be used as physical condition information.

[Modification to make the notification method different]
In addition, for example, in the above-described embodiment, the selection unit 113 selects the display unit 19 when notifying a predetermined message when performing notification. Then, the control unit 114 performs notification by displaying a message on the display unit 19. By changing this, the notification may be performed by another method. For example, the selection unit 113 may select a speaker (not shown). Then, the control unit 114 may output sound corresponding to a predetermined message from the speaker.

[Modification using the light emitting unit for other applications]
Besides, for example, the light emitting unit 17 may be used for other applications. For example, the light emitting unit 17 may be used for an application to work on the user's blood pressure.
In this case, the physical condition information acquisition unit 111 communicates with an external blood pressure measurement device to acquire blood pressure information of the user. Then, the control unit 114 controls the light emission of the light emitting unit 17 according to the acquired blood pressure information. Specifically, when the value of the acquired blood pressure is high, the control unit 114 controls the light emitting unit 17 to increase the component of B so as to emit light in blue. This is because the blood pressure can be lowered by looking at blue light emission. On the other hand, when the value of the acquired blood pressure is low, the control unit 114 controls the light emitting unit 17 to increase the component of R so as to emit light in red. This is because the blood pressure can be increased by looking at red light emission.

[Modification applied to evaluation for makeup]
In the embodiment described above, the notification device 1 notifies the user of support information for improving the acquired physical condition information. Not limited to this, the notification device 1 may notify other information to the user. For example, the notification device 1 may notify not the support information for improving the physical condition information but the evaluation information including the evaluation on the makeup applied to the user. Therefore, the notification device 1 performs the "makeup notification process" instead of the "physical condition notification process" performed in the above-described embodiment in this modification. The functional configuration and operation for performing the makeup notification process will be described below with reference to FIGS. 7 and 8.

(Functional configuration)
FIG. 7 is a functional block diagram showing a functional configuration for executing the makeup notification process in the functional configuration of the notification device 1.
The makeup notification process is a series of processes in which the notification device 1 notifies evaluation information including an evaluation on makeup provided to the user.
When the makeup notification process is performed, as shown in FIG. 7, in the CPU 11, the makeup information acquisition unit 115, the determination unit 112, the selection unit 113, and the control unit 114 function. The difference is that the physical condition information acquisition unit 111 is replaced with the makeup information acquisition unit 115 as compared with the case where the physical condition notification process is performed in the above-described embodiment.
Further, in one area of the storage unit 20, a determination information storage unit 201 and a notification information storage unit 202 are set.

  The determination information storage unit 201 stores information for the determination unit 112 to make a determination on makeup information indicating the state of makeup. Specifically, makeup information (hereinafter referred to as "make-up information target value") as a reference for determination in the makeup notification process, and makeup information of a user acquired in the makeup notification process (hereinafter, makeup information measured value Is stored.

  Here, as each makeup information such as makeup information target value and makeup information actual measurement value, for example, information indicating the color of each pixel of each area corresponding to the face portion (hereinafter referred to as "evaluation target area") is used. It can be used.

For example, an area corresponding to an organ or part to be a target of makeup, such as cheeks, lips, eyes, eyelashes, and T zone, can be used as an evaluation target area. In this case, a plurality of evaluation target areas may be set or only one may be set according to the setting of the user, the content of makeup, and the like.
Also, for example, RGB values for each pixel in these evaluation target areas can be used as makeup information. Here, in the above-described embodiment, among the RGB values for each pixel, the value of R indicating the redness of the user's face is used as the user's physical condition information.

On the other hand, makeup is performed using cosmetics corresponding to various colors other than red, such as red, yellow or black. Therefore, not only the value of R but also the value of G or the value of B may be used as each piece of makeup information such as the makeup information target value and the makeup information actual measurement value.
However, this is an example, and at least one or more values of RGB may be used as makeup information, and further, other information obtained from image analysis or the like may be used as makeup information .

Acquisition of each of these makeup information is performed by the makeup information acquisition unit 115 described later. The makeup information acquisition unit 115 acquires a makeup information target value by extracting it from an image of a person such as a model serving as a model. Alternatively, the makeup information acquisition unit 115 acquires the makeup information target value by performing predetermined processing such as skin care processing on the image of the user of the notification device 1 and extracting the makeup information target value from the image after the processing.
In addition, the makeup information acquisition unit 115 analyzes the image captured by the imaging unit 16 based on the analysis result and analyzes the makeup information measurement value.
The makeup information acquisition unit 115 stores the acquired makeup information in the determination information storage unit 201.

  Note that the makeup information target value may be acquired by the makeup information acquisition unit 115 each time the makeup notification process is performed, or may be performed prior to the makeup notification process. If performed before the makeup notification process, the makeup information target value is stored in the determination information storage unit 201 in the form of a database or the like provided for each user. Then, the makeup information acquisition unit 115 reads and uses the stored makeup information target value each time the makeup notification process is executed.

  The notification information storage unit 202 stores, under the control of the control unit 114, information for the light emitting unit 17 and the display unit 19 to perform notification. Specifically, control information for controlling light emission of the light emitting unit 17, character data (text data) for displaying on the display unit 19, and image data are stored.

  The various data such as the makeup information and the notification information stored in the determination information storage unit 201 and the notification information storage unit 202 may be stored only in the storage unit 20, but the removable media by the drive 21. It may be read appropriately from 100.

As described above in the description of the determination information storage unit 201, the makeup information acquisition unit 115 is a part that acquires each piece of makeup information such as a makeup information target value and a makeup information actual measurement value.
As described above, the makeup information acquisition unit 115 acquires a makeup information target value by performing extraction or the like from an image of a person such as a model serving as a model.

  Further, the makeup information acquisition unit 115 analyzes the image captured by the imaging unit 16 and acquires makeup information actual measurement values based on the analysis result. Here, as described above with reference to FIG. 1, the imaging unit 16 is disposed at a position where the face of the user facing the mirror unit 30 is imaged. Therefore, the image of the face portion of the user captured by the imaging unit 16 is analyzed, and the makeup information actual value is acquired based on the analysis result.

  Then, the makeup information acquisition unit 115 stores each piece of makeup information acquired in this manner in the determination information storage unit 201 as determination information.

The determination unit 112 is a part that determines whether makeup has been properly performed based on each piece of makeup information stored in the determination information storage unit 201.
Here, in the present modification, the makeup information actual measurement value (hereinafter, referred to as “first makeup information actual measurement value”) measured by the makeup information acquisition unit 115 at the first point in time and after the first point in time The determination is performed using the cosmetic information actual measurement value (hereinafter, referred to as “second cosmetic information actual measurement value”) measured by the cosmetic information acquisition unit 115 at the second point in time.

  Therefore, the determination unit 112 calculates a difference between the makeup information target value and each of the makeup information actual measurement values. In addition, the determination unit 112 determines the difference between the makeup information target value and the first makeup information actual measurement value (hereinafter referred to as the “first difference”), the makeup information target value, and the second makeup information actual measurement value. (Hereinafter referred to as "second difference") are compared. Then, when the second difference has changed from the first difference, the determination unit 112 determines that the makeup information actual value has changed. Thereby, it is possible to determine a change in the makeup information actual value of the user.

In this case, for example, when the second difference is smaller than the first difference, the determination unit 112 determines that the change is made to approach the makeup information target value more. As a result, the determination unit 112 can determine that makeup is properly performed at the second time point, as compared to the first time point.
On the other hand, when the second difference is, for example, larger than the first difference, the determination unit 112 determines that the change is made to be further away from the makeup information target value. Thus, the determination unit 112 can determine that makeup can not be performed properly (that is, improper makeup is performed) at the second point in time as compared to the first point in time.

  In these cases, for example, the determination unit 112 sets the time before the notification as the first time, and sets the time after the notification as the second time, thereby making the user's makeup before and after the notification. It is possible to determine the change in the information actual value.

Further, in the present modification, the determination unit 112 also performs determination using the makeup information target value and each makeup information actual measurement value. For that purpose, the determination unit 112 compares the difference between the makeup information target value and each makeup information actual measurement value (for example, the second makeup information actual measurement value, which is the latest actual measurement value) with a predetermined threshold value. Then, when the difference between the makeup information target value and the makeup information actual measurement value becomes smaller than a predetermined threshold value, the determination unit 112 determines that the makeup target has been achieved.
Here, when the difference between the makeup information target value and the makeup information actual measurement value becomes smaller than a predetermined threshold value, the user appropriately performs makeup, thereby performing makeup that approaches the goal. It corresponds to the case where it can be done. Further, when there are a plurality of evaluation target areas, the determination unit 112 performs the above-described determination on each of the plurality of evaluation target areas.

  The determination unit 112 outputs the determination result obtained by each determination to the selection unit 113 and the control unit 114 described later. Thus, the selection unit 113 and the control unit 114 described later can control the notification based on the results of the determinations.

  The selection unit 113 is a part that selects a notification unit used for notification in the makeup notification process. The selection unit 113 selects an appropriate notification unit according to the content of the notification determined based on the determination result of the determination unit 112.

The control unit 114 is a part that executes notification by controlling the notification unit selected by the selection unit 113 based on the determination result of the determination unit 112.
The specific content of the notification executed by the respective units in cooperation with each other will be described in detail in the following [Operation].

(Operation)
Next, the operation of the notification device 1 in the present modification will be described. FIG. 8 is a flowchart illustrating the flow of the makeup notification process performed by the notification device 1.
The makeup notification process is started, for example, with the activation of the notification device 1.

  In step S <b> 31, the makeup information acquisition unit 115 analyzes the image captured by the imaging unit 16 to detect the user facing the mirror unit 30.

In step S <b> 32, the makeup information acquisition unit 115 detects the evaluation target area by performing face tracking on the user who has faced in front of the mirror unit 30. Face tracking can be realized by specifying an outline of a user or a feature point of the user (for example, a feature point indicating a position of each organ or the like) by image analysis.
In step S33, the makeup information acquisition unit 115 acquires makeup information target values for each of the evaluation target areas detected in step S32.

In step S34, the makeup information acquisition unit 115 acquires makeup information actual measurement values for each of the evaluation target areas detected in step S32.
In step S35, the determination unit 112 calculates the difference between the makeup information target value acquired in step S33 and the makeup information actual value acquired in step S34. This difference corresponds to the second difference described above. Further, the difference calculated in step S35 performed at a time point before step S35 performed this time corresponds to the above-described first difference.

  In step S36, the determination unit 112 determines whether the makeup information actual value has changed based on the difference. Specifically, as described above, the determination unit 112 compares the first difference with the second difference. Then, when the second difference is changed from the first difference, it is determined that the makeup information actual value has changed. In this case, as described above, it is further determined whether the second difference has changed smaller than the first difference or the second difference has changed larger than the first difference. You may do so.

If the makeup information actual value changes (including both large change and small change), it is determined Yes in step S36, and the process proceeds to step S37. On the other hand, if the cosmetic information actual value does not change (including both the increase and decrease) or if it does not substantially change, it is determined No in step S36, and the process returns to step S34. The measurement of the cosmetic information actual measurement value is again performed with the current second difference as the new first difference.
If the process is the first one, the first difference does not exist, and only the second difference calculated this time exists. In this case, too, the determination in step S36 is No. Then, the process returns to step S34, and the measurement of the cosmetic information actual measurement value is performed again with the current second difference as the new first difference.

  In step S37, the selection unit 113 and the control unit 114 cooperate to notify the user. In this notification, for example, the selection unit 113 selects the display unit 19 as the notification unit. Then, the control unit 114 causes the display unit 19 to display, for example, a message indicating the content determined to be changed in step S37, the evaluation target area determined to be changed, or an illustration to the user. Inform

  For example, when the second difference is changed to be smaller than the first difference, the control unit 114 appropriately makes the makeup applied to the user, such as “make-up done properly!” In addition, a message including an evaluation of the effect may be displayed on the display unit 19. On the other hand, when the second difference changes so as to be larger than the first difference, the control unit 114 evaluates the makeup applied to the user, such as "make-up does not seem to be good!" May be displayed on the display unit 19 further.

In addition, the control unit 114 notifies the user of, for example, the value of the first difference or the second difference itself, or the amount of change of the first difference or the second difference as the makeup achievement value. May be For example, these values may be notified to the user as the achievement rate.
In this case, for example, the user may be notified of which value of each of the RGB values is the largest (or the smallest) difference from the makeup information target value. For example, when the evaluation target area is the user's lips, and the difference in the value of R is large, makeup given to the user such as "It seems that the lips are not red enough. Please apply a red lipstick a little more." The display unit 19 may further display a message indicating that the evaluation is inappropriate and a method for improving makeup.

  In step S38, the determination unit 112 compares the difference between the makeup information target value calculated in step S35 and the second makeup information actual value (that is, the second difference) with a predetermined threshold value. Then, it is determined whether there is an evaluation target area that has reached the goal (that is, an evaluation target area that can be appropriately dressed). If there is an evaluation target area that has reached the target, it is determined as Yes in Step S38, and the process proceeds to Step S39. On the other hand, if there is no evaluation target area that has reached the target, it is determined No in step S38, the process returns to step S34, and the makeup information is again set as the new second difference. Measurement of the measured value is performed.

  In step S39, the selection unit 113 and the control unit 114 cooperate to notify the user. In this notification, for example, the selection unit 113 selects the display unit 19 as the notification unit. Then, the control unit 114 notifies the user by, for example, displaying on the display unit 19 a message indicating the evaluation target area determined to have reached the target in step S38 or an illustration. In this case, a message including an evaluation of makeup applied to the user, such as “You can properly make makeup!” May be displayed on the display unit 19.

In step S40, the determination unit 112 determines whether the notification in step S39 has been performed for all the evaluation target areas (that is, whether all the evaluation target areas have reached the target).
When the notification in step S39 is performed for all the evaluation target areas, it is determined as Yes in step S40, and the present process ends. On the other hand, when the notification in step S39 is not performed for all the evaluation target areas, it is determined No in step S40, the process returns to step S34, and the current second difference is set as a new first difference. Measurement of makeup information actual value is performed again.

  According to the makeup notification process described above, the notification device 1 can notify the user of evaluation information including an evaluation on makeup applied to the user. Therefore, the user can grasp whether or not the makeup applied to him / her is appropriate.

  In the above-described makeup notification processing, as evaluation information including the evaluation for the makeup applied to the user, whether the target has been reached or not and which area the evaluation target region has reached the target has been reported . Not limited to this, it is also possible to make a step-by-step evaluation and to notify of this step-by-step evaluation result. For example, a plurality of predetermined threshold values may be provided step by step, and different contents may be notified each time the difference between the makeup information target value and the makeup information actual measurement value becomes equal to or less than any threshold.

In this case, for example, a first threshold and a second threshold smaller than this are provided. Then, when makeup is started and the difference between the makeup information target value and the makeup information actual measurement value becomes less than or equal to the first threshold, a message such as "Aim to reach the goal in a little more!" In addition, when makeup is continued and the difference between the makeup information target value and the makeup information actual measurement value becomes less than or equal to the second threshold, a message such as "the goal has been reached!" Is notified.
Thereby, it is possible to notify the user of evaluation information including stepwise evaluation. Further, such stepwise notification may be performed for each of a plurality of evaluation target areas. Furthermore, more than two stages may be provided as described above.

  Further, in the above-described makeup notification processing, when there is no change between the first difference and the second difference, it is determined No in step S36, but notification regarding this determination has not been made. Not limited to this, for example, a message such as “There is no change in the state of makeup. Please try makeup for a designated part.” May be notified. In addition, the makeup notification process may be ended when the first difference and the second difference do not change while the predetermined time has elapsed, and the determination of No continues in step S36.

Further, in the makeup notification process described above, it is determined in step S36 whether the makeup information actual value has changed by comparing the first difference and the second difference. Not limited to this, it may be determined whether the cosmetic information actual value has changed by comparing the first cosmetic information actual value itself with the second cosmetic information actual value itself. . Also, in this case, how the second makeup information actual measurement value changes from the first makeup information actual measurement value (for example, does the RGB value increase or decrease), and the makeup information target value It is also possible to determine whether or not makeup is properly performed at the second time point, as compared with the first time point.
Furthermore, in the makeup notification process described above, the target is reached by comparing the difference between the makeup information target value and the second makeup information actual value (that is, the second difference) with the predetermined threshold value in step S38. It was determined whether or not there was an evaluation target area (that is, an evaluation target area that could be appropriately dressed). The present invention is not limited to this, and it may be determined whether there is an evaluation target area that has reached the target by comparing the second makeup information actual value itself with a predetermined threshold value.
That is, in the makeup notification process, the determination may be performed without calculating the difference between the makeup information target values.

Also, the method of acquiring the makeup information target value may be made different. In this case, for example, the notification device 1 performs virtual makeup (hereinafter, referred to as “virtual makeup”) prior to the above-described makeup notification process. In virtual makeup, the image of the user captured by the imaging unit 16 and the color corresponding to the virtual cosmetic are superimposed and displayed on the display unit 19. Moreover, the state of makeup by virtual cosmetics is made different based on the operation by the user. For example, in the case where the virtual cosmetic is a virtual cheek, the position and the shape on which the cheek is placed are made different according to the user's operation. Alternatively, each area of the user's face is detected, and the position and shape on which cheeks are placed are automatically adjusted to the position and shape of each detected area of the user's face.
This makes it possible to make an appropriate virtual make-up that the user should aim for. Then, the RGB values of the makeup part and the shape of the makeup part in appropriate virtual makeup are acquired as makeup information target values.

  Then, by actually performing makeup in the makeup notification process described above, it is possible to evaluate actual makeup using the makeup information target value acquired by virtual makeup. As a result, it is possible to obtain a makeup information target value based on the user's face as a model, without the user actually making makeup using various cosmetics (that is, only by performing virtual makeup).

  However, the present invention is not limited to this, and the imaging unit 16 captures a face on which an expert such as a beauty staff member actually makes a makeup at a cosmetic store shop or the like, and obtains a makeup information target value from the image. You may do so. As a result, it is possible to obtain a makeup information target value based on the user's face as a model, to which makeup performed by the expert has been applied.

  Further, in this way, when the makeup information target value is acquired with the user's face as a model, the makeup information target value may be displayed very thinly in the above-described makeup notification process. For example, the cosmetic information target value is displayed with high transmittance (for example, 90 to 95% of transmissivity), the outline of the shape corresponding to the cosmetic information target value is displayed, or a makeup model image or the like is displayed. May be In this way, in the makeup notification process described above, the user can make makeup while referring to a specific target (example). Thus, the makeup information target value can be used not only for evaluating the makeup but also for improving the convenience of the makeup by the user.

  Further, this modification may be combined with the above-described embodiment. That is, the physical condition notification process and the makeup notification process may be selectively performed according to the user's selection operation, setting, and the like.

[Modification of physical condition notification process]
The physical condition notification process described above with reference to the flowchart of FIG. 5 is an example, and the present invention is not limited to this.
For example, in step S16, the determination unit 112 compares the first physical condition information with the second physical condition information, and determines whether the physical condition information has improved based on the comparison result. The processing may be modified, and in step S16, the determination unit 112 may compare the difference between the reference physical condition information and the first physical condition information and the difference between the reference physical condition information and the second physical condition information. Then, based on the comparison result of the difference, it may be determined how the physical condition information has changed. Specifically, if the difference between the second physical condition information and the reference physical condition information is reduced compared to the difference between the first physical condition information and the reference physical condition information, it is determined that the physical condition has improved, and the determination in S16 is Yes. If the difference between the second physical condition information and the reference physical condition information does not increase or change as compared to the difference between the first physical condition information and the reference physical condition information, it is determined that the physical condition is not improved , And S16 may be determined as No.
Then, in step S17, the selection unit 113 and the control unit 114 may cooperate with each other to notify the user that makeup has improved the physical condition information. Furthermore, after the notification in step S17, the evaluation target area in which the current state has reached the target (that is, the physical condition is definitely improved) by comparing the difference between the second physical condition information and the reference physical condition information with a predetermined threshold. It may be determined whether or not it has become an evaluation target area indicating that it has been done. Further, in this determination, when it is determined that the current state has reached the target, the main tone notification process may be ended after notification to that effect.
By being deformed in this manner, it becomes possible to continue the physical condition notification processing until the physical condition information of the user is improved by makeup.

Similarly, also in step S20, the determination unit 112 may compare the reference physical condition information with the second physical condition information. In this case, the difference between the reference physical condition information and the first physical condition information and the difference between the reference physical condition information and the second physical condition information may be compared. Then, based on the comparison result of the difference, it may be determined how the physical condition information has changed. Specifically, if the difference between the second physical condition information and the reference physical condition information decreases compared to the difference between the first physical condition information and the reference physical condition information, it is determined that the physical condition has improved, and the determination in S20 is Yes. If the difference between the second physical condition information and the reference physical condition information does not increase or change as compared to the difference between the first physical condition information and the reference physical condition information, it is determined that the physical condition is not improved , And S20 may be determined as No.
Then, in step S21, the selection unit 113 and the control unit 114 may cooperate to notify the user of the fact that the physical condition information has been improved by massage. Furthermore, after the notification in step S21, the evaluation target area in which the current state has reached the target (that is, the physical condition is surely improved) by comparing the difference between the second physical condition information and the reference physical condition information and the predetermined threshold. It may be determined whether or not it has become an evaluation target area indicating that it has been done. Further, in this determination, when it is determined that the current state has reached the target, the main tone notification process may be ended after notification to that effect.
By being deformed in this manner, it becomes possible to continue the physical condition notification processing until the physical condition information of the user is improved by the massage.

In addition, as another modification, step S12 and step S13 may be omitted. That is, the processes after step S14 may be performed without comparing the reference physical condition information with the first physical condition information.
By being deformed in this manner, for example, even if the user's physical condition is good, in order to further improve the user's physical condition information, it becomes possible to perform physical condition notification processing.

Further, as another modification, steps S18 to S22 may not be performed by setting in advance that the makeup mode is to be performed according to the user's operation or the like. That is, the care mode may not be performed. In this case, while omitting steps S12 to S15, steps S16 and S17 may be changed as follows.
That is, it may be determined in step S16 whether or not the physical condition information has been improved, and in step S17, the support information or the evaluation information may be notified based on the result, and then it may be modified to return to step S16 again.

Further, as another modification, steps S15 to S17 may not be performed by setting in advance that the care mode is to be performed according to the user's operation or the like. That is, the make mode may not be performed. In this case, while omitting steps S18 to S19, steps S20 and S21 may be changed as follows.
That is, it is determined in step S20 whether or not the physical condition information has been improved, and in step S21 or step S22, the support information or evaluation information based on the result is notified, and then it is modified to return to step S20 again. Good.

Further, in the physical condition notification process described above, the determination using the physical condition information of the user (for example, the value of R indicating the redness of the user's face) is performed in the determinations of step S12, step S16 and step S20. That is, it has been determined whether the user's physical condition has improved.
Not limited to this, in the determination of step S12, step S16, and step S20, the determination using the makeup information of the user (for example, each value of RGB indicating the state of makeup using cosmetics of various color tones) is performed You may That is, it may be determined whether the makeup of the user is properly performed.
In this case, as described above, steps S18 to S22 may not be performed by setting in advance that the makeup mode is to be performed according to the user's operation or the like. That is, the care mode may not be performed.

  As variously illustrated as the above [modification of physical condition notification processing], the physical condition notification processing described above may be partially modified (including omission or replacement) or physical condition within the scope not departing from the gist of the embodiment described above. Some of the notification processing and the makeup notification processing may be appropriately combined.

[Modification of makeup notification processing]
The makeup notification process described above with reference to the flowchart of FIG. 8 is an example, and the present invention is not limited to this.
For example, after step S35 performed first, the determination unit 112 determines the difference between the makeup information actual value calculated in step S35 and the makeup information target value (that is, the first difference), and a predetermined threshold value. A process of comparing with and may be added. Then, when it is determined that the first difference is smaller than the predetermined threshold and each evaluation target area has already reached the target, the makeup notification process is ended without performing the process after step S36. You may do so. Alternatively, only the notification in step S39 may be performed to end the makeup notification process. If it is determined that the first difference is larger than the predetermined threshold and each evaluation target area has not reached the target, processing in step S36 and subsequent steps will be performed. The process of comparing the first difference and the predetermined threshold as described above may not be performed.

  Due to this modification, processing such as calculation of the second difference and comparison of the first difference and the second difference may be omitted, which is unnecessary when makeup is properly performed in the first place. It becomes possible. In addition, the makeup information target value, which is a goal used to determine whether or not to perform the process after step S36, is based on the makeup information measurement value of one's face that has been achieved in the past. It may be a determined target value.

  In addition, as another modification, step S38, step S39, and step S40 may be omitted. In this case, in place of step S38, the determination unit 112 adds a process of determining whether a predetermined time has elapsed from the start of the makeup notification process. Then, steps S34 to S37 are repeated until the predetermined time elapses. In addition, when the predetermined time has elapsed, the selection unit 113 and the control unit 114 cooperate to perform notification. In this notification, if there is an evaluation target area achieved in the target, that is notified. On the other hand, if there is an evaluation target area that has not achieved the goal, that is notified. In this case, for the evaluation target area not achieving the goal, the value of the difference between the makeup information target value and the second makeup information actual value (that is, the second difference) is further set as the makeup achievement value. You may make it alert | report.

  By modifying in this way, the time for the makeup notification process can be determined in advance. Then, within that time, it can be informed whether appropriate makeup has been made. Moreover, when appropriate makeup is not made, the achievement value of makeup can be notified.

Further, in the above-described makeup notification process, in the determinations of step S36 and step S38, determination is performed using the makeup information of the user (for example, each value of RGB indicating the state of makeup using cosmetics of various color tones) The That is, it is determined whether the makeup of the user is properly performed.
Not limited to this, in the determinations of step S36 and step S38, determination may be performed using physical condition information of the user (for example, a value of R indicating redness of the user's face). That is, it may be determined whether the physical condition of the user has improved.

  As variously illustrated as [Modification of makeup notification processing] above, the above-described makeup notification processing may be partially modified (including omission or replacement) or physical condition without departing from the scope of the embodiment described above. Some of the notification processing and the makeup notification processing may be appropriately combined.

[Other modification]
Moreover, in the above-mentioned embodiment, although the alerting device 1 to which this invention is applied was demonstrated as an example the mirror which can be carried portable, it is not specifically limited to this.
For example, the present invention is applicable to an electronic device incorporated in a large-sized mirror such as a gaze, an electronic device incorporated in a stationary vanity, or a mirror-shaped electronic device installed in a bathroom.

The series of processes described above can be performed by hardware or software.
In other words, the functional configurations of FIG. 4 and FIG. 7 are merely examples and are not particularly limited. That is, it is sufficient if the notification device 1 is equipped with a function capable of executing the above-described series of processes as a whole, and what function blocks are used to realize this function is particularly shown in the examples of FIGS. It is not limited.
Further, one functional block may be configured by hardware alone, may be configured by software alone, or may be configured by a combination of them.
The functional configuration in the present embodiment is realized by a processor that executes arithmetic processing, and the processors that can be used in the present embodiment include various processing devices such as a single processor, a multiprocessor, and a multi-core processor alone. In addition to the above, those including various processing devices and processing circuits such as an application specific integrated circuit (ASIC) and a field-programmable gate array (FPGA) are included.

When the series of processes are executed by software, a program that configures the software is installed on a computer or the like from a network or a recording medium.
The computer may be a computer incorporated in dedicated hardware. The computer may be a computer capable of executing various functions by installing various programs, for example, a general-purpose personal computer.

  A recording medium including such a program is not only configured by the removable medium 100 of FIG. 2 distributed separately from the apparatus main body to provide the program to the user, but also the user in a state incorporated in advance in the apparatus main body The recording medium etc. provided to The removable medium 231 is formed of, for example, a magnetic disk (including a floppy disk), an optical disk, or a magneto-optical disk. The optical disc is composed of, for example, a CD-ROM (Compact Disk-Read Only Memory), a DVD (Digital Versatile Disk), a Blu-ray (registered trademark) Disc (Blu-ray Disc), or the like. The magneto-optical disk is configured by an MD (Mini-Disk) or the like. Further, the recording medium provided to the user in a state of being incorporated in the apparatus main body is, for example, the ROM 12 of FIG. 2 in which the program is recorded, a hard disk included in the storage unit 20 of FIG. Ru.

In the present specification, in the step of describing the program to be recorded on the recording medium, the processing performed chronologically along the order is, of course, parallel or individually not necessarily necessarily chronologically processing. It also includes the processing to be performed.
Also, in the present specification, the term "system" is intended to mean an overall device composed of a plurality of devices, a plurality of means, and the like.

  As mentioned above, although embodiment of this invention was described, this embodiment is only an illustration and does not limit the technical scope of this invention. The present invention can take other various embodiments, and furthermore, various changes such as omissions and substitutions can be made without departing from the scope of the present invention. These embodiments and modifications thereof are included in the scope and the gist of the invention described in the present specification, etc., and are included in the invention described in the claims and the equivalent scope thereof.

The invention described in the claims at the beginning of the application of the present application is appended below.
[Supplementary Note 1]
Face information acquisition means for acquiring face information;
Notification means for performing notification based on the face information;
Determining means for determining changes in the face information before notification and the face information after notification;
A control unit that controls notification by the notification unit based on the determination result by the determination unit;
A notification device comprising:
[Supplementary Note 2]
In addition to providing a plurality of types of notification means,
It further comprises selection means for selecting the type of the notification means,
The control means controls notification by the notification means selected by the selection means.
The alerting | reporting apparatus of Additional remark 1 characterized by the above-mentioned.
[Supplementary Note 3]
It further comprises calculation means for calculating the difference between the face information before notification and the face information after notification,
The control means causes the notification means to notify the difference calculated by the calculation means.
The alerting | reporting apparatus of Additional remark 1 characterized by the above-mentioned.
[Supplementary Note 4]
The control means causes the notification means to notify so as to emphasize the face information.
The alerting | reporting apparatus in any one of the additional notes 1 to 3 characterized by the above-mentioned.
[Supplementary Note 5]
The control means causes the notification means to notify information prompting a predetermined action according to the face information.
The alerting | reporting apparatus in any one of the additional notes 1 to 3 characterized by the above-mentioned.
[Supplementary Note 6]
The face information acquisition unit acquires, as the face information, an image of a subject that is an acquisition target of the face information,
The determination unit determines changes in the face information before notification and the face information after notification based on an image of the subject.
The notification device according to any one of appendices 1 to 5, characterized in that.
[Supplementary Note 7]
The notification means performs notification by light emission,
The control means controls notification by light emission of the notification means based on the determination result by the determination means.
The notification device according to any one of appendices 1 to 6, characterized in that
[Supplementary Note 8]
The informing means is to inform by letters.
The control means controls characters notified by the notification means based on the determination result by the determination means.
The notification device according to any one of appendices 1 to 7, characterized in that
[Supplementary Note 9]
The informing means is to inform by letters.
The control means controls the display position of the character notified by the notification means based on the determination result by the determination means.
The notification device according to any one of appendices 1 to 8, characterized in that
[Supplementary Note 10]
It has a display unit for displaying a subject for which the face information is to be acquired,
The notification device according to any one of appendices 1 to 9, wherein the display unit is a mirror or an image display unit.
[Supplementary Note 11]
11. The notification device according to any one of appendices 1 to 10, wherein the face information acquisition unit acquires information on physical condition or information on makeup as the face information.
[Supplementary Note 12]
The notification device according to any one of appendices 1 to 11, wherein the notification unit notifies support information or evaluation information based on the face information.
[Supplementary Note 13]
A face information acquisition step of acquiring face information;
A notification step of performing notification based on the face information;
A determination step of determining changes in the face information before notification and the face information after notification;
A control step of controlling notification by the notification step based on the determination result in the determination step;
A notification method including:
[Supplementary Note 14]
On the computer
Face information acquisition function to acquire face information,
A notification function of giving notification based on the face information;
A determination function of determining changes in the face information before notification and the face information after notification;
A control function that controls notification by the notification function based on a determination result by the determination function;
A program that is characterized by realizing

  DESCRIPTION OF SYMBOLS 1 ... alerting | reporting apparatus, 11 ... CPU, 12 ... ROM, 13 ... RAM, 14 ... bus, 15 ... input-output interface, 16 ... imaging part, 17 ... Light emitting unit, 18: input unit, 19: display unit, 20: storage unit, 21: drive, 100: removable media, 111: physical condition information acquisition unit, 112: Judgment part, 113 ... selection part, 114 ... control part, 115 ... makeup information acquisition part, 201 ... judgment information storage part, 202 ... notification information storage part

Claims (14)

Face information acquisition means for acquiring face information;
Notification means for performing notification based on the face information;
Determining means for determining changes in the face information before notification and the face information after notification;
A control unit that controls notification by the notification unit based on the determination result by the determination unit;
A notification device comprising: In addition to providing a plurality of types of notification means,
It further comprises selection means for selecting the type of the notification means,
The control means controls notification by the notification means selected by the selection means.
The notification device according to claim 1, characterized in that: It further comprises calculation means for calculating the difference between the face information before notification and the face information after notification,
The control means causes the notification means to notify the difference calculated by the calculation means.
The notification device according to claim 1, characterized in that: The control means causes the notification means to notify so as to emphasize the face information.
The notification device according to any one of claims 1 to 3, characterized in that: The control means causes the notification means to notify information prompting a predetermined action according to the face information.
The notification device according to any one of claims 1 to 3, characterized in that: The face information acquisition unit acquires, as the face information, an image of a subject that is an acquisition target of the face information,
The determination unit determines changes in the face information before notification and the face information after notification based on an image of the subject.
The notification device according to any one of claims 1 to 5, characterized in that: The notification means performs notification by light emission,
The control means controls notification by light emission of the notification means based on the determination result by the determination means.
The notification apparatus according to any one of claims 1 to 6, characterized in that: The informing means is to inform by letters.
The control means controls characters notified by the notification means based on the determination result by the determination means.
The notification device according to any one of claims 1 to 7, characterized in that: The informing means is to inform by letters.
The control means controls the display position of the character notified by the notification means based on the determination result by the determination means.
A notification device according to any one of claims 1 to 8, characterized in that. It has a display unit for displaying a subject for which the face information is to be acquired,
The notification device according to any one of claims 1 to 9, wherein the display unit is a mirror or an image display unit.   The notification device according to any one of claims 1 to 10, wherein the face information acquisition unit acquires information on physical condition or information on makeup as the face information.   The notification device according to any one of claims 1 to 11, wherein the notification means notifies support information or evaluation information based on the face information. A face information acquisition step of acquiring face information;
A notification step of performing notification based on the face information;
A determination step of determining changes in the face information before notification and the face information after notification;
A control step of controlling notification by the notification step based on the determination result in the determination step;
A notification method including: On the computer
Face information acquisition function to acquire face information,
A notification function of giving notification based on the face information;
A determination function of determining changes in the face information before notification and the face information after notification;
A control function that controls notification by the notification function based on a determination result by the determination function;
A program that is characterized by realizing

Images